2024-09-10T20:28:44.709 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T20:28:44.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T20:28:44.820 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/alternate-pool} email: hyelloji@redhat.com first_in_suite: false job_id: '7899626' kernel: flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - MDS_FAILED - MDS_DAMAGE sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUhu0Z70387LPMV7/lxZQQdMrzcCAf5WMbaTPmmF8KraDr85d//y/y6ChZgIqpmDfJmwNfxvp3AzQq3Q/Aak/g= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlPRLTOfIEagyyNKz2L+UTjYdjNsO26i7cE1HLRjKJm/qUexEupKDT4YQLHpVg3l/LHQQn/jg6Kv4oQGMCkgjw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_pool teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T20:28:44.820 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T20:28:44.821 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T20:28:44.821 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T20:28:44.823 INFO:teuthology.task.internal:Checking packages... 2024-09-10T20:28:44.843 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T20:28:44.843 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T20:28:44.843 INFO:teuthology.packaging:ref: None 2024-09-10T20:28:44.843 INFO:teuthology.packaging:tag: None 2024-09-10T20:28:44.843 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:28:44.843 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:28:44.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:28:44.983 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T20:28:44.984 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T20:28:44.990 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T20:28:44.991 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T20:28:45.005 INFO:teuthology.task.internal:Saving configuration 2024-09-10T20:28:45.020 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T20:28:45.026 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T20:28:45.051 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:23:46.700623', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUhu0Z70387LPMV7/lxZQQdMrzcCAf5WMbaTPmmF8KraDr85d//y/y6ChZgIqpmDfJmwNfxvp3AzQq3Q/Aak/g='} 2024-09-10T20:28:45.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:23:46.702090', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlPRLTOfIEagyyNKz2L+UTjYdjNsO26i7cE1HLRjKJm/qUexEupKDT4YQLHpVg3l/LHQQn/jg6Kv4oQGMCkgjw='} 2024-09-10T20:28:45.074 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T20:28:45.080 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T20:28:45.080 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T20:28:45.080 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T20:28:45.137 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff740c43be0>, signals=[15]) 2024-09-10T20:28:45.137 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T20:28:45.142 INFO:teuthology.task.internal:Opening connections... 2024-09-10T20:28:45.143 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:28:45.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:28:45.218 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:28:45.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:28:45.296 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T20:28:45.303 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-10T20:28:45.321 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-10T20:28:45.321 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:28:45.379 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:28:45.380 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:28:45.380 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:28:45.380 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:28:45.380 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:28:45.380 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-10T20:28:45.528 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-09-10T20:28:45.546 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-09-10T20:28:45.546 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-09-10T20:28:45.604 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-09-10T20:28:45.604 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:28:45.605 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:28:45.606 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-09-10T20:28:45.633 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T20:28:45.642 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T20:28:45.647 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T20:28:45.647 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:28:45.650 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:28:45.667 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T20:28:45.673 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T20:28:45.673 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:28:45.708 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:28:45.815 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T20:28:45.867 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T20:28:45.882 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T20:28:45.882 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'mon.b': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, timeout 300 2024-09-10T20:28:45.882 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:28:45.883 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:28:45.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:28:45.900 DEBUG:teuthology.task.kernel:sha1 for mon.b is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:28:45.900 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T20:28:45.901 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-10T20:28:45.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:28:45.902 DEBUG:teuthology.task.kernel:sha1 for mon.a is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:28:45.902 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T20:28:45.902 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-10T20:28:45.957 INFO:teuthology.orchestra.run.smithi143.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:28:45.957 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:28:45.958 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T20:28:45.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:28:45.962 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:28:45.962 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:28:45.962 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T20:28:45.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:28:46.102 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum upgrade -y linux-firmware 2024-09-10T20:28:46.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum upgrade -y linux-firmware 2024-09-10T20:28:48.582 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T20:28:50.483 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-10T20:28:51.319 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.2 MB 00:03 2024-09-10T20:28:56.084 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-10T20:28:56.520 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 20 MB 00:04 2024-09-10T20:28:58.277 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 19 kB 00:00 2024-09-10T20:28:59.906 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-10T20:29:02.437 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-10T20:29:04.121 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-10T20:29:05.395 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T20:29:05.499 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-10T20:29:07.544 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-10T20:29:07.545 INFO:teuthology.orchestra.run.smithi143.stdout:Nothing to do. 2024-09-10T20:29:07.545 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-10T20:29:07.650 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T20:29:07.651 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:29:07.800 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T20:29:07.800 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T20:29:07.802 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi143.front.sepia.ceph.com to complete... 2024-09-10T20:29:10.964 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T20:29:13.109 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-10T20:29:13.110 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-09-10T20:29:13.110 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-10T20:29:13.216 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T20:29:13.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T20:29:13.365 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T20:29:13.365 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T20:29:13.367 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2024-09-10T20:29:24.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10 20:29:24 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T20:29:24.167 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2024-09-10 20:29:24-- 2024-09-10T20:29:24.167 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 11s 2024-09-10T20:29:24.167 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 343M in 10s (33.1 MB/s) 2024-09-10T20:29:24.170 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.a... 2024-09-10T20:29:24.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T20:29:25.363 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10 20:29:25 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T20:29:25.364 INFO:teuthology.orchestra.run.smithi143.stderr:FINISHED --2024-09-10 20:29:25-- 2024-09-10T20:29:25.364 INFO:teuthology.orchestra.run.smithi143.stderr:Total wall clock time: 18s 2024-09-10T20:29:25.364 INFO:teuthology.orchestra.run.smithi143.stderr:Downloaded: 1 files, 343M in 17s (20.1 MB/s) 2024-09-10T20:29:25.366 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on mon.b... 2024-09-10T20:29:25.367 DEBUG:teuthology.orchestra.run.smithi143:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T20:29:26.275 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying... ######################################## 2024-09-10T20:29:26.518 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing... ######################################## 2024-09-10T20:29:26.638 INFO:teuthology.orchestra.run.smithi081.stdout:Updating / installing... 2024-09-10T20:29:27.502 INFO:teuthology.orchestra.run.smithi143.stdout:Verifying... ######################################## 2024-09-10T20:29:27.641 INFO:teuthology.orchestra.run.smithi143.stdout:Preparing... ######################################## 2024-09-10T20:29:27.764 INFO:teuthology.orchestra.run.smithi143.stdout:Updating / installing... 2024-09-10T20:29:34.695 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T20:29:35.700 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T20:30:14.725 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T20:30:14.725 DEBUG:teuthology.orchestra.run.smithi081:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T20:30:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T20:30:14.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T20:30:14.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T20:30:14.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T20:30:14.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T20:30:14.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T20:30:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T20:30:14.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T20:30:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T20:30:14.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T20:30:14.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T20:30:14.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T20:30:14.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T20:30:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T20:30:14.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T20:30:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T20:30:14.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T20:30:14.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T20:30:14.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T20:30:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T20:30:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T20:30:14.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T20:30:14.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T20:30:14.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T20:30:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T20:30:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T20:30:14.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T20:30:14.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T20:30:14.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T20:30:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T20:30:14.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T20:30:14.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T20:30:14.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T20:30:14.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T20:30:14.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T20:30:14.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T20:30:14.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T20:30:14.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T20:30:14.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T20:30:14.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T20:30:14.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T20:30:14.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T20:30:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T20:30:14.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T20:30:14.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T20:30:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T20:30:14.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T20:30:14.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T20:30:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T20:30:14.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T20:30:14.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T20:30:14.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T20:30:14.859 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T20:30:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T20:30:14.861 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T20:30:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T20:30:14.863 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T20:30:14.864 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T20:30:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T20:30:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T20:30:14.867 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T20:30:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T20:30:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T20:30:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T20:30:14.871 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T20:30:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T20:30:14.873 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T20:30:14.874 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T20:30:14.875 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T20:30:14.876 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T20:30:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T20:30:14.878 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T20:30:14.880 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T20:30:14.881 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T20:30:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T20:30:14.883 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T20:30:14.884 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T20:30:14.885 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T20:30:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T20:30:14.887 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T20:30:14.888 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T20:30:14.889 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T20:30:14.890 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T20:30:14.891 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T20:30:14.892 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T20:30:14.893 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T20:30:14.894 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T20:30:14.895 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T20:30:14.896 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T20:30:14.897 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T20:30:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T20:30:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T20:30:14.900 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T20:30:14.901 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T20:30:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T20:30:14.903 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T20:30:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T20:30:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T20:30:14.906 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T20:30:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T20:30:14.908 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T20:30:14.909 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T20:30:14.910 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T20:30:14.911 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T20:30:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T20:30:14.913 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T20:30:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T20:30:14.915 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T20:30:14.916 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T20:30:14.917 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T20:30:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T20:30:14.919 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T20:30:14.920 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T20:30:14.921 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T20:30:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T20:30:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T20:30:14.924 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T20:30:14.925 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T20:30:14.926 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T20:30:14.927 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T20:30:14.928 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T20:30:14.929 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T20:30:14.930 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T20:30:14.931 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T20:30:14.932 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T20:30:14.933 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T20:30:14.934 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T20:30:14.935 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T20:30:14.936 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T20:30:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T20:30:14.938 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T20:30:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T20:30:14.940 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T20:30:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T20:30:14.942 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T20:30:14.943 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T20:30:14.944 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T20:30:14.945 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T20:30:14.946 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T20:30:14.947 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T20:30:14.948 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T20:30:14.949 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T20:30:14.950 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:30:14.954 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:14.955 DEBUG:teuthology.orchestra.run.smithi081:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout:for file in vmlinuz System.map config; do 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:30:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: fi 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:14.979 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2024-09-10T20:30:14.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-10T20:30:15.054 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-10T20:30:15.054 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-10T20:30:15.054 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-10T20:30:15.054 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-10T20:30:15.054 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-10T20:30:15.055 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:30:15.056 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:30:15.056 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:30:15.056 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:30:15.056 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-10T20:30:15.056 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:30:15.056 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:30:15.057 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:30:15.057 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:15.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:30:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-10T20:30:16.007 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi143.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T20:30:16.007 DEBUG:teuthology.orchestra.run.smithi143:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T20:30:16.083 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T20:30:16.084 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T20:30:16.085 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T20:30:16.086 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T20:30:16.087 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T20:30:16.088 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T20:30:16.089 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T20:30:16.090 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T20:30:16.091 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T20:30:16.092 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T20:30:16.093 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T20:30:16.094 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T20:30:16.095 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T20:30:16.096 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T20:30:16.097 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T20:30:16.098 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T20:30:16.099 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T20:30:16.100 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T20:30:16.101 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T20:30:16.102 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T20:30:16.103 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T20:30:16.104 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T20:30:16.105 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T20:30:16.106 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T20:30:16.107 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T20:30:16.108 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T20:30:16.109 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T20:30:16.110 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T20:30:16.111 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T20:30:16.112 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T20:30:16.113 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T20:30:16.114 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T20:30:16.115 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T20:30:16.116 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T20:30:16.117 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T20:30:16.118 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T20:30:16.119 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T20:30:16.120 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T20:30:16.121 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T20:30:16.122 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T20:30:16.123 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T20:30:16.124 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T20:30:16.125 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T20:30:16.126 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T20:30:16.127 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T20:30:16.128 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T20:30:16.129 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T20:30:16.130 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T20:30:16.131 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T20:30:16.132 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T20:30:16.133 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T20:30:16.134 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T20:30:16.135 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T20:30:16.136 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T20:30:16.137 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T20:30:16.138 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T20:30:16.139 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T20:30:16.140 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T20:30:16.141 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T20:30:16.142 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T20:30:16.143 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T20:30:16.144 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T20:30:16.145 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T20:30:16.146 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T20:30:16.147 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T20:30:16.148 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T20:30:16.149 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T20:30:16.150 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T20:30:16.151 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T20:30:16.152 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T20:30:16.153 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T20:30:16.154 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T20:30:16.155 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T20:30:16.156 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T20:30:16.157 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T20:30:16.158 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T20:30:16.159 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T20:30:16.160 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T20:30:16.161 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T20:30:16.162 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T20:30:16.163 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T20:30:16.164 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T20:30:16.165 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T20:30:16.166 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T20:30:16.167 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T20:30:16.168 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T20:30:16.169 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T20:30:16.170 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T20:30:16.171 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T20:30:16.172 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T20:30:16.173 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T20:30:16.174 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T20:30:16.175 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T20:30:16.176 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T20:30:16.177 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T20:30:16.178 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T20:30:16.179 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T20:30:16.180 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T20:30:16.181 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T20:30:16.182 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T20:30:16.183 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T20:30:16.184 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T20:30:16.185 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T20:30:16.186 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T20:30:16.187 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T20:30:16.188 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T20:30:16.189 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T20:30:16.190 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T20:30:16.191 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T20:30:16.192 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T20:30:16.193 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T20:30:16.194 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T20:30:16.195 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T20:30:16.196 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T20:30:16.197 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T20:30:16.198 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T20:30:16.199 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T20:30:16.200 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T20:30:16.201 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T20:30:16.202 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T20:30:16.203 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T20:30:16.204 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T20:30:16.205 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T20:30:16.206 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T20:30:16.207 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T20:30:16.208 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T20:30:16.209 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T20:30:16.210 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T20:30:16.211 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T20:30:16.212 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T20:30:16.213 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T20:30:16.214 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T20:30:16.215 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T20:30:16.216 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T20:30:16.217 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T20:30:16.218 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T20:30:16.219 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T20:30:16.220 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T20:30:16.221 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T20:30:16.222 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T20:30:16.223 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T20:30:16.224 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T20:30:16.225 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T20:30:16.226 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T20:30:16.227 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T20:30:16.228 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T20:30:16.229 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T20:30:16.230 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T20:30:16.231 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T20:30:16.232 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T20:30:16.233 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T20:30:16.234 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T20:30:16.235 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T20:30:16.236 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T20:30:16.237 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T20:30:16.238 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T20:30:16.239 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T20:30:16.240 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T20:30:16.241 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T20:30:16.241 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T20:30:16.241 INFO:teuthology.orchestra.run.smithi143.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:30:16.244 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.244 DEBUG:teuthology.orchestra.run.smithi143:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T20:30:16.267 INFO:teuthology.orchestra.run.smithi143.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T20:30:16.267 INFO:teuthology.orchestra.run.smithi143.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:30:16.267 INFO:teuthology.orchestra.run.smithi143.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T20:30:16.267 INFO:teuthology.orchestra.run.smithi143.stdout:fi 2024-09-10T20:30:16.267 INFO:teuthology.orchestra.run.smithi143.stdout:for file in vmlinuz System.map config; do 2024-09-10T20:30:16.267 INFO:teuthology.orchestra.run.smithi143.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout: fi 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout:done 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout:fi 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.268 INFO:teuthology.orchestra.run.smithi143.stdout:fi 2024-09-10T20:30:16.269 INFO:teuthology.orchestra.run.smithi143.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T20:30:16.269 INFO:teuthology.orchestra.run.smithi143.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T20:30:16.269 INFO:teuthology.orchestra.run.smithi143.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.269 INFO:teuthology.orchestra.run.smithi143.stdout:fi 2024-09-10T20:30:16.270 DEBUG:teuthology.orchestra.run.smithi143:> sudo rpm -qi grub2-tools 2024-09-10T20:30:16.342 INFO:teuthology.orchestra.run.smithi143.stdout:Name : grub2-tools 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Epoch : 1 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Version : 2.06 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Release : 82.el9 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Architecture: x86_64 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Group : Unspecified 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Size : 8274670 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:License : GPLv3+ 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:30:16.343 INFO:teuthology.orchestra.run.smithi143.stdout:Packager : builder@centos.org 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:Vendor : CentOS 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:Summary : Support tools for GRUB. 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:Description : 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:hardware devices. 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:30:16.344 INFO:teuthology.orchestra.run.smithi143.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:30:16.345 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:30:16.345 INFO:teuthology.task.kernel:Updating grub on smithi143 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:16.345 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:30:16.960 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:30:16.978 INFO:teuthology.orchestra.run.smithi143.stderr:Generating grub configuration file ... 2024-09-10T20:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-10T20:30:16.982 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T20:30:16.997 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.SilsyL6dUW 2024-09-10T20:30:16.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SilsyL6dUW 2024-09-10T20:30:17.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.SilsyL6dUW 2024-09-10T20:30:17.207 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.SilsyL6dUW is 6KB 2024-09-10T20:30:17.257 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.SilsyL6dUW 2024-09-10T20:30:17.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:30:17.334 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:30:17.334 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:30:17.334 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:30:17.334 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T20:30:17.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:17.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-10T20:30:18.351 INFO:teuthology.orchestra.run.smithi143.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:30:18.380 INFO:teuthology.orchestra.run.smithi143.stderr:done 2024-09-10T20:30:18.382 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-09-10T20:30:18.397 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.1Szf7mkXjb 2024-09-10T20:30:18.398 DEBUG:teuthology.orchestra.run.smithi143:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1Szf7mkXjb 2024-09-10T20:30:18.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.1Szf7mkXjb 2024-09-10T20:30:18.610 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.1Szf7mkXjb is 6KB 2024-09-10T20:30:18.658 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.1Szf7mkXjb 2024-09-10T20:30:18.673 DEBUG:teuthology.orchestra.run.smithi143:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:30:18.735 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:30:18.735 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:30:18.735 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:30:18.735 INFO:teuthology.orchestra.run.smithi143.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T20:30:18.736 DEBUG:teuthology.orchestra.run.smithi143:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:30:18.890 DEBUG:teuthology.orchestra.run.smithi143:> sudo shutdown -r now 2024-09-10T20:30:47.502 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T20:30:47.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T20:30:47.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:30:48.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T20:30:48.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-10T20:30:48.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:31:22.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-10T20:31:31.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T20:31:31.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:31:48.915 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T20:31:49.569 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-10T20:31:57.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-10T20:31:57.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:32:01.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T20:32:01.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:32:01.949 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-10T20:32:02.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T20:32:02.481 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T20:32:02.481 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-10T20:32:02.515 INFO:teuthology.orchestra.run.smithi081.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:32:02.516 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:32:02.516 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:32:02.516 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:32:03.517 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T20:32:03.517 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T20:32:03.659 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-10T20:32:03.683 DEBUG:teuthology.parallel:result is None 2024-09-10T20:32:05.613 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-10T20:32:06.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-10T20:32:06.157 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T20:32:06.158 DEBUG:teuthology.orchestra.run.smithi143:> uname -r 2024-09-10T20:32:06.192 INFO:teuthology.orchestra.run.smithi143.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:32:06.192 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T20:32:06.192 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:32:06.192 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:32:07.193 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T20:32:07.193 DEBUG:teuthology.orchestra.run.smithi143:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T20:32:07.300 INFO:teuthology.orchestra.run.smithi143.stdout:ttyS1 2024-09-10T20:32:07.336 DEBUG:teuthology.parallel:result is None 2024-09-10T20:32:07.337 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T20:32:07.348 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T20:32:07.348 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:32:07.353 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:32:07.390 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T20:32:07.400 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T20:32:07.411 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T20:32:07.411 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:32:07.438 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:32:07.492 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T20:32:07.498 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T20:32:07.498 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:32:07.525 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:32:07.587 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:32:07.590 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:32:07.611 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:32:07.616 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:32:07.619 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T20:32:07.626 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T20:32:07.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:32:07.629 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:32:07.686 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T20:32:07.695 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T20:32:07.695 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:32:07.699 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:32:07.734 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:32:07.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:32:07.927 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:32:08.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:32:08.069 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:32:08.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:32:08.126 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:32:08.196 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:32:08.270 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:32:08.342 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:32:08.402 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:32:08.402 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:32:08.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-10T20:32:08.462 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-09-10T20:32:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:32:08.582 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:32:09.074 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T20:32:09.081 INFO:teuthology.task.internal:Starting timer... 2024-09-10T20:32:09.081 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T20:32:09.108 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T20:32:09.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-10T20:32:09.209 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-10T20:32:09.212 DEBUG:teuthology.orchestra.run.smithi143:> sudo service auditd rotate 2024-09-10T20:32:09.369 INFO:teuthology.orchestra.run.smithi143.stdout:Rotating logs: 2024-09-10T20:32:09.372 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T20:32:09.372 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-10T20:32:09.477 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-10T20:32:09.477 DEBUG:teuthology.orchestra.run.smithi143:> /usr/sbin/getenforce 2024-09-10T20:32:09.528 INFO:teuthology.orchestra.run.smithi143.stdout:Permissive 2024-09-10T20:32:09.528 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi143.front.sepia.ceph.com': 'permissive'} 2024-09-10T20:32:09.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:32:09.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:32:09.592 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:32:09.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:32:09.649 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T20:32:09.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:32:09.710 DEBUG:teuthology.orchestra.run.smithi143:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:32:09.785 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T20:32:09.798 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T20:32:09.810 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T20:32:09.811 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T20:36:54.256 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2024-09-10T20:36:54.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T20:36:54.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:36:54.358 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-10T20:36:54.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T20:36:54.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-10T20:36:54.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:36:54.587 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-10T20:36:54.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-10T20:36:54.701 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T20:36:54.710 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T20:36:54.711 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T20:36:54.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:36:54.715 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T20:36:54.715 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:36:54.772 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T20:36:54.801 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T20:36:54.802 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T20:36:54.831 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T20:36:54.852 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-10T20:36:54.876 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-10T20:36:54.883 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: ntpd: command not found 2024-09-10T20:36:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T20:36:54.907 INFO:teuthology.orchestra.run.smithi143.stdout:506 Cannot talk to daemon 2024-09-10T20:36:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T20:36:54.936 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T20:36:54.967 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T20:36:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:36:55.047 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:36:55.047 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-10T20:36:55.047 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.047 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.047 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.047 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.056 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:36:55.062 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:36:55.062 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-10T20:36:55.062 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.063 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.063 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.063 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:36:55.064 INFO:teuthology.run_tasks:Running task install... 2024-09-10T20:36:55.072 DEBUG:teuthology.task.install:project ceph 2024-09-10T20:36:55.072 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T20:36:55.072 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T20:36:55.072 INFO:teuthology.task.install:Using flavor: default 2024-09-10T20:36:55.078 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T20:36:55.078 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T20:36:55.079 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T20:36:55.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:36:55.081 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T20:36:55.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:36:55.240 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T20:36:55.240 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T20:36:55.257 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T20:36:55.257 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T20:36:55.371 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T20:36:55.372 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:36:55.372 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T20:36:55.397 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T20:36:55.397 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:36:55.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T20:36:55.427 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T20:36:55.428 DEBUG:teuthology.orchestra.run.smithi143:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T20:36:55.454 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T20:36:55.454 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T20:36:55.525 DEBUG:teuthology.orchestra.run.smithi143:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T20:36:55.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T20:36:55.603 DEBUG:teuthology.orchestra.run.smithi143:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T20:36:55.630 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T20:36:55.658 INFO:teuthology.orchestra.run.smithi143.stdout:check_obsoletes = 1 2024-09-10T20:36:55.661 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum clean all 2024-09-10T20:36:55.684 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-10T20:36:55.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-10T20:36:55.928 INFO:teuthology.orchestra.run.smithi143.stdout:45 files removed 2024-09-10T20:36:55.960 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T20:36:55.964 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-10T20:36:55.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T20:36:56.668 INFO:teuthology.orchestra.run.smithi143.stdout:ceph packages for x86_64 268 kB/s | 84 kB 00:00 2024-09-10T20:36:56.702 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 269 kB/s | 84 kB 00:00 2024-09-10T20:36:57.010 INFO:teuthology.orchestra.run.smithi143.stdout:ceph noarch packages 81 kB/s | 24 kB 00:00 2024-09-10T20:36:57.011 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-10T20:36:57.287 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T20:36:57.336 INFO:teuthology.orchestra.run.smithi143.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2024-09-10T20:36:57.795 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-10T20:36:57.961 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-10T20:37:00.296 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-10T20:37:00.363 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-10T20:37:05.322 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 6.5 MB 00:00 2024-09-10T20:37:06.564 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-10T20:37:07.256 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 19 kB 00:00 2024-09-10T20:37:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-10T20:37:08.494 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T20:37:09.694 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-10T20:37:14.950 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-09-10T20:37:16.008 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-10T20:37:17.472 INFO:teuthology.orchestra.run.smithi143.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:37:17.473 INFO:teuthology.orchestra.run.smithi143.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:37:17.487 INFO:teuthology.orchestra.run.smithi143.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T20:37:17.488 INFO:teuthology.orchestra.run.smithi143.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T20:37:17.489 INFO:teuthology.orchestra.run.smithi143.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T20:37:17.490 INFO:teuthology.orchestra.run.smithi143.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T20:37:17.492 INFO:teuthology.orchestra.run.smithi143.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T20:37:17.495 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T20:37:17.496 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T20:37:17.562 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-10T20:37:17.587 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-09-10T20:37:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-10T20:37:17.587 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-09-10T20:37:17.587 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-10T20:37:17.587 INFO:teuthology.orchestra.run.smithi143.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T20:37:17.588 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T20:37:17.589 INFO:teuthology.orchestra.run.smithi143.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T20:37:17.590 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrading: 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T20:37:17.591 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T20:37:17.592 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T20:37:17.593 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T20:37:17.594 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T20:37:17.595 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T20:37:17.596 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T20:37:17.597 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T20:37:17.598 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T20:37:17.599 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T20:37:17.600 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout:Installing weak dependencies: 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout:Install 149 Packages 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrade 8 Packages 2024-09-10T20:37:17.601 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:37:17.602 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 240 M 2024-09-10T20:37:17.602 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-10T20:37:17.926 INFO:teuthology.orchestra.run.smithi143.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-09-10T20:37:18.118 INFO:teuthology.orchestra.run.smithi143.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.6 MB/s | 900 kB 00:00 2024-09-10T20:37:18.202 INFO:teuthology.orchestra.run.smithi143.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.7 MB/s | 145 kB 00:00 2024-09-10T20:37:18.386 INFO:teuthology.orchestra.run.smithi143.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 8.6 MB/s | 5.5 MB 00:00 2024-09-10T20:37:18.461 INFO:teuthology.orchestra.run.smithi143.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 9.2 MB/s | 2.4 MB 00:00 2024-09-10T20:37:18.512 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:37:18.513 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T20:37:18.525 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T20:37:18.525 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T20:37:18.526 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T20:37:18.527 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T20:37:18.529 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T20:37:18.532 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T20:37:18.532 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T20:37:18.598 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-10T20:37:18.621 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-10T20:37:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-10T20:37:18.621 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-10T20:37:18.621 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-10T20:37:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T20:37:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T20:37:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T20:37:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T20:37:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T20:37:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T20:37:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T20:37:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T20:37:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T20:37:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T20:37:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T20:37:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T20:37:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T20:37:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T20:37:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T20:37:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T20:37:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T20:37:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T20:37:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T20:37:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T20:37:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T20:37:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T20:37:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T20:37:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T20:37:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T20:37:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T20:37:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T20:37:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-10T20:37:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T20:37:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:37:18.637 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-10T20:37:18.637 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-10T20:37:18.637 INFO:teuthology.orchestra.run.smithi081.stdout:Install 149 Packages 2024-09-10T20:37:18.637 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-10T20:37:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:37:18.638 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 240 M 2024-09-10T20:37:18.638 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-10T20:37:18.695 INFO:teuthology.orchestra.run.smithi143.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 4.9 MB/s | 1.5 MB 00:00 2024-09-10T20:37:19.012 INFO:teuthology.orchestra.run.smithi143.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 4.8 MB 00:00 2024-09-10T20:37:19.253 INFO:teuthology.orchestra.run.smithi143.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 14 MB/s | 22 MB 00:01 2024-09-10T20:37:19.329 INFO:teuthology.orchestra.run.smithi143.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 336 kB/s | 25 kB 00:00 2024-09-10T20:37:19.893 INFO:teuthology.orchestra.run.smithi081.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-09-10T20:37:20.062 INFO:teuthology.orchestra.run.smithi143.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 10 MB/s | 11 MB 00:01 2024-09-10T20:37:20.146 INFO:teuthology.orchestra.run.smithi143.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.7 MB/s | 225 kB 00:00 2024-09-10T20:37:20.271 INFO:teuthology.orchestra.run.smithi143.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 216 kB/s | 27 kB 00:00 2024-09-10T20:37:20.343 INFO:teuthology.orchestra.run.smithi081.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.0 MB/s | 900 kB 00:00 2024-09-10T20:37:20.363 INFO:teuthology.orchestra.run.smithi143.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 347 kB/s | 32 kB 00:00 2024-09-10T20:37:20.418 INFO:teuthology.orchestra.run.smithi081.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.9 MB/s | 145 kB 00:00 2024-09-10T20:37:20.497 INFO:teuthology.orchestra.run.smithi143.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.5 MB/s | 755 kB 00:00 2024-09-10T20:37:20.689 INFO:teuthology.orchestra.run.smithi143.stdout:(15/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 8.6 MB/s | 17 MB 00:01 2024-09-10T20:37:20.718 INFO:teuthology.orchestra.run.smithi143.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 746 kB/s | 162 kB 00:00 2024-09-10T20:37:20.756 INFO:teuthology.orchestra.run.smithi143.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T20:37:20.848 INFO:teuthology.orchestra.run.smithi143.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 3.7 MB/s | 507 kB 00:00 2024-09-10T20:37:20.940 INFO:teuthology.orchestra.run.smithi143.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 492 kB/s | 45 kB 00:00 2024-09-10T20:37:21.024 INFO:teuthology.orchestra.run.smithi143.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T20:37:21.035 INFO:teuthology.orchestra.run.smithi081.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 3.9 MB/s | 2.4 MB 00:00 2024-09-10T20:37:21.124 INFO:teuthology.orchestra.run.smithi143.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.6 MB/s | 161 kB 00:00 2024-09-10T20:37:21.160 INFO:teuthology.orchestra.run.smithi081.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 3.5 MB/s | 5.5 MB 00:01 2024-09-10T20:37:21.249 INFO:teuthology.orchestra.run.smithi143.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 2.5 MB/s | 321 kB 00:00 2024-09-10T20:37:21.358 INFO:teuthology.orchestra.run.smithi143.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 2.8 MB/s | 306 kB 00:00 2024-09-10T20:37:21.458 INFO:teuthology.orchestra.run.smithi143.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 997 kB/s | 99 kB 00:00 2024-09-10T20:37:21.527 INFO:teuthology.orchestra.run.smithi081.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-09-10T20:37:21.559 INFO:teuthology.orchestra.run.smithi143.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 853 kB/s | 85 kB 00:00 2024-09-10T20:37:22.117 INFO:teuthology.orchestra.run.smithi143.stdout:(26/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 5.7 MB/s | 3.2 MB 00:00 2024-09-10T20:37:22.202 INFO:teuthology.orchestra.run.smithi081.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 4.6 MB/s | 4.8 MB 00:01 2024-09-10T20:37:22.226 INFO:teuthology.orchestra.run.smithi143.stdout:(27/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 3.8 MB/s | 5.5 MB 00:01 2024-09-10T20:37:22.251 INFO:teuthology.orchestra.run.smithi143.stdout:(28/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.2 MB/s | 171 kB 00:00 2024-09-10T20:37:22.349 INFO:teuthology.orchestra.run.smithi143.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 279 kB/s | 34 kB 00:00 2024-09-10T20:37:22.377 INFO:teuthology.orchestra.run.smithi143.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.2 MB/s | 154 kB 00:00 2024-09-10T20:37:23.028 INFO:teuthology.orchestra.run.smithi081.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 6.3 MB/s | 22 MB 00:03 2024-09-10T20:37:23.120 INFO:teuthology.orchestra.run.smithi081.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 275 kB/s | 25 kB 00:00 2024-09-10T20:37:23.244 INFO:teuthology.orchestra.run.smithi143.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 13 MB/s | 50 MB 00:03 2024-09-10T20:37:23.361 INFO:teuthology.orchestra.run.smithi143.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.4 MB/s | 291 kB 00:00 2024-09-10T20:37:23.469 INFO:teuthology.orchestra.run.smithi143.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 6.8 MB/s | 7.4 MB 00:01 2024-09-10T20:37:23.511 INFO:teuthology.orchestra.run.smithi143.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 329 kB/s | 49 kB 00:00 2024-09-10T20:37:23.578 INFO:teuthology.orchestra.run.smithi143.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 151 kB/s | 16 kB 00:00 2024-09-10T20:37:23.603 INFO:teuthology.orchestra.run.smithi143.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 285 kB 00:00 2024-09-10T20:37:23.678 INFO:teuthology.orchestra.run.smithi081.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 7.4 MB/s | 11 MB 00:01 2024-09-10T20:37:23.679 INFO:teuthology.orchestra.run.smithi143.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 7.6 MB/s | 783 kB 00:00 2024-09-10T20:37:23.721 INFO:teuthology.orchestra.run.smithi143.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 156 kB/s | 18 kB 00:00 2024-09-10T20:37:23.745 INFO:teuthology.orchestra.run.smithi081.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.3 MB/s | 225 kB 00:00 2024-09-10T20:37:23.820 INFO:teuthology.orchestra.run.smithi081.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 361 kB/s | 27 kB 00:00 2024-09-10T20:37:23.821 INFO:teuthology.orchestra.run.smithi143.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-10T20:37:23.904 INFO:teuthology.orchestra.run.smithi081.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 382 kB/s | 32 kB 00:00 2024-09-10T20:37:23.918 INFO:teuthology.orchestra.run.smithi143.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-10T20:37:23.955 INFO:teuthology.orchestra.run.smithi143.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-10T20:37:23.980 INFO:teuthology.orchestra.run.smithi143.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 253 kB 00:00 2024-09-10T20:37:23.996 INFO:teuthology.orchestra.run.smithi081.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 8.1 MB/s | 755 kB 00:00 2024-09-10T20:37:24.023 INFO:teuthology.orchestra.run.smithi143.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-10T20:37:24.063 INFO:teuthology.orchestra.run.smithi081.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-10T20:37:24.073 INFO:teuthology.orchestra.run.smithi143.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-10T20:37:24.098 INFO:teuthology.orchestra.run.smithi143.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-10T20:37:24.113 INFO:teuthology.orchestra.run.smithi081.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T20:37:24.124 INFO:teuthology.orchestra.run.smithi143.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T20:37:24.149 INFO:teuthology.orchestra.run.smithi143.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T20:37:24.230 INFO:teuthology.orchestra.run.smithi081.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 4.3 MB/s | 507 kB 00:00 2024-09-10T20:37:24.324 INFO:teuthology.orchestra.run.smithi143.stdout:(48/157): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-10T20:37:24.358 INFO:teuthology.orchestra.run.smithi143.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-10T20:37:24.400 INFO:teuthology.orchestra.run.smithi143.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-10T20:37:24.431 INFO:teuthology.orchestra.run.smithi081.stdout:(18/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 5.9 MB/s | 17 MB 00:02 2024-09-10T20:37:24.485 INFO:teuthology.orchestra.run.smithi143.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-10T20:37:24.492 INFO:teuthology.orchestra.run.smithi143.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-10T20:37:24.497 INFO:teuthology.orchestra.run.smithi081.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 682 kB/s | 45 kB 00:00 2024-09-10T20:37:24.551 INFO:teuthology.orchestra.run.smithi143.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-10T20:37:24.572 INFO:teuthology.orchestra.run.smithi081.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.9 MB/s | 143 kB 00:00 2024-09-10T20:37:24.648 INFO:teuthology.orchestra.run.smithi081.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.1 MB/s | 161 kB 00:00 2024-09-10T20:37:24.683 INFO:teuthology.orchestra.run.smithi143.stdout:(54/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-10T20:37:24.731 INFO:teuthology.orchestra.run.smithi081.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 3.8 MB/s | 321 kB 00:00 2024-09-10T20:37:24.809 INFO:teuthology.orchestra.run.smithi081.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.0 MB/s | 306 kB 00:00 2024-09-10T20:37:24.835 INFO:teuthology.orchestra.run.smithi143.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 64 kB/s | 18 kB 00:00 2024-09-10T20:37:24.877 INFO:teuthology.orchestra.run.smithi143.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 58 kB/s | 11 kB 00:00 2024-09-10T20:37:24.898 INFO:teuthology.orchestra.run.smithi081.stdout:(24/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.3 MB/s | 5.5 MB 00:00 2024-09-10T20:37:24.945 INFO:teuthology.orchestra.run.smithi081.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 723 kB/s | 99 kB 00:00 2024-09-10T20:37:24.974 INFO:teuthology.orchestra.run.smithi081.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-10T20:37:25.058 INFO:teuthology.orchestra.run.smithi081.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.0 MB/s | 171 kB 00:00 2024-09-10T20:37:25.074 INFO:teuthology.orchestra.run.smithi143.stdout:(57/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 5.2 MB/s | 14 MB 00:02 2024-09-10T20:37:25.103 INFO:teuthology.orchestra.run.smithi143.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 639 kB/s | 171 kB 00:00 2024-09-10T20:37:25.128 INFO:teuthology.orchestra.run.smithi143.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 640 kB/s | 160 kB 00:00 2024-09-10T20:37:25.158 INFO:teuthology.orchestra.run.smithi081.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 342 kB/s | 34 kB 00:00 2024-09-10T20:37:25.228 INFO:teuthology.orchestra.run.smithi143.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2024-09-10T20:37:25.242 INFO:teuthology.orchestra.run.smithi081.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.8 MB/s | 154 kB 00:00 2024-09-10T20:37:25.270 INFO:teuthology.orchestra.run.smithi143.stdout:(61/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 232 kB/s | 45 kB 00:00 2024-09-10T20:37:25.295 INFO:teuthology.orchestra.run.smithi143.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-10T20:37:25.354 INFO:teuthology.orchestra.run.smithi143.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 195 kB/s | 24 kB 00:00 2024-09-10T20:37:25.396 INFO:teuthology.orchestra.run.smithi143.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-10T20:37:25.442 INFO:teuthology.orchestra.run.smithi143.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-10T20:37:25.488 INFO:teuthology.orchestra.run.smithi143.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-10T20:37:25.513 INFO:teuthology.orchestra.run.smithi143.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-10T20:37:25.567 INFO:teuthology.orchestra.run.smithi081.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 5.1 MB/s | 3.2 MB 00:00 2024-09-10T20:37:25.622 INFO:teuthology.orchestra.run.smithi143.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-10T20:37:25.681 INFO:teuthology.orchestra.run.smithi143.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-10T20:37:25.731 INFO:teuthology.orchestra.run.smithi143.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-10T20:37:25.757 INFO:teuthology.orchestra.run.smithi143.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-10T20:37:25.865 INFO:teuthology.orchestra.run.smithi143.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-10T20:37:25.907 INFO:teuthology.orchestra.run.smithi143.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-10T20:37:25.949 INFO:teuthology.orchestra.run.smithi143.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-10T20:37:26.041 INFO:teuthology.orchestra.run.smithi143.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-10T20:37:26.083 INFO:teuthology.orchestra.run.smithi143.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 459 kB/s | 61 kB 00:00 2024-09-10T20:37:26.108 INFO:teuthology.orchestra.run.smithi143.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-10T20:37:26.159 INFO:teuthology.orchestra.run.smithi143.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-10T20:37:26.230 INFO:teuthology.orchestra.run.smithi143.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 212 kB/s | 26 kB 00:00 2024-09-10T20:37:26.301 INFO:teuthology.orchestra.run.smithi143.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-09-10T20:37:26.326 INFO:teuthology.orchestra.run.smithi143.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-10T20:37:26.418 INFO:teuthology.orchestra.run.smithi143.stdout:(82/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-10T20:37:26.469 INFO:teuthology.orchestra.run.smithi143.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 208 kB/s | 35 kB 00:00 2024-09-10T20:37:26.511 INFO:teuthology.orchestra.run.smithi143.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-10T20:37:26.615 INFO:teuthology.orchestra.run.smithi143.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-10T20:37:26.645 INFO:teuthology.orchestra.run.smithi143.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-09-10T20:37:26.670 INFO:teuthology.orchestra.run.smithi143.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 486 kB/s | 77 kB 00:00 2024-09-10T20:37:26.720 INFO:teuthology.orchestra.run.smithi143.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 403 kB/s | 42 kB 00:00 2024-09-10T20:37:26.745 INFO:teuthology.orchestra.run.smithi143.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-10T20:37:26.771 INFO:teuthology.orchestra.run.smithi143.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-10T20:37:26.804 INFO:teuthology.orchestra.run.smithi143.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-10T20:37:26.846 INFO:teuthology.orchestra.run.smithi143.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 507 kB/s | 51 kB 00:00 2024-09-10T20:37:26.897 INFO:teuthology.orchestra.run.smithi143.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-09-10T20:37:26.922 INFO:teuthology.orchestra.run.smithi143.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-10T20:37:26.993 INFO:teuthology.orchestra.run.smithi081.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 13 MB/s | 50 MB 00:03 2024-09-10T20:37:27.000 INFO:teuthology.orchestra.run.smithi143.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 428 kB/s | 44 kB 00:00 2024-09-10T20:37:27.039 INFO:teuthology.orchestra.run.smithi143.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-10T20:37:27.065 INFO:teuthology.orchestra.run.smithi143.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 559 kB/s | 36 kB 00:00 2024-09-10T20:37:27.084 INFO:teuthology.orchestra.run.smithi081.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 4.9 MB/s | 7.4 MB 00:01 2024-09-10T20:37:27.115 INFO:teuthology.orchestra.run.smithi143.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-10T20:37:27.117 INFO:teuthology.orchestra.run.smithi081.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.3 MB/s | 291 kB 00:00 2024-09-10T20:37:27.149 INFO:teuthology.orchestra.run.smithi143.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-10T20:37:27.160 INFO:teuthology.orchestra.run.smithi081.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 660 kB/s | 49 kB 00:00 2024-09-10T20:37:27.182 INFO:teuthology.orchestra.run.smithi143.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 865 kB/s | 58 kB 00:00 2024-09-10T20:37:27.202 INFO:teuthology.orchestra.run.smithi081.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 197 kB/s | 16 kB 00:00 2024-09-10T20:37:27.252 INFO:teuthology.orchestra.run.smithi081.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 285 kB 00:00 2024-09-10T20:37:27.385 INFO:teuthology.orchestra.run.smithi143.stdout:(101/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-10T20:37:27.402 INFO:teuthology.orchestra.run.smithi081.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 6.6 MB/s | 14 MB 00:02 2024-09-10T20:37:27.416 INFO:teuthology.orchestra.run.smithi143.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 272 kB/s | 64 kB 00:00 2024-09-10T20:37:27.442 INFO:teuthology.orchestra.run.smithi143.stdout:(103/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 327 kB/s | 96 kB 00:00 2024-09-10T20:37:27.444 INFO:teuthology.orchestra.run.smithi081.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 95 kB/s | 18 kB 00:00 2024-09-10T20:37:27.467 INFO:teuthology.orchestra.run.smithi143.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 553 kB/s | 45 kB 00:00 2024-09-10T20:37:27.486 INFO:teuthology.orchestra.run.smithi081.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 2.7 MB/s | 783 kB 00:00 2024-09-10T20:37:27.525 INFO:teuthology.orchestra.run.smithi143.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-10T20:37:27.567 INFO:teuthology.orchestra.run.smithi143.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-10T20:37:27.592 INFO:teuthology.orchestra.run.smithi143.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 851 kB/s | 19 kB 00:00 2024-09-10T20:37:27.594 INFO:teuthology.orchestra.run.smithi081.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-10T20:37:27.629 INFO:teuthology.orchestra.run.smithi081.stdout:(41/157): fuse-2.9.9-16.el9.x86_64.rpm 354 kB/s | 80 kB 00:00 2024-09-10T20:37:27.643 INFO:teuthology.orchestra.run.smithi143.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-10T20:37:27.676 INFO:teuthology.orchestra.run.smithi143.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-10T20:37:27.679 INFO:teuthology.orchestra.run.smithi081.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-10T20:37:27.702 INFO:teuthology.orchestra.run.smithi143.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 443 kB/s | 26 kB 00:00 2024-09-10T20:37:27.729 INFO:teuthology.orchestra.run.smithi081.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-10T20:37:27.754 INFO:teuthology.orchestra.run.smithi081.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T20:37:27.769 INFO:teuthology.orchestra.run.smithi143.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-10T20:37:27.796 INFO:teuthology.orchestra.run.smithi081.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-10T20:37:27.802 INFO:teuthology.orchestra.run.smithi143.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 387 kB/s | 49 kB 00:00 2024-09-10T20:37:27.821 INFO:teuthology.orchestra.run.smithi081.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-10T20:37:27.827 INFO:teuthology.orchestra.run.smithi143.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-10T20:37:27.838 INFO:teuthology.orchestra.run.smithi081.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-10T20:37:27.864 INFO:teuthology.orchestra.run.smithi081.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-10T20:37:27.903 INFO:teuthology.orchestra.run.smithi143.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-10T20:37:27.920 INFO:teuthology.orchestra.run.smithi143.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T20:37:27.930 INFO:teuthology.orchestra.run.smithi081.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-10T20:37:27.937 INFO:teuthology.orchestra.run.smithi143.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T20:37:27.971 INFO:teuthology.orchestra.run.smithi143.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-10T20:37:27.972 INFO:teuthology.orchestra.run.smithi081.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-09-10T20:37:27.987 INFO:teuthology.orchestra.run.smithi143.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-10T20:37:28.013 INFO:teuthology.orchestra.run.smithi143.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-10T20:37:28.022 INFO:teuthology.orchestra.run.smithi081.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-10T20:37:28.055 INFO:teuthology.orchestra.run.smithi143.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-10T20:37:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-09-10T20:37:28.106 INFO:teuthology.orchestra.run.smithi081.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-10T20:37:28.132 INFO:teuthology.orchestra.run.smithi081.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-10T20:37:28.148 INFO:teuthology.orchestra.run.smithi143.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-09-10T20:37:28.180 INFO:teuthology.orchestra.run.smithi143.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2024-09-10T20:37:28.199 INFO:teuthology.orchestra.run.smithi081.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-10T20:37:28.206 INFO:teuthology.orchestra.run.smithi143.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.4 MB/s | 220 kB 00:00 2024-09-10T20:37:28.231 INFO:teuthology.orchestra.run.smithi143.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T20:37:28.241 INFO:teuthology.orchestra.run.smithi081.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-10T20:37:28.257 INFO:teuthology.orchestra.run.smithi143.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-10T20:37:28.282 INFO:teuthology.orchestra.run.smithi143.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-10T20:37:28.283 INFO:teuthology.orchestra.run.smithi081.stdout:(57/157): flexiblas-openblas-openmp-3.0.4-8.el9 103 kB/s | 18 kB 00:00 2024-09-10T20:37:28.307 INFO:teuthology.orchestra.run.smithi143.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-10T20:37:28.308 INFO:teuthology.orchestra.run.smithi081.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-10T20:37:28.333 INFO:teuthology.orchestra.run.smithi143.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-10T20:37:28.334 INFO:teuthology.orchestra.run.smithi081.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-10T20:37:28.358 INFO:teuthology.orchestra.run.smithi143.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-10T20:37:28.359 INFO:teuthology.orchestra.run.smithi081.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-10T20:37:28.383 INFO:teuthology.orchestra.run.smithi143.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T20:37:28.392 INFO:teuthology.orchestra.run.smithi081.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-10T20:37:28.417 INFO:teuthology.orchestra.run.smithi143.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T20:37:28.434 INFO:teuthology.orchestra.run.smithi081.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-10T20:37:28.442 INFO:teuthology.orchestra.run.smithi143.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T20:37:28.459 INFO:teuthology.orchestra.run.smithi081.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-10T20:37:28.484 INFO:teuthology.orchestra.run.smithi143.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-10T20:37:28.485 INFO:teuthology.orchestra.run.smithi081.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-10T20:37:28.510 INFO:teuthology.orchestra.run.smithi081.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-10T20:37:28.533 INFO:teuthology.orchestra.run.smithi143.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 336 kB/s | 16 kB 00:00 2024-09-10T20:37:28.535 INFO:teuthology.orchestra.run.smithi081.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-10T20:37:28.560 INFO:teuthology.orchestra.run.smithi081.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 513 kB/s | 38 kB 00:00 2024-09-10T20:37:28.568 INFO:teuthology.orchestra.run.smithi143.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-10T20:37:28.594 INFO:teuthology.orchestra.run.smithi143.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-10T20:37:28.618 INFO:teuthology.orchestra.run.smithi143.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-10T20:37:28.644 INFO:teuthology.orchestra.run.smithi143.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T20:37:28.669 INFO:teuthology.orchestra.run.smithi143.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T20:37:28.669 INFO:teuthology.orchestra.run.smithi081.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-10T20:37:28.694 INFO:teuthology.orchestra.run.smithi143.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-10T20:37:28.720 INFO:teuthology.orchestra.run.smithi143.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-10T20:37:28.744 INFO:teuthology.orchestra.run.smithi081.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-10T20:37:28.745 INFO:teuthology.orchestra.run.smithi143.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T20:37:28.795 INFO:teuthology.orchestra.run.smithi081.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-10T20:37:28.807 INFO:teuthology.orchestra.run.smithi143.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-10T20:37:28.820 INFO:teuthology.orchestra.run.smithi081.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-10T20:37:28.841 INFO:teuthology.orchestra.run.smithi143.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 938 kB/s | 90 kB 00:00 2024-09-10T20:37:28.862 INFO:teuthology.orchestra.run.smithi081.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-10T20:37:28.866 INFO:teuthology.orchestra.run.smithi143.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-09-10T20:37:28.912 INFO:teuthology.orchestra.run.smithi081.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-10T20:37:28.917 INFO:teuthology.orchestra.run.smithi143.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-09-10T20:37:28.937 INFO:teuthology.orchestra.run.smithi081.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-10T20:37:28.942 INFO:teuthology.orchestra.run.smithi143.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-10T20:37:28.967 INFO:teuthology.orchestra.run.smithi143.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-10T20:37:29.004 INFO:teuthology.orchestra.run.smithi081.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 922 kB/s | 61 kB 00:00 2024-09-10T20:37:29.026 INFO:teuthology.orchestra.run.smithi143.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T20:37:29.105 INFO:teuthology.orchestra.run.smithi081.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-09-10T20:37:29.130 INFO:teuthology.orchestra.run.smithi081.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T20:37:29.205 INFO:teuthology.orchestra.run.smithi081.stdout:(78/157): postgresql-server-13.16-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-09-10T20:37:29.210 INFO:teuthology.orchestra.run.smithi143.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-10T20:37:29.230 INFO:teuthology.orchestra.run.smithi081.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-10T20:37:29.256 INFO:teuthology.orchestra.run.smithi081.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-10T20:37:29.298 INFO:teuthology.orchestra.run.smithi081.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 208 kB/s | 19 kB 00:00 2024-09-10T20:37:29.302 INFO:teuthology.orchestra.run.smithi143.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.7 MB/s | 3.2 MB 00:00 2024-09-10T20:37:29.323 INFO:teuthology.orchestra.run.smithi081.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-09-10T20:37:29.348 INFO:teuthology.orchestra.run.smithi081.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-10T20:37:29.360 INFO:teuthology.orchestra.run.smithi143.stdout:(152/157): NetworkManager-libnm-1.49.90-1.el9.x 12 MB/s | 1.8 MB 00:00 2024-09-10T20:37:29.402 INFO:teuthology.orchestra.run.smithi143.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-10T20:37:29.415 INFO:teuthology.orchestra.run.smithi081.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-09-10T20:37:29.427 INFO:teuthology.orchestra.run.smithi143.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 326 kB/s | 41 kB 00:00 2024-09-10T20:37:29.441 INFO:teuthology.orchestra.run.smithi081.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-10T20:37:29.474 INFO:teuthology.orchestra.run.smithi081.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T20:37:29.494 INFO:teuthology.orchestra.run.smithi143.stdout:(155/157): librados2-19.3.0-4854.g8f219c47.el9. 6.3 MB/s | 3.5 MB 00:00 2024-09-10T20:37:29.508 INFO:teuthology.orchestra.run.smithi081.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 632 kB/s | 42 kB 00:00 2024-09-10T20:37:29.536 INFO:teuthology.orchestra.run.smithi143.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-10T20:37:29.592 INFO:teuthology.orchestra.run.smithi081.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-10T20:37:29.617 INFO:teuthology.orchestra.run.smithi081.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-10T20:37:29.642 INFO:teuthology.orchestra.run.smithi081.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-09-10T20:37:29.667 INFO:teuthology.orchestra.run.smithi081.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-10T20:37:29.684 INFO:teuthology.orchestra.run.smithi081.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 761 kB/s | 51 kB 00:00 2024-09-10T20:37:29.701 INFO:teuthology.orchestra.run.smithi081.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 912 kB/s | 54 kB 00:00 2024-09-10T20:37:29.751 INFO:teuthology.orchestra.run.smithi081.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-09-10T20:37:29.768 INFO:teuthology.orchestra.run.smithi081.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-09-10T20:37:29.827 INFO:teuthology.orchestra.run.smithi081.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-10T20:37:29.844 INFO:teuthology.orchestra.run.smithi081.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-09-10T20:37:29.886 INFO:teuthology.orchestra.run.smithi081.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-09-10T20:37:29.911 INFO:teuthology.orchestra.run.smithi081.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-10T20:37:29.912 INFO:teuthology.orchestra.run.smithi143.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 2.4 MB 00:00 2024-09-10T20:37:29.917 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:37:29.917 INFO:teuthology.orchestra.run.smithi143.stdout:Total 20 MB/s | 240 MB 00:12 2024-09-10T20:37:29.945 INFO:teuthology.orchestra.run.smithi081.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-10T20:37:29.995 INFO:teuthology.orchestra.run.smithi081.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-10T20:37:30.020 INFO:teuthology.orchestra.run.smithi081.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-09-10T20:37:30.087 INFO:teuthology.orchestra.run.smithi081.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 489 kB/s | 45 kB 00:00 2024-09-10T20:37:30.137 INFO:teuthology.orchestra.run.smithi081.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-10T20:37:30.455 INFO:teuthology.orchestra.run.smithi081.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-10T20:37:30.497 INFO:teuthology.orchestra.run.smithi081.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-09-10T20:37:30.522 INFO:teuthology.orchestra.run.smithi081.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 858 kB/s | 19 kB 00:00 2024-09-10T20:37:30.580 INFO:teuthology.orchestra.run.smithi081.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-09-10T20:37:30.606 INFO:teuthology.orchestra.run.smithi081.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T20:37:30.648 INFO:teuthology.orchestra.run.smithi081.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-09-10T20:37:30.673 INFO:teuthology.orchestra.run.smithi081.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 728 kB/s | 49 kB 00:00 2024-09-10T20:37:30.723 INFO:teuthology.orchestra.run.smithi081.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.8 MB/s | 151 kB 00:00 2024-09-10T20:37:30.757 INFO:teuthology.orchestra.run.smithi081.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-09-10T20:37:30.840 INFO:teuthology.orchestra.run.smithi081.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-10T20:37:30.874 INFO:teuthology.orchestra.run.smithi081.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-10T20:37:30.908 INFO:teuthology.orchestra.run.smithi081.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-10T20:37:30.933 INFO:teuthology.orchestra.run.smithi081.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 552 kB/s | 32 kB 00:00 2024-09-10T20:37:30.958 INFO:teuthology.orchestra.run.smithi081.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 283 kB/s | 14 kB 00:00 2024-09-10T20:37:30.983 INFO:teuthology.orchestra.run.smithi081.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T20:37:31.059 INFO:teuthology.orchestra.run.smithi081.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-10T20:37:31.084 INFO:teuthology.orchestra.run.smithi081.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-10T20:37:31.109 INFO:teuthology.orchestra.run.smithi081.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-10T20:37:31.151 INFO:teuthology.orchestra.run.smithi081.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.3 MB/s | 220 kB 00:00 2024-09-10T20:37:31.177 INFO:teuthology.orchestra.run.smithi081.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-10T20:37:31.202 INFO:teuthology.orchestra.run.smithi081.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-10T20:37:31.227 INFO:teuthology.orchestra.run.smithi081.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-10T20:37:31.252 INFO:teuthology.orchestra.run.smithi081.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-10T20:37:31.277 INFO:teuthology.orchestra.run.smithi081.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-10T20:37:31.303 INFO:teuthology.orchestra.run.smithi081.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T20:37:31.336 INFO:teuthology.orchestra.run.smithi081.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T20:37:31.370 INFO:teuthology.orchestra.run.smithi081.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T20:37:31.403 INFO:teuthology.orchestra.run.smithi081.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T20:37:31.446 INFO:teuthology.orchestra.run.smithi081.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-10T20:37:31.471 INFO:teuthology.orchestra.run.smithi081.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-10T20:37:31.521 INFO:teuthology.orchestra.run.smithi081.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.7 MB/s | 2.0 MB 00:00 2024-09-10T20:37:31.546 INFO:teuthology.orchestra.run.smithi081.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-10T20:37:31.571 INFO:teuthology.orchestra.run.smithi081.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-10T20:37:31.597 INFO:teuthology.orchestra.run.smithi081.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 716 kB/s | 90 kB 00:00 2024-09-10T20:37:31.614 INFO:teuthology.orchestra.run.smithi081.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-09-10T20:37:31.631 INFO:teuthology.orchestra.run.smithi081.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-10T20:37:31.647 INFO:teuthology.orchestra.run.smithi081.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-10T20:37:31.665 INFO:teuthology.orchestra.run.smithi081.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-10T20:37:31.690 INFO:teuthology.orchestra.run.smithi081.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-10T20:37:31.715 INFO:teuthology.orchestra.run.smithi081.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T20:37:31.740 INFO:teuthology.orchestra.run.smithi081.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-10T20:37:31.774 INFO:teuthology.orchestra.run.smithi081.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-10T20:37:31.808 INFO:teuthology.orchestra.run.smithi081.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T20:37:31.833 INFO:teuthology.orchestra.run.smithi081.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-10T20:37:31.933 INFO:teuthology.orchestra.run.smithi081.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-10T20:37:32.011 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-10T20:37:32.042 INFO:teuthology.orchestra.run.smithi081.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 21 MB/s | 2.3 MB 00:00 2024-09-10T20:37:32.176 INFO:teuthology.orchestra.run.smithi081.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-10T20:37:32.195 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-10T20:37:32.195 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-10T20:37:32.226 INFO:teuthology.orchestra.run.smithi081.stdout:(152/157): NetworkManager-libnm-1.49.90-1.el9.x 9.9 MB/s | 1.8 MB 00:00 2024-09-10T20:37:32.340 INFO:teuthology.orchestra.run.smithi081.stdout:(153/157): librados2-19.3.0-4854.g8f219c47.el9. 6.5 MB/s | 3.5 MB 00:00 2024-09-10T20:37:32.377 INFO:teuthology.orchestra.run.smithi081.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 203 kB/s | 41 kB 00:00 2024-09-10T20:37:32.402 INFO:teuthology.orchestra.run.smithi081.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 1.4 MB/s | 249 kB 00:00 2024-09-10T20:37:32.452 INFO:teuthology.orchestra.run.smithi081.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-10T20:37:32.519 INFO:teuthology.orchestra.run.smithi081.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-10T20:37:32.525 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:37:32.525 INFO:teuthology.orchestra.run.smithi081.stdout:Total 17 MB/s | 240 MB 00:13 2024-09-10T20:37:34.616 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-10T20:37:34.650 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-10T20:37:34.651 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-10T20:37:34.803 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-10T20:37:34.803 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-10T20:37:37.364 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-10T20:37:37.365 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-10T20:37:41.822 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-10T20:37:41.959 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T20:37:42.238 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T20:37:42.350 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T20:37:42.395 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T20:37:42.427 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T20:37:42.487 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T20:37:42.848 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T20:37:42.952 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:37:43.106 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:37:43.136 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:37:43.242 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:37:43.279 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:37:43.315 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T20:37:43.554 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T20:37:43.624 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T20:37:43.650 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:37:43.752 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:37:43.784 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:37:43.858 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:37:43.885 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:37:43.930 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:37:44.222 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-10T20:37:44.287 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:37:44.416 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T20:37:44.466 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T20:37:44.469 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:37:44.531 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T20:37:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T20:37:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T20:37:44.682 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T20:37:44.688 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T20:37:44.819 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:37:44.936 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:37:45.049 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T20:37:45.160 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:37:45.221 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:37:45.304 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:37:45.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:37:45.376 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T20:37:45.408 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T20:37:45.452 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T20:37:45.491 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:37:45.532 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:37:45.534 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T20:37:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T20:37:45.597 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T20:37:45.644 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T20:37:45.698 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T20:37:45.738 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T20:37:45.771 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T20:37:45.790 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T20:37:45.859 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T20:37:45.861 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T20:37:45.883 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:37:45.924 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T20:37:45.962 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T20:37:46.030 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T20:37:46.044 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:37:46.084 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:37:46.112 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T20:37:46.146 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T20:37:46.189 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T20:37:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T20:37:46.218 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T20:37:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:37:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T20:37:46.306 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T20:37:46.391 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T20:37:46.502 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T20:37:46.504 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:37:46.668 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T20:37:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T20:37:46.731 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T20:37:46.900 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T20:37:47.017 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:37:47.168 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:37:47.375 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T20:37:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T20:37:47.465 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T20:37:47.511 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T20:37:47.555 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T20:37:47.591 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T20:37:47.593 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T20:37:47.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T20:37:47.646 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T20:37:47.677 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T20:37:47.768 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T20:37:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T20:37:47.836 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T20:37:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T20:37:47.914 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T20:37:47.921 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T20:37:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T20:37:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T20:37:48.025 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T20:37:48.091 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T20:37:48.115 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T20:37:48.172 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T20:37:48.175 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T20:37:48.207 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T20:37:48.236 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T20:37:48.253 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T20:37:48.276 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T20:37:48.334 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T20:37:48.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T20:37:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T20:37:48.375 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T20:37:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T20:37:48.420 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T20:37:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T20:37:48.470 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T20:37:48.515 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T20:37:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T20:37:48.639 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T20:37:48.659 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T20:37:48.688 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T20:37:48.742 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T20:37:48.816 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T20:37:48.859 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T20:37:48.879 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T20:37:48.901 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T20:37:48.942 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T20:37:49.000 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T20:37:49.022 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T20:37:49.140 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T20:37:49.297 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T20:37:49.362 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T20:37:49.408 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T20:37:49.460 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T20:37:49.501 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T20:37:49.524 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T20:37:49.540 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T20:37:49.578 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T20:37:49.612 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T20:37:49.645 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T20:37:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T20:37:49.688 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T20:37:49.751 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T20:37:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T20:37:49.879 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T20:37:49.930 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T20:37:49.967 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T20:37:50.027 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T20:37:50.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T20:37:50.086 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T20:37:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T20:37:50.171 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T20:37:50.301 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T20:37:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T20:37:50.506 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T20:37:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T20:37:50.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T20:37:50.704 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T20:37:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T20:37:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T20:37:50.864 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T20:37:50.909 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T20:37:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T20:37:51.047 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T20:37:51.102 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T20:37:51.128 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T20:37:51.136 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T20:37:51.176 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T20:37:51.219 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T20:37:51.250 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T20:37:51.310 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T20:37:51.343 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T20:37:51.364 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T20:37:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T20:37:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T20:37:51.457 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T20:37:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T20:37:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T20:37:51.513 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T20:37:51.604 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T20:37:51.744 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T20:37:51.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T20:37:51.777 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T20:37:51.814 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T20:37:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T20:37:51.872 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T20:37:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T20:37:51.954 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T20:37:51.993 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T20:37:52.030 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T20:37:52.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T20:37:52.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T20:37:52.142 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T20:37:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T20:37:52.273 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T20:37:52.325 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T20:37:52.361 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T20:37:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T20:37:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T20:37:52.691 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T20:37:52.840 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T20:37:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T20:37:53.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T20:37:53.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T20:37:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T20:37:53.676 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T20:37:53.729 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T20:37:53.824 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T20:37:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T20:37:54.102 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T20:37:54.150 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T20:37:54.277 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T20:37:54.380 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T20:37:54.485 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T20:37:54.513 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T20:37:54.571 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T20:37:54.924 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T20:37:54.974 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:37:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T20:37:55.078 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:37:55.113 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T20:37:55.164 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T20:37:55.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T20:37:55.698 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T20:37:55.936 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:37:56.026 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:37:56.079 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T20:37:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T20:37:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T20:37:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T20:37:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T20:37:57.256 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T20:37:57.298 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:37:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T20:37:57.437 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T20:37:57.486 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T20:37:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T20:37:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:37:58.125 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T20:37:58.152 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T20:37:58.651 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:37:58.693 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:37:59.350 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:37:59.421 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:37:59.583 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:37:59.583 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T20:37:59.583 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T20:37:59.583 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:37:59.648 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:38:00.967 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:38:01.016 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:38:01.651 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T20:38:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:38:01.821 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T20:38:01.821 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T20:38:01.821 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T20:38:01.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:38:12.541 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /sys 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /proc 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /mnt 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /var/tmp 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /home 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /root 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /tmp 2024-09-10T20:38:12.542 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:12.763 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:38:12.799 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:38:12.799 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:12.800 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T20:38:12.800 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:14.407 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:38:14.465 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:38:14.465 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:14.465 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T20:38:14.465 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:38:14.465 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:38:14.466 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:14.716 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:38:14.766 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:38:14.766 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:14.766 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T20:38:14.766 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:38:14.767 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:38:14.767 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:14.798 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T20:38:14.798 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-10T20:38:14.798 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-10T20:38:14.799 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-10T20:38:14.799 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-10T20:38:14.799 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-10T20:38:14.799 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-10T20:38:14.799 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-10T20:38:14.799 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:14.999 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:38:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T20:38:15.037 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:15.037 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T20:38:15.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:15.258 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:38:15.309 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:38:15.309 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:15.309 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T20:38:15.309 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:38:15.309 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:38:15.309 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:15.433 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T20:38:15.494 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T20:38:15.557 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T20:38:15.789 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T20:38:15.854 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T20:38:15.939 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T20:38:16.050 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T20:38:16.222 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T20:38:16.274 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T20:38:16.327 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T20:38:16.353 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T20:38:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:38:16.728 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T20:38:16.728 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:16.728 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T20:38:16.728 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:38:16.728 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T20:38:16.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:16.979 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:38:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T20:38:17.029 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:17.029 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T20:38:17.029 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:38:17.029 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T20:38:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:17.128 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:38:17.169 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:38:17.202 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T20:38:17.282 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T20:38:17.317 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:38:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:38:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T20:38:17.581 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:17.581 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T20:38:17.581 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:38:17.581 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T20:38:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:17.713 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T20:38:17.773 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T20:38:17.838 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T20:38:18.062 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T20:38:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T20:38:18.228 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T20:38:18.361 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T20:38:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T20:38:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T20:38:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T20:38:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T20:38:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:38:19.190 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T20:38:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T20:38:19.305 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T20:38:19.340 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:38:20.929 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:38:20.999 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:38:22.078 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:38:22.107 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:38:22.258 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:38:22.437 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T20:38:22.467 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:38:22.519 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:38:22.519 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:22.519 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T20:38:22.519 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:38:22.519 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:38:22.519 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:22.601 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:38:22.628 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:38:22.748 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T20:38:22.823 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T20:38:22.946 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T20:38:23.010 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:38:23.873 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T20:38:23.904 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:38:23.956 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:38:23.956 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:23.956 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T20:38:23.956 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:38:23.957 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:38:23.957 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:24.005 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:38:24.055 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:38:24.055 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:24.055 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T20:38:24.055 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:24.097 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T20:38:24.114 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:38:24.126 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:38:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:38:24.166 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:24.166 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T20:38:24.166 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:38:24.166 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:38:24.166 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:24.278 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T20:38:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T20:38:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:38:24.515 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:38:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T20:38:24.539 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:24.539 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T20:38:24.539 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:38:24.539 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T20:38:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:24.567 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:38:24.567 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:24.567 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T20:38:24.568 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:38:24.568 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:38:24.568 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:38:24.623 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T20:38:24.731 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T20:38:24.794 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T20:38:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T20:38:25.858 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:38:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T20:38:25.918 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:25.918 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T20:38:25.918 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:38:25.918 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T20:38:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:25.966 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:38:26.015 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T20:38:26.016 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:26.016 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T20:38:26.016 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:26.075 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:38:26.126 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T20:38:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T20:38:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:38:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T20:38:26.126 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:26.467 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:38:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T20:38:26.519 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T20:38:26.519 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T20:38:26.519 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:38:26.520 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T20:38:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:29.680 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T20:38:29.720 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T20:38:29.764 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T20:38:29.793 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T20:38:29.829 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T20:38:30.059 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T20:38:30.110 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T20:38:30.140 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T20:38:30.179 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T20:38:30.224 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T20:38:31.179 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:38:31.230 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:38:31.273 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:38:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T20:38:31.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T20:38:31.676 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T20:38:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T20:38:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T20:38:31.975 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T20:38:32.029 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T20:38:32.059 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T20:38:32.091 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T20:38:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T20:38:32.538 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T20:38:32.670 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T20:38:32.724 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T20:38:32.825 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T20:38:32.856 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T20:38:32.871 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:38:32.881 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T20:38:32.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:38:32.918 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T20:38:32.918 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:38:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T20:38:33.042 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:38:33.042 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:38:33.151 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:38:33.176 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T20:38:33.192 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:38:33.192 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:38:33.445 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:38:33.445 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:38:33.555 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:38:33.636 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:38:33.889 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:38:33.889 INFO:teuthology.orchestra.run.smithi143.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T20:38:33.889 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:34.226 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T20:38:34.338 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T20:38:34.392 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T20:38:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T20:38:34.532 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T20:38:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T20:38:34.602 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T20:38:34.602 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:38:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T20:38:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:38:34.878 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T20:38:34.901 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T20:38:34.917 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:38:34.917 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:38:35.162 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T20:38:35.162 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:38:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T20:38:35.346 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:38:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:38:35.560 INFO:teuthology.orchestra.run.smithi081.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T20:38:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:38:40.255 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T20:38:40.256 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T20:38:40.257 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T20:38:40.257 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T20:38:40.257 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T20:38:40.257 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T20:38:40.275 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T20:38:40.275 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T20:38:40.275 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T20:38:40.275 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T20:38:40.275 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T20:38:40.275 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T20:38:40.276 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T20:38:40.277 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T20:38:40.278 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T20:38:40.279 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T20:38:40.280 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T20:38:40.281 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T20:38:40.282 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T20:38:40.283 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T20:38:40.284 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T20:38:40.285 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T20:38:40.286 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T20:38:40.287 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T20:38:40.288 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T20:38:40.289 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T20:38:40.290 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T20:38:40.290 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T20:38:40.290 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T20:38:40.290 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T20:38:41.763 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T20:38:41.763 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T20:38:41.763 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T20:38:41.763 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T20:38:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T20:38:41.765 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T20:38:41.778 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T20:38:41.779 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T20:38:41.780 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T20:38:41.781 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T20:38:41.782 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T20:38:41.783 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T20:38:41.784 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T20:38:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T20:38:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T20:38:41.787 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T20:38:41.788 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T20:38:41.788 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T20:38:41.788 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T20:38:41.788 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T20:38:41.788 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T20:38:42.516 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:38:42.516 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:42.516 INFO:teuthology.orchestra.run.smithi143.stdout:Upgraded: 2024-09-10T20:38:42.516 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:42.516 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:42.516 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T20:38:42.517 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.518 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:42.519 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T20:38:42.520 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T20:38:42.521 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T20:38:42.522 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T20:38:42.523 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T20:38:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T20:38:42.525 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T20:38:42.526 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T20:38:42.527 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T20:38:42.528 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T20:38:42.529 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T20:38:42.530 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T20:38:42.530 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T20:38:42.530 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:42.530 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-10T20:38:43.355 DEBUG:teuthology.parallel:result is None 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T20:38:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T20:38:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T20:38:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T20:38:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T20:38:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T20:38:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T20:38:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T20:38:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T20:38:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T20:38:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T20:38:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T20:38:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T20:38:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:44.017 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-10T20:38:44.641 DEBUG:teuthology.parallel:result is None 2024-09-10T20:38:44.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:38:44.792 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T20:38:44.837 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T20:38:44.838 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T20:38:44.838 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T20:38:44.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:38:44.985 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T20:38:45.030 INFO:teuthology.orchestra.run.smithi143.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T20:38:45.030 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T20:38:45.030 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T20:38:45.032 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T20:38:45.032 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:45.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T20:38:45.098 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:45.098 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T20:38:45.157 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T20:38:45.158 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:45.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T20:38:45.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T20:38:45.331 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:45.331 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T20:38:45.386 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T20:38:45.482 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T20:38:45.483 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:45.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T20:38:45.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T20:38:45.648 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:45.649 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T20:38:45.706 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T20:38:45.802 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T20:38:45.802 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:45.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T20:38:45.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T20:38:45.963 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:45.963 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T20:38:46.019 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T20:38:46.116 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T20:38:46.227 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T20:38:46.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-10T20:38:46.231 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-09-10T20:38:46.286 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T20:38:46.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T20:38:46.290 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T20:38:46.345 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T20:38:46.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T20:38:46.349 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T20:38:46.415 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T20:38:46.415 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T20:38:46.415 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T20:38:46.415 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:46.415 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T20:38:46.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T20:38:46.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T20:38:46.691 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:46.692 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T20:38:46.729 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T20:38:46.899 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T20:38:46.961 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T20:38:46.961 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T20:38:46.961 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/alternate-pool}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899626', 'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6190, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '479/1024', 'suite': 'fs', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUhu0Z70387LPMV7/lxZQQdMrzcCAf5WMbaTPmmF8KraDr85d//y/y6ChZgIqpmDfJmwNfxvp3AzQq3Q/Aak/g=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlPRLTOfIEagyyNKz2L+UTjYdjNsO26i7cE1HLRjKJm/qUexEupKDT4YQLHpVg3l/LHQQn/jg6Kv4oQGMCkgjw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_pool']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_16:59:47', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T20:38:46.962 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T20:38:46.965 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T20:38:47.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T20:38:47.042 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T20:38:47.099 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:47.099 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T20:38:47.134 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T20:38:47.134 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-10T20:38:47.211 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T20:38:47.211 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:47.211 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-10T20:38:47.211 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:47.211 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:47.211 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 20:38:35.884140281 +0000 2024-09-10T20:38:47.212 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 20:36:28.125577823 +0000 2024-09-10T20:38:47.212 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 20:36:28.125577823 +0000 2024-09-10T20:38:47.212 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 20:36:28.125577823 +0000 2024-09-10T20:38:47.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T20:38:47.309 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T20:38:47.309 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T20:38:47.309 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000343423 s, 1.5 MB/s 2024-09-10T20:38:47.312 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T20:38:47.351 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 20:38:35.885140262 +0000 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 20:36:28.590568912 +0000 2024-09-10T20:38:47.426 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 20:36:28.590568912 +0000 2024-09-10T20:38:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 20:36:28.590568912 +0000 2024-09-10T20:38:47.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T20:38:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T20:38:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T20:38:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000273109 s, 1.9 MB/s 2024-09-10T20:38:47.522 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T20:38:47.558 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-10T20:38:47.633 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 20:38:35.886140242 +0000 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 20:36:29.085559427 +0000 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 20:36:29.085559427 +0000 2024-09-10T20:38:47.634 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 20:36:29.085559427 +0000 2024-09-10T20:38:47.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T20:38:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T20:38:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T20:38:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000304662 s, 1.7 MB/s 2024-09-10T20:38:47.729 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T20:38:47.765 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-10T20:38:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T20:38:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:47.840 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-09-10T20:38:47.840 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:47.840 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:47.841 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 20:38:35.886140242 +0000 2024-09-10T20:38:47.841 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 20:36:29.553550459 +0000 2024-09-10T20:38:47.841 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 20:36:29.553550459 +0000 2024-09-10T20:38:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-10 20:36:29.553550459 +0000 2024-09-10T20:38:47.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T20:38:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T20:38:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T20:38:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000304003 s, 1.7 MB/s 2024-09-10T20:38:47.935 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T20:38:47.972 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:38:47.972 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:47.972 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T20:38:48.012 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T20:38:48.013 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-09-10T20:38:48.090 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T20:38:48.090 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:48.090 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 640 Links: 1 2024-09-10T20:38:48.090 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:48.090 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:48.091 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-10 20:38:34.222663812 +0000 2024-09-10T20:38:48.091 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-10 20:36:28.160521684 +0000 2024-09-10T20:38:48.091 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-10 20:36:28.160521684 +0000 2024-09-10T20:38:48.091 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-10 20:36:28.160521684 +0000 2024-09-10T20:38:48.092 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T20:38:48.185 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-10T20:38:48.185 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-10T20:38:48.185 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000290432 s, 1.8 MB/s 2024-09-10T20:38:48.187 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T20:38:48.224 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-10 20:38:34.223663786 +0000 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-10 20:36:28.610509729 +0000 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-10 20:36:28.610509729 +0000 2024-09-10T20:38:48.301 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-10 20:36:28.610509729 +0000 2024-09-10T20:38:48.302 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T20:38:48.394 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-10T20:38:48.394 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-10T20:38:48.394 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000292199 s, 1.8 MB/s 2024-09-10T20:38:48.396 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T20:38:48.433 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-09-10T20:38:48.508 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T20:38:48.508 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:48.508 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-10T20:38:48.509 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:48.509 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:48.509 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-10 20:38:34.223663786 +0000 2024-09-10T20:38:48.509 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-10 20:36:29.067497643 +0000 2024-09-10T20:38:48.509 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-10 20:36:29.067497643 +0000 2024-09-10T20:38:48.509 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-10 20:36:29.067497643 +0000 2024-09-10T20:38:48.509 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T20:38:48.602 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-10T20:38:48.602 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-10T20:38:48.602 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000304588 s, 1.7 MB/s 2024-09-10T20:38:48.604 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T20:38:48.641 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-10 20:38:34.224663760 +0000 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-10 20:36:29.499486229 +0000 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-10 20:36:29.499486229 +0000 2024-09-10T20:38:48.716 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-10 20:36:29.499486229 +0000 2024-09-10T20:38:48.717 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T20:38:48.809 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-10T20:38:48.809 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-10T20:38:48.809 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00048246 s, 1.1 MB/s 2024-09-10T20:38:48.812 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T20:38:48.848 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:38:48.849 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T20:38:48.849 INFO:tasks.ceph:Generating config... 2024-09-10T20:38:48.850 INFO:tasks.ceph:[client] pid file = 2024-09-10T20:38:48.850 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-10T20:38:48.850 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T20:38:48.850 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T20:38:48.850 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T20:38:48.850 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T20:38:48.850 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T20:38:48.850 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T20:38:48.851 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T20:38:48.851 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T20:38:48.852 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T20:38:48.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T20:38:48.940 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T20:38:48.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T20:38:49.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T20:38:49.089 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.143'), ('mon.c', '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]')] 2024-09-10T20:38:49.090 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-10T20:38:49.091 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:49.092 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T20:38:49.127 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.143 --addv c '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:38:49.244 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-10T20:38:49.241618+0000 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-10T20:38:49.241618+0000 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.b 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-09-10T20:38:49.245 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T20:38:49.247 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T20:38:49.282 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0ea88071-0b16-46b5-b258-7e2fd8f41721... 2024-09-10T20:38:49.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:38:49.326 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:38:49.419 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-10T20:38:49.419 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-10T20:38:49.419 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-10T20:38:49.420 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.421 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:38:49.422 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.423 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-10T20:38:49.424 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-10T20:38:49.425 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:38:49.426 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.426 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-10T20:38:49.426 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-10T20:38:49.426 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.426 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:38:49.427 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.428 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-10T20:38:49.429 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-10T20:38:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 30 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T20:38:49.431 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:38:49.432 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: mon down mkfs grace = 300 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-09-10T20:38:49.433 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-10T20:38:49.434 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-10T20:38:49.434 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-10T20:38:49.434 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-10T20:38:49.434 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-10T20:38:49.434 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-10T20:38:49.434 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-10T20:38:49.435 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-09-10T20:38:49.435 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-09-10T20:38:49.435 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:38:49.436 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-09-10T20:38:49.436 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.436 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-09-10T20:38:49.436 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.436 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-09-10T20:38:49.436 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.437 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-09-10T20:38:49.437 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-09-10T20:38:49.437 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.437 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-09-10T20:38:49.437 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-09-10T20:38:49.437 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.437 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.438 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-09-10T20:38:49.439 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-09-10T20:38:49.439 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:38:49.439 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:38:49.439 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-09-10T20:38:49.439 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:38:49.439 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-09-10T20:38:49.440 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:38:49.440 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:38:49.440 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-09-10T20:38:49.440 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.440 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:38:49.440 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.441 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-09-10T20:38:49.441 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.441 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-09-10T20:38:49.441 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.441 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-09-10T20:38:49.441 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-09-10T20:38:49.442 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-09-10T20:38:49.442 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.81,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-09-10T20:38:49.442 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:38:49.442 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.442 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-09-10T20:38:49.442 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.443 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:38:49.444 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:38:49.445 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 30 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.446 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:38:49.447 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.448 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:38:49.449 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2024-09-10T20:38:49.450 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-09-10T20:38:49.450 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-09-10T20:38:49.450 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-09-10T20:38:49.450 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-09-10T20:38:49.450 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-09-10T20:38:49.450 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-09-10T20:38:49.450 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-09-10T20:38:49.452 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T20:38:49.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T20:38:49.549 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T20:38:49.549 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:49.550 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T20:38:49.584 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:49.585 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T20:38:49.659 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:38:49.659 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:49.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T20:38:49.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T20:38:49.778 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:38:49.778 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:38:49.853 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:38:49.853 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:49.853 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T20:38:49.853 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T20:38:49.932 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:38:49.932 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:38:50.007 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T20:38:50.008 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T20:38:50.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T20:38:50.111 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T20:38:50.117 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T20:38:50.245 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T20:38:50.251 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T20:38:50.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T20:38:50.355 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T20:38:50.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T20:38:50.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T20:38:50.519 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T20:38:50.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T20:38:50.579 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T20:38:50.685 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T20:38:50.691 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T20:38:50.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T20:38:50.852 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T20:38:50.858 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T20:38:50.914 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T20:38:50.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T20:38:50.995 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T20:38:51.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T20:38:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T20:38:51.131 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T20:38:51.213 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T20:38:51.241 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T20:38:51.322 INFO:teuthology.orchestra.run.smithi143.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T20:38:51.350 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T20:38:51.350 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T20:38:51.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T20:38:51.406 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:38:51.406 INFO:tasks.ceph:role: osd.0 2024-09-10T20:38:51.406 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:38:51.406 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T20:38:51.468 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:38:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:38:51.469 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:38:51.874 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-10T20:38:51.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-10T20:38:51.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T20:38:51.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T20:38:52.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T20:38:52.106 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:38:52.107 INFO:tasks.ceph:role: osd.1 2024-09-10T20:38:52.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:38:52.107 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T20:38:52.171 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:38:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:38:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:38:52.171 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:38:52.172 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:38:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:38:52.172 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:38:52.172 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:38:52.172 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:38:52.172 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:38:52.535 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-10T20:38:52.539 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-10T20:38:52.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T20:38:52.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T20:38:52.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T20:38:52.745 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:38:52.745 INFO:tasks.ceph:role: osd.2 2024-09-10T20:38:52.746 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:38:52.746 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T20:38:52.808 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:38:52.809 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:38:53.190 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-10T20:38:53.193 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-10T20:38:53.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T20:38:53.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T20:38:53.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T20:38:53.411 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T20:38:53.411 INFO:tasks.ceph:role: osd.3 2024-09-10T20:38:53.411 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:38:53.411 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:38:53.475 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:38:53.859 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-10T20:38:53.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-10T20:38:53.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T20:38:53.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T20:38:54.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:38:54.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:54.158+0000 7fc202213640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T20:38:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:54.161+0000 7fc202213640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T20:38:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:54.161+0000 7fc202213640 -1 bdev(0x55e9cb08b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T20:38:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:54.161+0000 7fc202213640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T20:38:57.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T20:38:57.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:38:57.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:57.327+0000 7fcd6af34640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T20:38:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:57.328+0000 7fcd6af34640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T20:38:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:57.328+0000 7fcd6af34640 -1 bdev(0x560aae3c5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T20:38:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:38:57.328+0000 7fcd6af34640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T20:39:00.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T20:39:00.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:00.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:00.493+0000 7f5f7afb9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T20:39:00.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:00.493+0000 7f5f7afb9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T20:39:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:00.493+0000 7f5f7afb9640 -1 bdev(0x558bb8ef1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T20:39:00.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:00.494+0000 7f5f7afb9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T20:39:03.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T20:39:03.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:03.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:03.652+0000 7fbf8482c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T20:39:03.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:03.653+0000 7fbf8482c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T20:39:03.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:03.653+0000 7fbf8482c640 -1 bdev(0x56051f23f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T20:39:03.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:03.653+0000 7fbf8482c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T20:39:06.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T20:39:06.759 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T20:39:06.821 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:39:06.821 INFO:tasks.ceph:role: osd.4 2024-09-10T20:39:06.821 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:39:06.822 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:39:06.887 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:39:06.888 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:39:07.301 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-09-10T20:39:07.306 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-09-10T20:39:07.306 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T20:39:07.452 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T20:39:07.516 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T20:39:07.573 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:39:07.573 INFO:tasks.ceph:role: osd.5 2024-09-10T20:39:07.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:39:07.573 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T20:39:07.637 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:39:07.637 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:39:07.638 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:39:07.990 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-09-10T20:39:07.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-09-10T20:39:07.995 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T20:39:08.082 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T20:39:08.145 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T20:39:08.210 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:39:08.210 INFO:tasks.ceph:role: osd.6 2024-09-10T20:39:08.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:39:08.210 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T20:39:08.273 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:39:08.274 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:39:08.653 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-09-10T20:39:08.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-09-10T20:39:08.658 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T20:39:08.751 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T20:39:08.812 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T20:39:08.868 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T20:39:08.868 INFO:tasks.ceph:role: osd.7 2024-09-10T20:39:08.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:39:08.868 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T20:39:08.932 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T20:39:08.933 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T20:39:09.365 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-09-10T20:39:09.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-09-10T20:39:09.369 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T20:39:09.491 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T20:39:09.557 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:09.673 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:09.668+0000 7f60e9c83640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T20:39:09.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:09.674+0000 7f60e9c83640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T20:39:09.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:09.674+0000 7f60e9c83640 -1 bdev(0x563e534d1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T20:39:09.679 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:09.675+0000 7f60e9c83640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T20:39:12.678 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T20:39:12.736 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:12.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:12.823+0000 7f4329fdb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T20:39:12.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:12.824+0000 7f4329fdb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T20:39:12.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:12.824+0000 7f4329fdb640 -1 bdev(0x55d41cb13800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T20:39:12.829 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:12.824+0000 7f4329fdb640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T20:39:15.855 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T20:39:15.912 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:15.997+0000 7f56eb864640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T20:39:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:15.998+0000 7f56eb864640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T20:39:16.002 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:15.998+0000 7f56eb864640 -1 bdev(0x55fd54011800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T20:39:16.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:15.998+0000 7f56eb864640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T20:39:16.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:39:16.967 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:39:19.025 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T20:39:19.081 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:19.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:19.176+0000 7fabe7220640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T20:39:19.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:19.176+0000 7fabe7220640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T20:39:19.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:19.176+0000 7fabe7220640 -1 bdev(0x55ff62d41800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T20:39:19.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:19.177+0000 7fabe7220640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T20:39:22.189 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T20:39:22.246 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T20:39:22.247 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:22.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T20:39:22.308 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:22.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T20:39:22.407 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:22.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T20:39:22.503 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:22.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T20:39:22.600 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:22.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T20:39:22.694 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:22.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T20:39:22.790 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:22.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T20:39:22.886 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:22.886 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T20:39:22.946 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:22.946 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T20:39:23.044 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:23.044 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T20:39:23.140 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:23.140 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T20:39:23.237 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:23.238 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T20:39:23.332 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:23.333 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T20:39:23.428 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:23.428 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T20:39:23.523 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:23.523 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T20:39:23.559 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:23.559 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T20:39:23.635 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:23.635 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T20:39:23.670 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:23.670 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T20:39:23.745 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T20:39:23.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T20:39:23.749 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBmc8h3BhAA+jaHDToU+zkNV8JLEbWVHw== 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBmecf/FBAAMrD8A2X25S1eXq18yJMTEw== 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBmIszLHhAAYUpveadz31/xr9LlC8m4Dg== 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBeruBmjAOTCRAASWWLcPVmoZ0CTsvTypZTkA== 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-10T20:39:23.797 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBhruBmmzeVExAAxXYH/KR0JP2R1zrJZFkUOw== 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBkruBm2KtzHRAAwQERCDHC7zBBWSetonaxLQ== 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBnruBmB3j3JhAA6SC6h/7dUHzwkH7kk+7ggg== 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBm6NVsDhAAi4P8yxI/EcbEoSE9W4Y7Sg== 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBmMSmtKBAAyBCKaAIBElCh9m3c7xEzRw== 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBmuMOlMhAAI4id4JiEdEkMM8ru8Y+LMw== 2024-09-10T20:39:23.798 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBtruBmoOP1JxAA+NGeZT+0U3CwTaMASAVcyg== 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBwruBmgMcwMRAASULYtlLnFip6t9rVKRjLtA== 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBzruBmMzePOxAAn22iwmc4edm37BhcAjL2Kw== 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3ruBm05KZChAARGHrKTyfDmeVtMMHeNXiig== 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBmaPwoOxAAjHBOYp6lxVxDK5yph+ot9w== 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBbruBmNmsMBhAAF6cuus1v1m18Hhxu1ktIUw== 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-10T20:39:23.799 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBbruBm7w2JDBAA15G17VNnMhJREIHjAU5+xA== 2024-09-10T20:39:23.800 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2024-09-10T20:39:23.800 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBbruBmi0cFExAAXDgVwl69GCoc6mNj5zJV2g== 2024-09-10T20:39:23.836 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2024-09-10T20:39:23.836 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBaruBmc8h3BhAA+jaHDToU+zkNV8JLEbWVHw== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBaruBmecf/FBAAMrD8A2X25S1eXq18yJMTEw== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBaruBmIszLHhAAYUpveadz31/xr9LlC8m4Dg== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBeruBmjAOTCRAASWWLcPVmoZ0CTsvTypZTkA== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBhruBmmzeVExAAxXYH/KR0JP2R1zrJZFkUOw== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBkruBm2KtzHRAAwQERCDHC7zBBWSetonaxLQ== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBnruBmB3j3JhAA6SC6h/7dUHzwkH7kk+7ggg== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBaruBm6NVsDhAAi4P8yxI/EcbEoSE9W4Y7Sg== 2024-09-10T20:39:23.837 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBaruBmMSmtKBAAyBCKaAIBElCh9m3c7xEzRw== 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBaruBmuMOlMhAAI4id4JiEdEkMM8ru8Y+LMw== 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBtruBmoOP1JxAA+NGeZT+0U3CwTaMASAVcyg== 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBwruBmgMcwMRAASULYtlLnFip6t9rVKRjLtA== 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBzruBmMzePOxAAn22iwmc4edm37BhcAjL2Kw== 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQB3ruBm05KZChAARGHrKTyfDmeVtMMHeNXiig== 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBaruBmaPwoOxAAjHBOYp6lxVxDK5yph+ot9w== 2024-09-10T20:39:23.838 INFO:teuthology.orchestra.run.smithi143.stdout:[client.2] 2024-09-10T20:39:23.839 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBbruBmNmsMBhAAF6cuus1v1m18Hhxu1ktIUw== 2024-09-10T20:39:23.839 INFO:teuthology.orchestra.run.smithi143.stdout:[client.1] 2024-09-10T20:39:23.839 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBbruBm7w2JDBAA15G17VNnMhJREIHjAU5+xA== 2024-09-10T20:39:23.839 INFO:teuthology.orchestra.run.smithi143.stdout:[client.3] 2024-09-10T20:39:23.839 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQBbruBmi0cFExAAXDgVwl69GCoc6mNj5zJV2g== 2024-09-10T20:39:23.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:39:23.844 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:39:23.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:23.977 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:24.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:24.077 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:24.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.177 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.274 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.372 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:39:24.566 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T20:39:24.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:24.664 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:24.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:24.766 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T20:39:24.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.867 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:24.965 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:25.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:25.062 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:25.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:25.159 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T20:39:25.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.257 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.357 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.458 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.558 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T20:39:25.655 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T20:39:25.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T20:39:25.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T20:39:25.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T20:39:25.876 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T20:39:25.932 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T20:39:26.040 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T20:39:26.096 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T20:39:26.152 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T20:39:26.258 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T20:39:26.315 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:26.319 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T20:39:26.353 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T20:39:26.354 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T20:39:26.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T20:39:26.393 INFO:tasks.ceph.mon.a:Started 2024-09-10T20:39:26.394 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T20:39:26.394 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T20:39:26.398 INFO:tasks.ceph.mon.b:Started 2024-09-10T20:39:26.398 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T20:39:26.398 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T20:39:26.401 INFO:tasks.ceph.mon.c:Started 2024-09-10T20:39:26.402 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T20:39:26.402 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T20:39:26.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T20:39:26.406 INFO:tasks.ceph.mgr.y:Started 2024-09-10T20:39:26.406 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T20:39:26.406 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T20:39:26.409 INFO:tasks.ceph.mgr.x:Started 2024-09-10T20:39:26.410 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-10T20:39:26.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-10T20:39:26.414 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-10T20:39:26.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-10T20:39:26.460 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-10T20:39:26.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-10T20:39:26.505 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-10T20:39:26.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-10T20:39:26.551 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-10T20:39:26.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-10T20:39:26.598 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-10T20:39:26.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-10T20:39:26.645 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-10T20:39:26.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-10T20:39:26.691 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-10T20:39:26.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-10T20:39:26.742 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-10T20:39:26.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-10T20:39:26.763 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-10T20:39:26.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-10T20:39:26.814 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-10T20:39:26.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-10T20:39:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.847+0000 7f1d31c00640 1 -- 172.21.15.81:0/424421839 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d2c0ceca0 msgr2=0x7f1d2c155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.847+0000 7f1d31c00640 1 --2- 172.21.15.81:0/424421839 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d2c0ceca0 0x7f1d2c155200 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c02a640 tx=0x7f1d1c0046c0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.859 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-10T20:39:26.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-10T20:39:26.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.852+0000 7f1d31c00640 1 -- 172.21.15.81:0/424421839 shutdown_connections 2024-09-10T20:39:26.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.852+0000 7f1d31c00640 1 --2- 172.21.15.81:0/424421839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d2c15ded0 0x7f1d2c0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.852+0000 7f1d31c00640 1 --2- 172.21.15.81:0/424421839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d2c0d0390 0x7f1d2c0cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.852+0000 7f1d31c00640 1 --2- 172.21.15.81:0/424421839 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d2c0ceca0 0x7f1d2c155200 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.852+0000 7f1d31c00640 1 -- 172.21.15.81:0/424421839 >> 172.21.15.81:0/424421839 conn(0x7f1d2c0d3c50 msgr2=0x7f1d2c0b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f1d31c00640 1 -- 172.21.15.81:0/424421839 shutdown_connections 2024-09-10T20:39:26.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f1d31c00640 1 -- 172.21.15.81:0/424421839 wait complete. 2024-09-10T20:39:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 -- 172.21.15.81:0/4205573641 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 msgr2=0x7f43e8161ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 --2- 172.21.15.81:0/4205573641 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 0x7f43e8161ae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43e80ce090 tx=0x7f43d802a560 comp rx=0 tx=0).stop 2024-09-10T20:39:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 -- 172.21.15.81:0/4205573641 shutdown_connections 2024-09-10T20:39:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 --2- 172.21.15.81:0/4205573641 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 0x7f43e8161ae0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 --2- 172.21.15.81:0/4205573641 >> v2:172.21.15.81:3300/0 conn(0x7f43e815d8e0 0x7f43e81615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 -- 172.21.15.81:0/4205573641 >> 172.21.15.81:0/4205573641 conn(0x7f43e80d3a40 msgr2=0x7f43e80d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:26.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 -- 172.21.15.81:0/4205573641 shutdown_connections 2024-09-10T20:39:26.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.854+0000 7f43e7e00640 1 -- 172.21.15.81:0/4205573641 wait complete. 2024-09-10T20:39:26.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.857+0000 7f507b400640 1 -- 172.21.15.81:0/65519391 <== mon.1 v2:172.21.15.143:3300/0 8 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f5074004f50 con 0x7f508406e6e0 2024-09-10T20:39:26.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.859+0000 7f43e7e00640 1 Processor -- start 2024-09-10T20:39:26.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.860+0000 7f43e7e00640 1 -- start start 2024-09-10T20:39:26.871 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-10T20:39:26.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-10T20:39:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.864+0000 7fdf08c00640 1 -- 172.21.15.81:0/1085036200 <== mon.1 v2:172.21.15.143:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fdf00010ce0 con 0x7fdf0c0d4560 2024-09-10T20:39:26.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.864+0000 7fdf08c00640 1 -- 172.21.15.81:0/1085036200 <== mon.1 v2:172.21.15.143:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v4)=0 v4) ==== 114+0+0 (secure 0 0 0) 0x7fdf00024480 con 0x7fdf0c0d4560 2024-09-10T20:39:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.862+0000 7f43e7e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e80d45f0 0x7f43e80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.862+0000 7f43e7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e815d8e0 0x7f43e8155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e6a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e80d45f0 0x7f43e80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e6a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e80d45f0 0x7f43e80cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:33602/0 (socket says 172.21.15.81:33602) 2024-09-10T20:39:26.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e6a00640 1 -- 172.21.15.81:0/693021 learned_addr learned my addr 172.21.15.81:0/693021 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e7e00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 0x7f43e80b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43e81623b0 con 0x7f43e815d8e0 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f43e8162230 con 0x7f43e815dcc0 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f43e80b7df0 con 0x7f43e80d45f0 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.863+0000 7f43e7400640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 0x7f43e80b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.864+0000 7f43de000640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e815d8e0 0x7f43e8155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.865+0000 7f43e6a00640 1 -- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 msgr2=0x7f43e80b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.865+0000 7f43e6a00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 0x7f43e80b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.865+0000 7f43e6a00640 1 -- 172.21.15.81:0/693021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e815d8e0 msgr2=0x7f43e8155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.865+0000 7f43e6a00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e815d8e0 0x7f43e8155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.865+0000 7f43e6a00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e815e1d0 con 0x7f43e80d45f0 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.865+0000 7f43de000640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e815d8e0 0x7f43e8155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:26.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.869+0000 7f43e6a00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e80d45f0 0x7f43e80cb000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43d000c9a0 tx=0x7f43d000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:26.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0007bb0 con 0x7f43e80d45f0 2024-09-10T20:39:26.883 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T20:39:26.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-10T20:39:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.869+0000 7fdf11e00640 1 -- 172.21.15.81:0/1085036200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf0c0d4560 msgr2=0x7fdf0c0cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.869+0000 7fdf11e00640 1 --2- 172.21.15.81:0/1085036200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf0c0d4560 0x7fdf0c0cab10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdf00003960 tx=0x7fdf00003e20 comp rx=0 tx=0).stop 2024-09-10T20:39:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7fdf11e00640 1 -- 172.21.15.81:0/1085036200 shutdown_connections 2024-09-10T20:39:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7fdf11e00640 1 --2- 172.21.15.81:0/1085036200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c15b250 0x7fdf0c161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7fdf11e00640 1 --2- 172.21.15.81:0/1085036200 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdf0c15db30 0x7fdf0c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7fdf11e00640 1 --2- 172.21.15.81:0/1085036200 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdf0c0d4560 0x7fdf0c0cab10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7fdf11e00640 1 -- 172.21.15.81:0/1085036200 >> 172.21.15.81:0/1085036200 conn(0x7fdf0c0d3a40 msgr2=0x7fdf0c0d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7fdf11e00640 1 -- 172.21.15.81:0/1085036200 shutdown_connections 2024-09-10T20:39:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.871+0000 7fdf11e00640 1 -- 172.21.15.81:0/1085036200 wait complete. 2024-09-10T20:39:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f43d0007d50 con 0x7f43e80d45f0 2024-09-10T20:39:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d000f6b0 con 0x7f43e80d45f0 2024-09-10T20:39:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.870+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e80cb540 con 0x7f43e80d45f0 2024-09-10T20:39:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.874+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e81602e0 con 0x7f43e80d45f0 2024-09-10T20:39:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.879+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e815acd0 con 0x7f43e80d45f0 2024-09-10T20:39:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.881+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f43d000f850 con 0x7f43e80d45f0 2024-09-10T20:39:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.881+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f43d0021730 con 0x7f43e80d45f0 2024-09-10T20:39:26.891 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T20:39:26.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-10T20:39:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.885+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f43e815acd0 con 0x7f43e80d45f0 2024-09-10T20:39:26.925 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-10T20:39:26.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-10T20:39:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.932+0000 7fbf23e00640 1 -- 172.21.15.81:0/1067064973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2406f530 msgr2=0x7fbf24143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:26.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.932+0000 7fbf23e00640 1 --2- 172.21.15.81:0/1067064973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2406f530 0x7fbf24143090 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbf240cf3b0 tx=0x7fbf1c03b9d0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.940 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T20:39:26.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T20:39:26.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.933+0000 7fbf23e00640 1 -- 172.21.15.81:0/1067064973 shutdown_connections 2024-09-10T20:39:26.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.933+0000 7fbf23e00640 1 --2- 172.21.15.81:0/1067064973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2406f530 0x7fbf24143090 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.933+0000 7fbf23e00640 1 --2- 172.21.15.81:0/1067064973 >> v2:172.21.15.143:3300/0 conn(0x7fbf240cfcb0 0x7fbf24142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.933+0000 7fbf23e00640 1 -- 172.21.15.81:0/1067064973 >> 172.21.15.81:0/1067064973 conn(0x7fbf2406cb50 msgr2=0x7fbf2406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.937+0000 7fbf23e00640 1 -- 172.21.15.81:0/1067064973 shutdown_connections 2024-09-10T20:39:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.937+0000 7fbf23e00640 1 -- 172.21.15.81:0/1067064973 wait complete. 2024-09-10T20:39:26.957 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-10T20:39:26.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-10T20:39:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.951+0000 7fbf23e00640 1 Processor -- start 2024-09-10T20:39:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.954+0000 7fbf23e00640 1 -- start start 2024-09-10T20:39:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.956+0000 7fbf23e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf2406f530 0x7fbf241f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.956+0000 7fbf23e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf240cf8d0 0x7fbf2415c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf23e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf240cfcb0 0x7fbf2415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf23e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf24072940 con 0x7fbf240cfcb0 2024-09-10T20:39:26.969 DEBUG:tasks.ceph:set 18 configs 2024-09-10T20:39:26.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi081') 2024-09-10T20:39:26.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-10T20:39:26.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-10T20:39:26.970 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf23e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbf240727c0 con 0x7fbf2406f530 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf23e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbf24072ac0 con 0x7fbf240cf8d0 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf2406f530 0x7fbf241f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf2406f530 0x7fbf241f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53872/0 (socket says 172.21.15.81:53872) 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 -- 172.21.15.81:0/4136593667 learned_addr learned my addr 172.21.15.81:0/4136593667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 -- 172.21.15.81:0/4136593667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf240cf8d0 msgr2=0x7fbf2415c210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 --2- 172.21.15.81:0/4136593667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf240cf8d0 0x7fbf2415c210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 -- 172.21.15.81:0/4136593667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf240cfcb0 msgr2=0x7fbf2415fa70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 --2- 172.21.15.81:0/4136593667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf240cfcb0 0x7fbf2415fa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:26.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.957+0000 7fbf22a00640 1 -- 172.21.15.81:0/4136593667 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf241f43a0 con 0x7fbf2406f530 2024-09-10T20:39:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.958+0000 7fbf22a00640 1 --2- 172.21.15.81:0/4136593667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf2406f530 0x7fbf241f3e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400c460 tx=0x7fbf1400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.962+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14016020 con 0x7fbf2406f530 2024-09-10T20:39:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.962+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fbf140128e0 con 0x7fbf2406f530 2024-09-10T20:39:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.962+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14016020 con 0x7fbf2406f530 2024-09-10T20:39:26.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.965+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf241f0120 con 0x7fbf2406f530 2024-09-10T20:39:26.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.965+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf241f06e0 con 0x7fbf2406f530 2024-09-10T20:39:26.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.967+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fbf1401b400 con 0x7fbf2406f530 2024-09-10T20:39:26.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.971+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbf1401a9e0 con 0x7fbf2406f530 2024-09-10T20:39:26.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.971+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf24161480 con 0x7fbf2406f530 2024-09-10T20:39:26.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:26.974+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fbf14020030 con 0x7fbf2406f530 2024-09-10T20:39:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.014+0000 7f5089e00640 1 -- 172.21.15.81:0/65519391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5058005100 con 0x7f508406e6e0 2024-09-10T20:39:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.029+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f43d0018e40 con 0x7f43e80d45f0 2024-09-10T20:39:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.026+0000 7f5647400640 1 -- 172.21.15.81:0/713933324 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 msgr2=0x7f56280079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.031+0000 7f563f400640 1 -- 172.21.15.81:0/713933324 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563800c260 con 0x7f56280053c0 2024-09-10T20:39:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.031+0000 7f5647400640 1 --2- 172.21.15.81:0/713933324 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 0x7f56280079e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f563800c610 tx=0x7f5628005830 comp rx=0 tx=0).stop 2024-09-10T20:39:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.031+0000 7f5645400640 1 -- 172.21.15.81:0/713933324 reap_dead start 2024-09-10T20:39:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.031+0000 7f5647400640 1 -- 172.21.15.81:0/713933324 shutdown_connections 2024-09-10T20:39:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.032+0000 7f5647400640 1 -- 172.21.15.81:0/713933324 >> 172.21.15.81:0/713933324 conn(0x7f564006d180 msgr2=0x7f56400b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.033+0000 7f5647400640 1 -- 172.21.15.81:0/713933324 shutdown_connections 2024-09-10T20:39:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.033+0000 7f5647400640 1 -- 172.21.15.81:0/713933324 wait complete. 2024-09-10T20:39:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.036+0000 7f507b400640 1 -- 172.21.15.81:0/65519391 <== mon.1 v2:172.21.15.143:3300/0 9 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f5074005150 con 0x7f508406e6e0 2024-09-10T20:39:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.037+0000 7f507b400640 1 -- 172.21.15.81:0/65519391 <== mon.1 v2:172.21.15.143:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f5074044450 con 0x7f508406e6e0 2024-09-10T20:39:27.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.032+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fbf1401a3b0 con 0x7fbf2406f530 2024-09-10T20:39:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.044+0000 7f5647400640 1 Processor -- start 2024-09-10T20:39:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.045+0000 7f5647400640 1 -- start start 2024-09-10T20:39:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.053+0000 7f5078c00640 1 -- 172.21.15.81:0/65519391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508406e6e0 msgr2=0x7f50840b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.053+0000 7f5078c00640 1 --2- 172.21.15.81:0/65519391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508406e6e0 0x7f50840b0f80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5074006010 tx=0x7f50740046c0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.054+0000 7f5078c00640 1 -- 172.21.15.81:0/65519391 shutdown_connections 2024-09-10T20:39:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.054+0000 7f5078c00640 1 --2- 172.21.15.81:0/65519391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f50840aee90 0x7f50840adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.054+0000 7f5078c00640 1 --2- 172.21.15.81:0/65519391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f508406eac0 0x7f5084167430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.054+0000 7f5078c00640 1 --2- 172.21.15.81:0/65519391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508406e6e0 0x7f50840b0f80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.054+0000 7f5078c00640 1 -- 172.21.15.81:0/65519391 >> 172.21.15.81:0/65519391 conn(0x7f508406d180 msgr2=0x7f5084166c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.055+0000 7f5647400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 0x7f56401441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.055+0000 7f5647400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f564014c310 0x7f56401587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.056+0000 7f5647400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640157d50 0x7f5640158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.056+0000 7f5644a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 0x7f56401441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.056+0000 7f5644a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 0x7f56401441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53898/0 (socket says 172.21.15.81:53898) 2024-09-10T20:39:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.056+0000 7f563fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f564014c310 0x7f56401587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.056+0000 7f563fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f564014c310 0x7f56401587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:33634/0 (socket says 172.21.15.81:33634) 2024-09-10T20:39:27.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.057+0000 7f5647400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f564006f350 con 0x7f5640157d50 2024-09-10T20:39:27.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.057+0000 7f5647400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f56400cf500 con 0x7f56280053c0 2024-09-10T20:39:27.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.057+0000 7f5647400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f564006f4d0 con 0x7f564014c310 2024-09-10T20:39:27.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.057+0000 7f5644a00640 1 -- 172.21.15.81:0/2998520168 learned_addr learned my addr 172.21.15.81:0/2998520168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.058+0000 7f5645400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640157d50 0x7f5640158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.059+0000 7f5645400640 1 -- 172.21.15.81:0/2998520168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f564014c310 msgr2=0x7f56401587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.059+0000 7f5645400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f564014c310 0x7f56401587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.059+0000 7f5645400640 1 -- 172.21.15.81:0/2998520168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 msgr2=0x7f56401441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.059+0000 7f5645400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 0x7f56401441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.059+0000 7f5645400640 1 -- 172.21.15.81:0/2998520168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5640154f00 con 0x7f5640157d50 2024-09-10T20:39:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.060+0000 7f5644a00640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 0x7f56401441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:27.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.061+0000 7f5078c00640 1 -- 172.21.15.81:0/65519391 shutdown_connections 2024-09-10T20:39:27.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.061+0000 7f5078c00640 1 -- 172.21.15.81:0/65519391 wait complete. 2024-09-10T20:39:27.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.060+0000 7f5645400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640157d50 0x7f5640158d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5638030000 tx=0x7f563802bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.061+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638006070 con 0x7f5640157d50 2024-09-10T20:39:27.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.062+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f56380062e0 con 0x7f5640157d50 2024-09-10T20:39:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.062+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380066d0 con 0x7f5640157d50 2024-09-10T20:39:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.062+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564015ad40 con 0x7f5640157d50 2024-09-10T20:39:27.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.062+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56401551a0 con 0x7f5640157d50 2024-09-10T20:39:27.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.063+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5638034800 con 0x7f5640157d50 2024-09-10T20:39:27.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.064+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f563803f760 con 0x7f5640157d50 2024-09-10T20:39:27.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.068+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561c005290 con 0x7f5640157d50 2024-09-10T20:39:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.083+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f563800c2d0 con 0x7f5640157d50 2024-09-10T20:39:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.108+0000 7f03d5e00640 1 -- 172.21.15.81:0/749010565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d00b3db0 msgr2=0x7f03d00ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.108+0000 7f03d5e00640 1 --2- 172.21.15.81:0/749010565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d00b3db0 0x7f03d00ad950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f03d006e800 tx=0x7f03c002a340 comp rx=0 tx=0).stop 2024-09-10T20:39:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.108+0000 7f03d5e00640 1 -- 172.21.15.81:0/749010565 shutdown_connections 2024-09-10T20:39:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.108+0000 7f03d5e00640 1 --2- 172.21.15.81:0/749010565 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d00b3db0 0x7f03d00ad950 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.108+0000 7f03d5e00640 1 --2- 172.21.15.81:0/749010565 >> v2:172.21.15.81:3300/0 conn(0x7f03d0073340 0x7f03d00b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.108+0000 7f03d5e00640 1 -- 172.21.15.81:0/749010565 >> 172.21.15.81:0/749010565 conn(0x7f03d006d180 msgr2=0x7f03d00b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.109+0000 7f03d5e00640 1 -- 172.21.15.81:0/749010565 shutdown_connections 2024-09-10T20:39:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.109+0000 7f03d5e00640 1 -- 172.21.15.81:0/749010565 wait complete. 2024-09-10T20:39:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.118+0000 7f03d5e00640 1 Processor -- start 2024-09-10T20:39:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.118+0000 7f03d5e00640 1 -- start start 2024-09-10T20:39:27.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.130+0000 7f03d5e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d0073340 0x7f03d01fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.130+0000 7f03d5e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d00b3db0 0x7f03d00abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.131+0000 7f03cea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d0073340 0x7f03d01fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.133+0000 7f03cea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d0073340 0x7f03d01fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53908/0 (socket says 172.21.15.81:53908) 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.133+0000 7f03ce000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d00b3db0 0x7f03d00abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.133+0000 7f03d5e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d0161650 0x7f03d00ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.133+0000 7f03d5e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03d00ae450 con 0x7f03d00b3db0 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.133+0000 7f03d5e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f03d00ae2d0 con 0x7f03d0073340 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.133+0000 7f03d5e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f03d00ae5d0 con 0x7f03d0161650 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.134+0000 7f03cf400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d0161650 0x7f03d00ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.134+0000 7f03cf400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d0161650 0x7f03d00ac520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:33648/0 (socket says 172.21.15.81:33648) 2024-09-10T20:39:27.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.134+0000 7f03cf400640 1 -- 172.21.15.81:0/1681690653 learned_addr learned my addr 172.21.15.81:0/1681690653 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.140 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.142+0000 7f03ce000640 1 -- 172.21.15.81:0/1681690653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d0161650 msgr2=0x7f03d00ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.142+0000 7f03ce000640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d0161650 0x7f03d00ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.142+0000 7f03ce000640 1 -- 172.21.15.81:0/1681690653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d0073340 msgr2=0x7f03d01fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.143+0000 7f03ce000640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d0073340 0x7f03d01fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.143+0000 7f03ce000640 1 -- 172.21.15.81:0/1681690653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d01fd770 con 0x7f03d00b3db0 2024-09-10T20:39:27.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.143+0000 7f03cea00640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d0073340 0x7f03d01fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:39:27.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.144+0000 7f03ce000640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d00b3db0 0x7f03d00abfe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00d650 tx=0x7f03bc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.145+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc017070 con 0x7f03d00b3db0 2024-09-10T20:39:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.145+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f03bc0042f0 con 0x7f03d00b3db0 2024-09-10T20:39:27.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.145+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc005280 con 0x7f03d00b3db0 2024-09-10T20:39:27.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.145+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d01f98f0 con 0x7f03d00b3db0 2024-09-10T20:39:27.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.145+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d01f9eb0 con 0x7f03d00b3db0 2024-09-10T20:39:27.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.147+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f03bc009820 con 0x7f03d00b3db0 2024-09-10T20:39:27.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.148+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f03bc0035f0 con 0x7f03d00b3db0 2024-09-10T20:39:27.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.162+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a8005290 con 0x7f03d00b3db0 2024-09-10T20:39:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.166+0000 7f7583600640 1 -- 172.21.15.81:0/1949425468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c154110 msgr2=0x7f757c15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.166+0000 7f7583600640 1 --2- 172.21.15.81:0/1949425468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c154110 0x7f757c15a980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f75740074e0 tx=0x7f757402b2a0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.176+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f03bc020020 con 0x7f03d00b3db0 2024-09-10T20:39:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.181+0000 7f7583600640 1 -- 172.21.15.81:0/1949425468 shutdown_connections 2024-09-10T20:39:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.181+0000 7f7583600640 1 --2- 172.21.15.81:0/1949425468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c0c9f60 0x7f757c06f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.181+0000 7f7583600640 1 --2- 172.21.15.81:0/1949425468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c154110 0x7f757c15a980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.181+0000 7f7583600640 1 -- 172.21.15.81:0/1949425468 >> 172.21.15.81:0/1949425468 conn(0x7f757c0b1380 msgr2=0x7f757c0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.181+0000 7f7583600640 1 -- 172.21.15.81:0/1949425468 shutdown_connections 2024-09-10T20:39:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.181+0000 7f7583600640 1 -- 172.21.15.81:0/1949425468 wait complete. 2024-09-10T20:39:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.184+0000 7f7583600640 1 Processor -- start 2024-09-10T20:39:27.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.188+0000 7f7583600640 1 -- start start 2024-09-10T20:39:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.194+0000 7f7583600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c0c9f60 0x7f757c1f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.194+0000 7f7583600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0cc220 0x7f757c0b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.194+0000 7f7583600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c154110 0x7f757c157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.193+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f43e80ce550 con 0x7f43e80d45f0 2024-09-10T20:39:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.195+0000 7f757be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c0c9f60 0x7f757c1f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.196+0000 7f7580c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c154110 0x7f757c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.200+0000 7f7580c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c154110 0x7f757c157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:33668/0 (socket says 172.21.15.81:33668) 2024-09-10T20:39:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.200+0000 7f7580c00640 1 -- 172.21.15.81:0/3337417624 learned_addr learned my addr 172.21.15.81:0/3337417624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.196+0000 7f7583600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f757c0b1ff0 con 0x7f757c0cc220 2024-09-10T20:39:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.200+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f757c0b1e70 con 0x7f757c0c9f60 2024-09-10T20:39:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.200+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f757c0729d0 con 0x7f757c154110 2024-09-10T20:39:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.200+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d000fb70 con 0x7f43e80d45f0 2024-09-10T20:39:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.206+0000 7f757b400640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0cc220 0x7f757c0b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.206+0000 7f7580c00640 1 -- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c0c9f60 msgr2=0x7f757c1f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.206+0000 7f7580c00640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c0c9f60 0x7f757c1f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.206+0000 7f7580c00640 1 -- 172.21.15.81:0/3337417624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0cc220 msgr2=0x7f757c0b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.206+0000 7f7580c00640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0cc220 0x7f757c0b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.207+0000 7f7580c00640 1 -- 172.21.15.81:0/3337417624 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c0b43e0 con 0x7f757c154110 2024-09-10T20:39:27.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.207+0000 7f757be00640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c0c9f60 0x7f757c1f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.209+0000 7f7580c00640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c154110 0x7f757c157210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f757000c7d0 tx=0x7f757000cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.209+0000 7f757b400640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0cc220 0x7f757c0b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:39:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.210+0000 7f7578c00640 1 -- 172.21.15.81:0/3337417624 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570003b70 con 0x7f757c154110 2024-09-10T20:39:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.210+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f563802f030 con 0x7f5640157d50 2024-09-10T20:39:27.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.211+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c0b46c0 con 0x7f757c154110 2024-09-10T20:39:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.211+0000 7f7578c00640 1 -- 172.21.15.81:0/3337417624 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7570003d10 con 0x7f757c154110 2024-09-10T20:39:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.211+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c14e8e0 con 0x7f757c154110 2024-09-10T20:39:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.215+0000 7f7578c00640 1 -- 172.21.15.81:0/3337417624 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757000aab0 con 0x7f757c154110 2024-09-10T20:39:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.208+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf1401abe0 con 0x7fbf2406f530 2024-09-10T20:39:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.216+0000 7f7578c00640 1 -- 172.21.15.81:0/3337417624 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f757000acd0 con 0x7f757c154110 2024-09-10T20:39:27.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.216+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03bc004e70 con 0x7f03d00b3db0 2024-09-10T20:39:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.221+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757c06f630 con 0x7f757c154110 2024-09-10T20:39:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.222+0000 7f43df400640 1 -- 172.21.15.81:0/693021 <== mon.2 v2:172.21.15.143:3301/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f43d0026020 con 0x7f43e80d45f0 2024-09-10T20:39:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.222+0000 7f7578c00640 1 -- 172.21.15.81:0/3337417624 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7570012880 con 0x7f757c154110 2024-09-10T20:39:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.224+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e80d45f0 msgr2=0x7f43e80cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.224+0000 7f43e7e00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e80d45f0 0x7f43e80cb000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43d000c9a0 tx=0x7f43d000ce60 comp rx=0 tx=0).stop 2024-09-10T20:39:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.225+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 shutdown_connections 2024-09-10T20:39:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.225+0000 7f43e7e00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43e815dcc0 0x7f43e80b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.225+0000 7f43e7e00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43e815d8e0 0x7f43e8155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.225+0000 7f43e7e00640 1 --2- 172.21.15.81:0/693021 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43e80d45f0 0x7f43e80cb000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.225+0000 7f7578c00640 1 -- 172.21.15.81:0/3337417624 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f75700050d0 con 0x7f757c154110 2024-09-10T20:39:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.225+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 >> 172.21.15.81:0/693021 conn(0x7f43e80d3a40 msgr2=0x7f43e8068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.226+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 shutdown_connections 2024-09-10T20:39:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.226+0000 7f43e7e00640 1 -- 172.21.15.81:0/693021 wait complete. 2024-09-10T20:39:27.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.252+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2824281375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 msgr2=0x7f9c94162130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.253+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2824281375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c94162130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c9408d360 tx=0x7f9c8002a440 comp rx=0 tx=0).stop 2024-09-10T20:39:27.257 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.255+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2824281375 shutdown_connections 2024-09-10T20:39:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.255+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2824281375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c94162130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.255+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2824281375 >> v2:172.21.15.81:3300/0 conn(0x7f9c94161810 0x7f9c94161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.255+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2824281375 >> 172.21.15.81:0/2824281375 conn(0x7f9c940d3a40 msgr2=0x7f9c940d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.259+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2824281375 shutdown_connections 2024-09-10T20:39:27.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.259+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2824281375 wait complete. 2024-09-10T20:39:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.268+0000 7f9c9ae00640 1 Processor -- start 2024-09-10T20:39:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.272+0000 7f9c9ae00640 1 -- start start 2024-09-10T20:39:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.274+0000 7f9c9ae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c9414ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.274+0000 7f9c9ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c9415c460 0x7f9c9406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.274+0000 7f9c99a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c9414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.275+0000 7f9c99a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c9414ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53938/0 (socket says 172.21.15.81:53938) 2024-09-10T20:39:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.275+0000 7f9c99a00640 1 -- 172.21.15.81:0/2178939815 learned_addr learned my addr 172.21.15.81:0/2178939815 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.275+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c94161810 0x7f9c9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.276+0000 7f9c9a400640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c94161810 0x7f9c9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.276+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940b0cb0 con 0x7f9c94161810 2024-09-10T20:39:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.276+0000 7f9c99000640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c9415c460 0x7f9c9406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.277+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940b0b30 con 0x7f9c940d4560 2024-09-10T20:39:27.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.277+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9c940b0e30 con 0x7f9c9415c460 2024-09-10T20:39:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.279+0000 7f9c9a400640 1 -- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c9415c460 msgr2=0x7f9c9406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.279+0000 7f9c9a400640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c9415c460 0x7f9c9406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.279+0000 7f9c9a400640 1 -- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 msgr2=0x7f9c9414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.280+0000 7f9c9a400640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c9414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.280+0000 7f9c9a400640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c940b6930 con 0x7f9c94161810 2024-09-10T20:39:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.280+0000 7f9c99000640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c9415c460 0x7f9c9406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.280+0000 7f9c99a00640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c9414ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.281+0000 7f9c9a400640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c94161810 0x7f9c9406e320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c8e0 tx=0x7f9c8c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.281+0000 7f9c91600640 1 -- 172.21.15.81:0/2178939815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c016020 con 0x7f9c94161810 2024-09-10T20:39:27.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.282+0000 7f9c91600640 1 -- 172.21.15.81:0/2178939815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c8c00a930 con 0x7f9c94161810 2024-09-10T20:39:27.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.282+0000 7f9c91600640 1 -- 172.21.15.81:0/2178939815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c00adc0 con 0x7f9c94161810 2024-09-10T20:39:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.282+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c940b6c10 con 0x7f9c94161810 2024-09-10T20:39:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.282+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c940b71d0 con 0x7f9c94161810 2024-09-10T20:39:27.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.285+0000 7f9c91600640 1 -- 172.21.15.81:0/2178939815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9c8c0127b0 con 0x7f9c94161810 2024-09-10T20:39:27.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.286+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fbef80052f0 con 0x7fbf2406f530 2024-09-10T20:39:27.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.285+0000 7f9c91600640 1 -- 172.21.15.81:0/2178939815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9c8c01bde0 con 0x7f9c94161810 2024-09-10T20:39:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.286+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c70005290 con 0x7f9c94161810 2024-09-10T20:39:27.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.290+0000 7f9c91600640 1 -- 172.21.15.81:0/2178939815 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f9c8c020070 con 0x7f9c94161810 2024-09-10T20:39:27.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.301+0000 7fbf1b400640 1 -- 172.21.15.81:0/4136593667 <== mon.1 v2:172.21.15.143:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7fbf241f43a0 con 0x7fbf2406f530 2024-09-10T20:39:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.306+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf2406f530 msgr2=0x7fbf241f3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.306+0000 7fbf23e00640 1 --2- 172.21.15.81:0/4136593667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf2406f530 0x7fbf241f3e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400c460 tx=0x7fbf1400c920 comp rx=0 tx=0).stop 2024-09-10T20:39:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.306+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 shutdown_connections 2024-09-10T20:39:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.306+0000 7fbf23e00640 1 --2- 172.21.15.81:0/4136593667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf240cfcb0 0x7fbf2415fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.306+0000 7fbf23e00640 1 --2- 172.21.15.81:0/4136593667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf240cf8d0 0x7fbf2415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.307+0000 7fbf23e00640 1 --2- 172.21.15.81:0/4136593667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf2406f530 0x7fbf241f3e60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.307+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 >> 172.21.15.81:0/4136593667 conn(0x7fbf2406cb50 msgr2=0x7fbf2406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.307+0000 7fbc83e00640 1 -- 172.21.15.81:0/819098361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415d8e0 msgr2=0x7fbc841615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.307+0000 7fbc83e00640 1 --2- 172.21.15.81:0/819098361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415d8e0 0x7fbc841615a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbc840d2840 tx=0x7fbc7c033260 comp rx=0 tx=0).stop 2024-09-10T20:39:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.307+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 shutdown_connections 2024-09-10T20:39:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.310+0000 7fbc83e00640 1 -- 172.21.15.81:0/819098361 shutdown_connections 2024-09-10T20:39:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.310+0000 7fbc83e00640 1 --2- 172.21.15.81:0/819098361 >> v2:172.21.15.143:3300/0 conn(0x7fbc8415dcc0 0x7fbc84161ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.310+0000 7fbc83e00640 1 --2- 172.21.15.81:0/819098361 >> v2:172.21.15.81:3300/0 conn(0x7fbc840d45f0 0x7fbc84162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.310+0000 7fbc83e00640 1 --2- 172.21.15.81:0/819098361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415d8e0 0x7fbc841615a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.310+0000 7fbc83e00640 1 -- 172.21.15.81:0/819098361 >> 172.21.15.81:0/819098361 conn(0x7fbc840d3a40 msgr2=0x7fbc840d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.311+0000 7fbf23e00640 1 -- 172.21.15.81:0/4136593667 wait complete. 2024-09-10T20:39:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.312+0000 7fbc83e00640 1 -- 172.21.15.81:0/819098361 shutdown_connections 2024-09-10T20:39:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.312+0000 7fbc83e00640 1 -- 172.21.15.81:0/819098361 wait complete. 2024-09-10T20:39:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.323+0000 7fbc83e00640 1 Processor -- start 2024-09-10T20:39:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.323+0000 7fbc83e00640 1 -- start start 2024-09-10T20:39:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.325+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc840d45f0 0x7fbc84157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.325+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415dcc0 0x7fbc84153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.325+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc8415a6b0 0x7fbc84153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.330+0000 7fbc82a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc840d45f0 0x7fbc84157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.331+0000 7fbc82000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415dcc0 0x7fbc84153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.331+0000 7fbc82000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415dcc0 0x7fbc84153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:33688/0 (socket says 172.21.15.81:33688) 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.331+0000 7fbc82a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc840d45f0 0x7fbc84157930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36946/0 (socket says 172.21.15.81:36946) 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.333+0000 7fbc83400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc8415a6b0 0x7fbc84153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.333+0000 7fbc83400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc8415a6b0 0x7fbc84153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53942/0 (socket says 172.21.15.81:53942) 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.333+0000 7fbc82000640 1 -- 172.21.15.81:0/1355348489 learned_addr learned my addr 172.21.15.81:0/1355348489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.333+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc840cec60 con 0x7fbc840d45f0 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.334+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbc840ceae0 con 0x7fbc8415a6b0 2024-09-10T20:39:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.336+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbc840cede0 con 0x7fbc8415dcc0 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.341+0000 7fbc82a00640 1 -- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415dcc0 msgr2=0x7fbc84153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.341+0000 7fbc82a00640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415dcc0 0x7fbc84153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.341+0000 7fbc82a00640 1 -- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc8415a6b0 msgr2=0x7fbc84153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.341+0000 7fbc82a00640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc8415a6b0 0x7fbc84153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.341+0000 7fbc82a00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8415c310 con 0x7fbc840d45f0 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.341+0000 7fbc82000640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415dcc0 0x7fbc84153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.342+0000 7fbc83400640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc8415a6b0 0x7fbc84153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.342+0000 7fbc82a00640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc840d45f0 0x7fbc84157930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c03a000 tx=0x7fbc7c039570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.347+0000 7fbc7aa00640 1 -- 172.21.15.81:0/1355348489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c049030 con 0x7fbc840d45f0 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.347+0000 7fbc7aa00640 1 -- 172.21.15.81:0/1355348489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc7c041040 con 0x7fbc840d45f0 2024-09-10T20:39:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.347+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8415ae90 con 0x7fbc840d45f0 2024-09-10T20:39:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.348+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8415d090 con 0x7fbc840d45f0 2024-09-10T20:39:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.352+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc840cf380 con 0x7fbc840d45f0 2024-09-10T20:39:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.352+0000 7fbc7aa00640 1 -- 172.21.15.81:0/1355348489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c040070 con 0x7fbc840d45f0 2024-09-10T20:39:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.356+0000 7fbc7aa00640 1 -- 172.21.15.81:0/1355348489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fbc7c039970 con 0x7fbc840d45f0 2024-09-10T20:39:27.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.360+0000 7fbc7aa00640 1 -- 172.21.15.81:0/1355348489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbc7c059d10 con 0x7fbc840d45f0 2024-09-10T20:39:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.361+0000 7fbc7aa00640 1 -- 172.21.15.81:0/1355348489 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fbc7c039d30 con 0x7fbc840d45f0 2024-09-10T20:39:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.362+0000 7fe84d600640 1 -- 172.21.15.81:0/1185842591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480d4560 msgr2=0x7fe8480ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.362+0000 7fe84d600640 1 --2- 172.21.15.81:0/1185842591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480d4560 0x7fe8480ce550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe848162860 tx=0x7fe83803b470 comp rx=0 tx=0).stop 2024-09-10T20:39:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.368+0000 7fe84d600640 1 -- 172.21.15.81:0/1185842591 shutdown_connections 2024-09-10T20:39:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.368+0000 7fe84d600640 1 --2- 172.21.15.81:0/1185842591 >> v2:172.21.15.143:3300/0 conn(0x7fe8480cea90 0x7fe8480ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.368+0000 7fe84d600640 1 --2- 172.21.15.81:0/1185842591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480d4560 0x7fe8480ce550 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.368+0000 7fe84d600640 1 -- 172.21.15.81:0/1185842591 >> 172.21.15.81:0/1185842591 conn(0x7fe8480d3a40 msgr2=0x7fe8480d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.368+0000 7fe84d600640 1 -- 172.21.15.81:0/1185842591 shutdown_connections 2024-09-10T20:39:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.368+0000 7fe84d600640 1 -- 172.21.15.81:0/1185842591 wait complete. 2024-09-10T20:39:27.378 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.371+0000 7fe84d600640 1 Processor -- start 2024-09-10T20:39:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.378+0000 7fe84d600640 1 -- start start 2024-09-10T20:39:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.387+0000 7fe84d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480cea90 0x7fe8480c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.387+0000 7fe84d600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8480d4560 0x7fe8481f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.387+0000 7fe84d600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe848161810 0x7fe8481533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.388+0000 7fe847400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8480d4560 0x7fe8481f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.388+0000 7fe847400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8480d4560 0x7fe8481f1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:33696/0 (socket says 172.21.15.81:33696) 2024-09-10T20:39:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.388+0000 7fe847400640 1 -- 172.21.15.81:0/3326286175 learned_addr learned my addr 172.21.15.81:0/3326286175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.389+0000 7fe84cc00640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe848161810 0x7fe8481533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8480b0ec0 con 0x7fe8480cea90 2024-09-10T20:39:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe8480b0d40 con 0x7fe848161810 2024-09-10T20:39:27.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe8480b1040 con 0x7fe8480d4560 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe847e00640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480cea90 0x7fe8480c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84cc00640 1 -- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8480d4560 msgr2=0x7fe8481f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84cc00640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8480d4560 0x7fe8481f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84cc00640 1 -- 172.21.15.81:0/3326286175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480cea90 msgr2=0x7fe8480c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84cc00640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480cea90 0x7fe8480c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe84cc00640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8481f18a0 con 0x7fe848161810 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.392+0000 7fe847e00640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480cea90 0x7fe8480c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.393+0000 7fe84cc00640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe848161810 0x7fe8481533c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe84000be00 tx=0x7fe84000bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.393+0000 7fe83fe00640 1 -- 172.21.15.81:0/3326286175 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840019070 con 0x7fe848161810 2024-09-10T20:39:27.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.393+0000 7fe83fe00640 1 -- 172.21.15.81:0/3326286175 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe840014440 con 0x7fe848161810 2024-09-10T20:39:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.395+0000 7f886ce00640 1 -- 172.21.15.81:0/2662026268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 msgr2=0x7f886806f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.395+0000 7f8866000640 1 -- 172.21.15.81:0/2662026268 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854031600 con 0x7f886816b060 2024-09-10T20:39:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.395+0000 7f886ce00640 1 --2- 172.21.15.81:0/2662026268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 0x7f886806f630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f886816b4d0 tx=0x7f885402a440 comp rx=0 tx=0).stop 2024-09-10T20:39:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7f886ce00640 1 -- 172.21.15.81:0/2662026268 shutdown_connections 2024-09-10T20:39:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7f886ce00640 1 --2- 172.21.15.81:0/2662026268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 0x7f886806f630 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7f886ce00640 1 --2- 172.21.15.81:0/2662026268 >> v2:172.21.15.81:3300/0 conn(0x7f88680aed80 0x7f886816ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7f886ce00640 1 -- 172.21.15.81:0/2662026268 >> 172.21.15.81:0/2662026268 conn(0x7f886806cb50 msgr2=0x7f886806cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7f886ce00640 1 -- 172.21.15.81:0/2662026268 shutdown_connections 2024-09-10T20:39:27.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7f886ce00640 1 -- 172.21.15.81:0/2662026268 wait complete. 2024-09-10T20:39:27.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.399+0000 7f886ce00640 1 Processor -- start 2024-09-10T20:39:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.393+0000 7fe83fe00640 1 -- 172.21.15.81:0/3326286175 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840014910 con 0x7fe848161810 2024-09-10T20:39:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8481f0a60 con 0x7fe848161810 2024-09-10T20:39:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8481f1020 con 0x7fe848161810 2024-09-10T20:39:27.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7fe83fe00640 1 -- 172.21.15.81:0/3326286175 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fe840014ab0 con 0x7fe848161810 2024-09-10T20:39:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.396+0000 7fe83fe00640 1 -- 172.21.15.81:0/3326286175 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe84001d6f0 con 0x7fe848161810 2024-09-10T20:39:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.399+0000 7f886ce00640 1 -- start start 2024-09-10T20:39:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.400+0000 7f886ce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886806fb70 0x7f88680ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.401+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8480ceee0 con 0x7fe848161810 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.401+0000 7f886ce00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88680aed80 0x7f886816c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.401+0000 7f886ce00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 0x7f886816caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.402+0000 7f886ce00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88680cf600 con 0x7f886806fb70 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.402+0000 7f886ce00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f886806f200 con 0x7f886816b060 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.402+0000 7f886ce00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f88680cf780 con 0x7f88680aed80 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.402+0000 7f8867e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 0x7f886816caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.402+0000 7f8867e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 0x7f886816caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53964/0 (socket says 172.21.15.81:53964) 2024-09-10T20:39:27.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.402+0000 7f8867e00640 1 -- 172.21.15.81:0/1266375496 learned_addr learned my addr 172.21.15.81:0/1266375496 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.402+0000 7f8867400640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886806fb70 0x7f88680ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.403+0000 7f8867400640 1 -- 172.21.15.81:0/1266375496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88680aed80 msgr2=0x7f886816c5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T20:39:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.403+0000 7f8867400640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88680aed80 0x7f886816c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.404+0000 7f8867400640 1 -- 172.21.15.81:0/1266375496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 msgr2=0x7f886816caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.404+0000 7f8867400640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 0x7f886816caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.404+0000 7f8867400640 1 -- 172.21.15.81:0/1266375496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88680cd4e0 con 0x7f886806fb70 2024-09-10T20:39:27.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.405+0000 7f8867400640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886806fb70 0x7f88680ccf00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8858005fd0 tx=0x7f885800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.405+0000 7f885f400640 1 -- 172.21.15.81:0/1266375496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858009c30 con 0x7f886806fb70 2024-09-10T20:39:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.407+0000 7fe83fe00640 1 -- 172.21.15.81:0/3326286175 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fe840023030 con 0x7fe848161810 2024-09-10T20:39:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.406+0000 7f885f400640 1 -- 172.21.15.81:0/1266375496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8858004030 con 0x7f886806fb70 2024-09-10T20:39:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.407+0000 7f885f400640 1 -- 172.21.15.81:0/1266375496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858004460 con 0x7f886806fb70 2024-09-10T20:39:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.407+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88680cd7c0 con 0x7f886806fb70 2024-09-10T20:39:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.407+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88680cdd80 con 0x7f886806fb70 2024-09-10T20:39:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.409+0000 7f885f400640 1 -- 172.21.15.81:0/1266375496 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f88580053b0 con 0x7f886806fb70 2024-09-10T20:39:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.409+0000 7f885f400640 1 -- 172.21.15.81:0/1266375496 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8858003c40 con 0x7f886806fb70 2024-09-10T20:39:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.414+0000 7f06bb000640 1 -- 172.21.15.81:0/4052694108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b4154110 msgr2=0x7f06b415a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.414+0000 7f06bb000640 1 --2- 172.21.15.81:0/4052694108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b4154110 0x7f06b415a980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f06a0009370 tx=0x7f06a002b8b0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.414+0000 7f06bb000640 1 -- 172.21.15.81:0/4052694108 shutdown_connections 2024-09-10T20:39:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.414+0000 7f06bb000640 1 --2- 172.21.15.81:0/4052694108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b4154110 0x7f06b415a980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.414+0000 7f06bb000640 1 -- 172.21.15.81:0/4052694108 >> 172.21.15.81:0/4052694108 conn(0x7f06b40b1380 msgr2=0x7f06b40b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.414+0000 7f06bb000640 1 -- 172.21.15.81:0/4052694108 shutdown_connections 2024-09-10T20:39:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.414+0000 7f06bb000640 1 -- 172.21.15.81:0/4052694108 wait complete. 2024-09-10T20:39:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.416+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88680ae650 con 0x7f886806fb70 2024-09-10T20:39:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.421+0000 7f06bb000640 1 Processor -- start 2024-09-10T20:39:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.421+0000 7f06bb000640 1 -- start start 2024-09-10T20:39:27.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.424+0000 7f885f400640 1 -- 172.21.15.81:0/1266375496 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f8858020020 con 0x7f886806fb70 2024-09-10T20:39:27.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.426+0000 7f06bb000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b40c9f60 0x7f06b40b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.427+0000 7f06bb000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06b40cc220 0x7f06b40ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.428+0000 7f06b2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06b40cc220 0x7f06b40ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.428+0000 7f06b2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06b40cc220 0x7f06b40ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53980/0 (socket says 172.21.15.81:53980) 2024-09-10T20:39:27.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.428+0000 7f06b2a00640 1 -- 172.21.15.81:0/2075407270 learned_addr learned my addr 172.21.15.81:0/2075407270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.430+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f03a8005580 con 0x7f03d00b3db0 2024-09-10T20:39:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.431+0000 7f06bb000640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06b4154110 0x7f06b40b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.431+0000 7f06b3400640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b40c9f60 0x7f06b40b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.431+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06b40729d0 con 0x7f06b4154110 2024-09-10T20:39:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.431+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f06b40b2080 con 0x7f06b40cc220 2024-09-10T20:39:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.431+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f06b4072b50 con 0x7f06b40c9f60 2024-09-10T20:39:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.432+0000 7f06b3e00640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06b4154110 0x7f06b40b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.432+0000 7f06b3e00640 1 -- 172.21.15.81:0/2075407270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b40c9f60 msgr2=0x7f06b40b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.432+0000 7f06b3e00640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b40c9f60 0x7f06b40b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.432+0000 7f06b3e00640 1 -- 172.21.15.81:0/2075407270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06b40cc220 msgr2=0x7f06b40ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.432+0000 7f06b3e00640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06b40cc220 0x7f06b40ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.432+0000 7f06b3e00640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b40cde80 con 0x7f06b4154110 2024-09-10T20:39:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.433+0000 7f06b3e00640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06b4154110 0x7f06b40b2680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06a800c760 tx=0x7f06a800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.434+0000 7f06a7e00640 1 -- 172.21.15.81:0/2075407270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8003b70 con 0x7f06b4154110 2024-09-10T20:39:27.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.434+0000 7f06a7e00640 1 -- 172.21.15.81:0/2075407270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06a8003d10 con 0x7f06b4154110 2024-09-10T20:39:27.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.434+0000 7f06a7e00640 1 -- 172.21.15.81:0/2075407270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a800aab0 con 0x7f06b4154110 2024-09-10T20:39:27.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.434+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b40b5580 con 0x7f06b4154110 2024-09-10T20:39:27.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.434+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b4155f20 con 0x7f06b4154110 2024-09-10T20:39:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.435+0000 7f06a7e00640 1 -- 172.21.15.81:0/2075407270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f06a800ac50 con 0x7f06b4154110 2024-09-10T20:39:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.435+0000 7f06a7e00640 1 -- 172.21.15.81:0/2075407270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f06a80128f0 con 0x7f06b4154110 2024-09-10T20:39:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.436+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f757c0cc730 con 0x7f757c154110 2024-09-10T20:39:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.441+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f561c005580 con 0x7f5640157d50 2024-09-10T20:39:27.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.442+0000 7f03c7400640 1 -- 172.21.15.81:0/1681690653 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) ==== 106+0+0 (secure 0 0 0) 0x7f03d01fd770 con 0x7f03d00b3db0 2024-09-10T20:39:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d00b3db0 msgr2=0x7f03d00abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d00b3db0 0x7f03d00abfe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00d650 tx=0x7f03bc00db10 comp rx=0 tx=0).stop 2024-09-10T20:39:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 shutdown_connections 2024-09-10T20:39:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f03d0161650 0x7f03d00ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03d00b3db0 0x7f03d00abfe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 --2- 172.21.15.81:0/1681690653 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03d0073340 0x7f03d01fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 >> 172.21.15.81:0/1681690653 conn(0x7f03d006d180 msgr2=0x7f03d01547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 shutdown_connections 2024-09-10T20:39:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.444+0000 7f03d5e00640 1 -- 172.21.15.81:0/1681690653 wait complete. 2024-09-10T20:39:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.443+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b415a980 con 0x7f06b4154110 2024-09-10T20:39:27.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.450+0000 7f01aa800640 1 -- 172.21.15.81:0/615224466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a415d390 msgr2=0x7f01a415d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.450+0000 7f01aa800640 1 --2- 172.21.15.81:0/615224466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a415d390 0x7f01a415d840 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0198009900 tx=0x7f019803b550 comp rx=0 tx=0).stop 2024-09-10T20:39:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.451+0000 7f01aa800640 1 -- 172.21.15.81:0/615224466 shutdown_connections 2024-09-10T20:39:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.451+0000 7f01aa800640 1 --2- 172.21.15.81:0/615224466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a415d390 0x7f01a415d840 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.451+0000 7f01aa800640 1 -- 172.21.15.81:0/615224466 >> 172.21.15.81:0/615224466 conn(0x7f01a40b2280 msgr2=0x7f01a40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.448+0000 7f563cc00640 1 -- 172.21.15.81:0/2998520168 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) ==== 117+0+0 (secure 0 0 0) 0x7f5638006870 con 0x7f5640157d50 2024-09-10T20:39:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.453+0000 7f01aa800640 1 -- 172.21.15.81:0/615224466 shutdown_connections 2024-09-10T20:39:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.453+0000 7f01aa800640 1 -- 172.21.15.81:0/615224466 wait complete. 2024-09-10T20:39:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.453+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640157d50 msgr2=0x7f5640158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.453+0000 7f5647400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640157d50 0x7f5640158d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5638030000 tx=0x7f563802bd00 comp rx=0 tx=0).stop 2024-09-10T20:39:27.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.455+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 shutdown_connections 2024-09-10T20:39:27.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.455+0000 7f5647400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5640157d50 0x7f5640158d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.455+0000 7f5647400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f564014c310 0x7f56401587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.455+0000 7f5647400640 1 --2- 172.21.15.81:0/2998520168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56280053c0 0x7f56401441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.455+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 >> 172.21.15.81:0/2998520168 conn(0x7f564006d180 msgr2=0x7f56400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.455+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 shutdown_connections 2024-09-10T20:39:27.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f2779200640 1 -- 172.21.15.81:0/212327433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27740d1fb0 msgr2=0x7f2774161cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f2779200640 1 --2- 172.21.15.81:0/212327433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27740d1fb0 0x7f2774161cd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2760009900 tx=0x7f276002a670 comp rx=0 tx=0).stop 2024-09-10T20:39:27.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f2779200640 1 -- 172.21.15.81:0/212327433 shutdown_connections 2024-09-10T20:39:27.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f2779200640 1 --2- 172.21.15.81:0/212327433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f27740d1fb0 0x7f2774161cd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f2779200640 1 -- 172.21.15.81:0/212327433 >> 172.21.15.81:0/212327433 conn(0x7f27740d3a60 msgr2=0x7f27740d3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f5647400640 1 -- 172.21.15.81:0/2998520168 wait complete. 2024-09-10T20:39:27.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f2779200640 1 -- 172.21.15.81:0/212327433 shutdown_connections 2024-09-10T20:39:27.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.456+0000 7f2779200640 1 -- 172.21.15.81:0/212327433 wait complete. 2024-09-10T20:39:27.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.460+0000 7f2779200640 1 Processor -- start 2024-09-10T20:39:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.460+0000 7f2779200640 1 -- start start 2024-09-10T20:39:27.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.460+0000 7f01aa800640 1 Processor -- start 2024-09-10T20:39:27.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.462+0000 7f01aa800640 1 -- start start 2024-09-10T20:39:27.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.462+0000 7f2779200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27740b1070 0x7f27740b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.462+0000 7f2779200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27740d1fb0 0x7f27740d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2779200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f277415db50 0x7f27740c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2779200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27740b1db0 con 0x7f27740b1070 2024-09-10T20:39:27.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2779200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f27740b1c30 con 0x7f27740d1fb0 2024-09-10T20:39:27.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2779200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f27740b1f30 con 0x7f277415db50 2024-09-10T20:39:27.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2771400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27740d1fb0 0x7f27740d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2771400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27740d1fb0 0x7f27740d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53990/0 (socket says 172.21.15.81:53990) 2024-09-10T20:39:27.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2771400640 1 -- 172.21.15.81:0/3532144001 learned_addr learned my addr 172.21.15.81:0/3532144001 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.463+0000 7f2772800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f277415db50 0x7f27740c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.464+0000 7f9b54400640 1 -- 172.21.15.81:0/327293493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 msgr2=0x7f9b440369e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.464+0000 7f9b54400640 1 --2- 172.21.15.81:0/327293493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 0x7f9b440369e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009820 tx=0x7f9b4002a4a0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.467+0000 7f9b54400640 1 -- 172.21.15.81:0/327293493 shutdown_connections 2024-09-10T20:39:27.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.467+0000 7f9b54400640 1 --2- 172.21.15.81:0/327293493 >> v2:172.21.15.81:3300/0 conn(0x7f9b44006ef0 0x7f9b44033b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.467+0000 7f9b54400640 1 --2- 172.21.15.81:0/327293493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 0x7f9b440369e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.467+0000 7f9b54400640 1 -- 172.21.15.81:0/327293493 >> 172.21.15.81:0/327293493 conn(0x7f9b4401d790 msgr2=0x7f9b44054580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.467+0000 7f01aa800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a406cb50 0x7f01a415ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01aa800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a40ccc80 0x7f01a40c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01aa800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01a415d390 0x7f01a40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f2771400640 1 -- 172.21.15.81:0/3532144001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f277415db50 msgr2=0x7f27740c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f2771400640 1 --2- 172.21.15.81:0/3532144001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f277415db50 0x7f27740c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f2771400640 1 -- 172.21.15.81:0/3532144001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27740b1070 msgr2=0x7f27740b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f2771400640 1 --2- 172.21.15.81:0/3532144001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27740b1070 0x7f27740b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f2771400640 1 -- 172.21.15.81:0/3532144001 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27740c7cd0 con 0x7f27740d1fb0 2024-09-10T20:39:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01aa800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01a4162b30 con 0x7f01a406cb50 2024-09-10T20:39:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01aa800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f01a41629b0 con 0x7f01a415d390 2024-09-10T20:39:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01aa800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f01a4162cb0 con 0x7f01a40ccc80 2024-09-10T20:39:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01a9e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01a415d390 0x7f01a40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01a9e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01a415d390 0x7f01a40c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:53994/0 (socket says 172.21.15.81:53994) 2024-09-10T20:39:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01a9e00640 1 -- 172.21.15.81:0/592110116 learned_addr learned my addr 172.21.15.81:0/592110116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.470+0000 7f9b54400640 1 -- 172.21.15.81:0/327293493 shutdown_connections 2024-09-10T20:39:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f2771400640 1 --2- 172.21.15.81:0/3532144001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27740d1fb0 0x7f27740d0400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2760009850 tx=0x7f2760003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.470+0000 7f276a000640 1 -- 172.21.15.81:0/3532144001 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276003f070 con 0x7f27740d1fb0 2024-09-10T20:39:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.470+0000 7f276a000640 1 -- 172.21.15.81:0/3532144001 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2760004890 con 0x7f27740d1fb0 2024-09-10T20:39:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.470+0000 7f276a000640 1 -- 172.21.15.81:0/3532144001 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760035030 con 0x7f27740d1fb0 2024-09-10T20:39:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f06a7e00640 1 -- 172.21.15.81:0/2075407270 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f06a8012b40 con 0x7f06b4154110 2024-09-10T20:39:27.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.468+0000 7f01a8a00640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a40ccc80 0x7f01a40c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f01a9400640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a406cb50 0x7f01a415ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f01a9e00640 1 -- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a40ccc80 msgr2=0x7f01a40c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f01a9e00640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a40ccc80 0x7f01a40c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f01a9e00640 1 -- 172.21.15.81:0/592110116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a406cb50 msgr2=0x7f01a415ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f01a9e00640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a406cb50 0x7f01a415ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f01a9e00640 1 -- 172.21.15.81:0/592110116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a40b6610 con 0x7f01a415d390 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.469+0000 7f01a9400640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a406cb50 0x7f01a415ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.470+0000 7f01a9e00640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01a415d390 0x7f01a40c9b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0198009850 tx=0x7f0198004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.470+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27740c89a0 con 0x7f27740d1fb0 2024-09-10T20:39:27.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.471+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27740c7fb0 con 0x7f27740d1fb0 2024-09-10T20:39:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.471+0000 7f01a1600640 1 -- 172.21.15.81:0/592110116 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198050070 con 0x7f01a415d390 2024-09-10T20:39:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.471+0000 7f7578c00640 1 -- 172.21.15.81:0/3337417624 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f7570012a80 con 0x7f757c154110 2024-09-10T20:39:27.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.470+0000 7f9b54400640 1 -- 172.21.15.81:0/327293493 wait complete. 2024-09-10T20:39:27.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.472+0000 7f01a1600640 1 -- 172.21.15.81:0/592110116 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01980038f0 con 0x7f01a415d390 2024-09-10T20:39:27.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.472+0000 7f01a1600640 1 -- 172.21.15.81:0/592110116 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198046020 con 0x7f01a415d390 2024-09-10T20:39:27.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.471+0000 7f276a000640 1 -- 172.21.15.81:0/3532144001 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2760004ca0 con 0x7f27740d1fb0 2024-09-10T20:39:27.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.471+0000 7f276a000640 1 -- 172.21.15.81:0/3532144001 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2760044450 con 0x7f27740d1fb0 2024-09-10T20:39:27.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.474+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a415cc90 con 0x7f01a415d390 2024-09-10T20:39:27.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.474+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a40b62c0 con 0x7f01a415d390 2024-09-10T20:39:27.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.475+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c154110 msgr2=0x7f757c157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.475+0000 7f7583600640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c154110 0x7f757c157210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f757000c7d0 tx=0x7f757000cc90 comp rx=0 tx=0).stop 2024-09-10T20:39:27.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.476+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 shutdown_connections 2024-09-10T20:39:27.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.476+0000 7f7583600640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f757c154110 0x7f757c157210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.476+0000 7f7583600640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0cc220 0x7f757c0b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.476+0000 7f7583600640 1 --2- 172.21.15.81:0/3337417624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f757c0c9f60 0x7f757c1f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.476+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 >> 172.21.15.81:0/3337417624 conn(0x7f757c0b1380 msgr2=0x7f757c14fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.477+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 shutdown_connections 2024-09-10T20:39:27.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.477+0000 7f7583600640 1 -- 172.21.15.81:0/3337417624 wait complete. 2024-09-10T20:39:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.477+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a406d220 con 0x7f01a415d390 2024-09-10T20:39:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.478+0000 7f01a1600640 1 -- 172.21.15.81:0/592110116 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f019804c460 con 0x7f01a415d390 2024-09-10T20:39:27.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.477+0000 7f9b54400640 1 Processor -- start 2024-09-10T20:39:27.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.478+0000 7f01a1600640 1 -- 172.21.15.81:0/592110116 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0198055790 con 0x7f01a415d390 2024-09-10T20:39:27.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.478+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27740b1520 con 0x7f27740d1fb0 2024-09-10T20:39:27.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.479+0000 7f9b54400640 1 -- start start 2024-09-10T20:39:27.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.481+0000 7f9b54400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b44006ef0 0x7f9b44176290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.482+0000 7f9b54400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b44034080 0x7f9b440d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.478+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f9c70005580 con 0x7f9c94161810 2024-09-10T20:39:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.483+0000 7f9b51a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b44006ef0 0x7f9b44176290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.483+0000 7f9b51a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b44006ef0 0x7f9b44176290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37028/0 (socket says 172.21.15.81:37028) 2024-09-10T20:39:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.483+0000 7f9b51a00640 1 -- 172.21.15.81:0/875601377 learned_addr learned my addr 172.21.15.81:0/875601377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.483+0000 7f9b54400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 0x7f9b44006130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.483+0000 7f01a1600640 1 -- 172.21.15.81:0/592110116 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0198005220 con 0x7f01a415d390 2024-09-10T20:39:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.484+0000 7f9b52400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 0x7f9b44006130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.484+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44033830 con 0x7f9b44006ef0 2024-09-10T20:39:27.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.485+0000 7f9b51000640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b44034080 0x7f9b440d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.485+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9b440e23b0 con 0x7f9b44034080 2024-09-10T20:39:27.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.485+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9b44054c90 con 0x7f9b440e1fd0 2024-09-10T20:39:27.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.485+0000 7f276a000640 1 -- 172.21.15.81:0/3532144001 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f276003be20 con 0x7f27740d1fb0 2024-09-10T20:39:27.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.488+0000 7f9b52400640 1 -- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b44034080 msgr2=0x7f9b440d7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.488+0000 7f9b52400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b44034080 0x7f9b440d7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.488+0000 7f9b52400640 1 -- 172.21.15.81:0/875601377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b44006ef0 msgr2=0x7f9b44176290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.489+0000 7f6e55c00640 1 -- 172.21.15.81:0/3912824089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 msgr2=0x7f6e50072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.489+0000 7f6e55c00640 1 --2- 172.21.15.81:0/3912824089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 0x7f6e50072a70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c005fd0 tx=0x7f6e3c02a4b0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.489+0000 7f9b52400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b44006ef0 0x7f9b44176290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.489+0000 7f9b52400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b441767d0 con 0x7f9b440e1fd0 2024-09-10T20:39:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.489+0000 7f9b51a00640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b44006ef0 0x7f9b44176290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.490+0000 7f9c91600640 1 -- 172.21.15.81:0/2178939815 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f9c8c01b4c0 con 0x7f9c94161810 2024-09-10T20:39:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.491+0000 7f9b52400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 0x7f9b44006130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c066670 tx=0x7f9b4c069cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.491+0000 7f9b49600640 1 -- 172.21.15.81:0/875601377 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c075840 con 0x7f9b440e1fd0 2024-09-10T20:39:27.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.491+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b440d8d40 con 0x7f9b440e1fd0 2024-09-10T20:39:27.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.491+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b440d9300 con 0x7f9b440e1fd0 2024-09-10T20:39:27.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.492+0000 7f9b49600640 1 -- 172.21.15.81:0/875601377 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b4c075c90 con 0x7f9b440e1fd0 2024-09-10T20:39:27.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.492+0000 7f9b49600640 1 -- 172.21.15.81:0/875601377 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c075840 con 0x7f9b440e1fd0 2024-09-10T20:39:27.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.492+0000 7f9b49600640 1 -- 172.21.15.81:0/875601377 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9b4c06ece0 con 0x7f9b440e1fd0 2024-09-10T20:39:27.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.492+0000 7f9b49600640 1 -- 172.21.15.81:0/875601377 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9b4c0642a0 con 0x7f9b440e1fd0 2024-09-10T20:39:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.493+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c94161810 msgr2=0x7f9c9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.494+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c94161810 0x7f9c9406e320 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c8e0 tx=0x7f9c8c00cda0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.494+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 shutdown_connections 2024-09-10T20:39:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.495+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c94161810 0x7f9c9406e320 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.495+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9c9415c460 0x7f9c9406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.495+0000 7f9c9ae00640 1 --2- 172.21.15.81:0/2178939815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c940d4560 0x7f9c9414ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.495+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 >> 172.21.15.81:0/2178939815 conn(0x7f9c940d3a40 msgr2=0x7f9c941562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.495+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b28005290 con 0x7f9b440e1fd0 2024-09-10T20:39:27.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.495+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 shutdown_connections 2024-09-10T20:39:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.496+0000 7f9c9ae00640 1 -- 172.21.15.81:0/2178939815 wait complete. 2024-09-10T20:39:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.496+0000 7f6e55c00640 1 -- 172.21.15.81:0/3912824089 shutdown_connections 2024-09-10T20:39:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.496+0000 7f6e55c00640 1 --2- 172.21.15.81:0/3912824089 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e5006ec50 0x7f6e50072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.496+0000 7f6e55c00640 1 --2- 172.21.15.81:0/3912824089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 0x7f6e50072a70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.496+0000 7f6e55c00640 1 -- 172.21.15.81:0/3912824089 >> 172.21.15.81:0/3912824089 conn(0x7f6e5006cb50 msgr2=0x7f6e5006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.496+0000 7f6e55c00640 1 -- 172.21.15.81:0/3912824089 shutdown_connections 2024-09-10T20:39:27.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.496+0000 7f6e55c00640 1 -- 172.21.15.81:0/3912824089 wait complete. 2024-09-10T20:39:27.503 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.503 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.500+0000 7f6e55c00640 1 Processor -- start 2024-09-10T20:39:27.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.500+0000 7f9b49600640 1 -- 172.21.15.81:0/875601377 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f9b441767d0 con 0x7f9b440e1fd0 2024-09-10T20:39:27.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.500+0000 7f6e55c00640 1 -- start start 2024-09-10T20:39:27.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.502+0000 7f6e55c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 0x7f6e50167500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.502+0000 7f6e55c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e5006ec50 0x7f6e500b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.502+0000 7f6e55c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e500cf660 0x7f6e5013bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.502+0000 7f6e55c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50073990 con 0x7f6e5006e7e0 2024-09-10T20:39:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.503+0000 7f6e4f400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e5006ec50 0x7f6e500b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.503+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 0x7f6e50167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.503+0000 7f6e4fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 0x7f6e50167500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37042/0 (socket says 172.21.15.81:37042) 2024-09-10T20:39:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.503+0000 7f6e4fe00640 1 -- 172.21.15.81:0/2993739315 learned_addr learned my addr 172.21.15.81:0/2993739315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.503+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50073810 con 0x7f6e500cf660 2024-09-10T20:39:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.503+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6e50073b10 con 0x7f6e5006ec50 2024-09-10T20:39:27.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.503+0000 7f6e55200640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e500cf660 0x7f6e5013bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.504+0000 7f6e4f400640 1 -- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e500cf660 msgr2=0x7f6e5013bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.504+0000 7f6e4f400640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e500cf660 0x7f6e5013bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.504+0000 7f6e4f400640 1 -- 172.21.15.81:0/2993739315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 msgr2=0x7f6e50167500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.504+0000 7f6e4f400640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 0x7f6e50167500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.504+0000 7f6e4f400640 1 -- 172.21.15.81:0/2993739315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e500b01d0 con 0x7f6e5006ec50 2024-09-10T20:39:27.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.506+0000 7f6e4f400640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e5006ec50 0x7f6e500b0cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c031000 tx=0x7f6e3c005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.506+0000 7f6e47e00640 1 -- 172.21.15.81:0/2993739315 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c03f070 con 0x7f6e5006ec50 2024-09-10T20:39:27.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.506+0000 7f6e47e00640 1 -- 172.21.15.81:0/2993739315 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e3c0047a0 con 0x7f6e5006ec50 2024-09-10T20:39:27.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.506+0000 7f6e47e00640 1 -- 172.21.15.81:0/2993739315 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c035030 con 0x7f6e5006ec50 2024-09-10T20:39:27.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.507+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e50166a20 con 0x7f6e5006ec50 2024-09-10T20:39:27.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.507+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e50167a40 con 0x7f6e5006ec50 2024-09-10T20:39:27.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.508+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e28005290 con 0x7f6e5006ec50 2024-09-10T20:39:27.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.511+0000 7f6e47e00640 1 -- 172.21.15.81:0/2993739315 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f6e3c004bb0 con 0x7f6e5006ec50 2024-09-10T20:39:27.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.511+0000 7f6e47e00640 1 -- 172.21.15.81:0/2993739315 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e3c04ec00 con 0x7f6e5006ec50 2024-09-10T20:39:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.513+0000 7f6e47e00640 1 -- 172.21.15.81:0/2993739315 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f6e3c004ed0 con 0x7f6e5006ec50 2024-09-10T20:39:27.542 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.542 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.548+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fbc84155ac0 con 0x7fbc840d45f0 2024-09-10T20:39:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.551+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fe848155390 con 0x7fe848161810 2024-09-10T20:39:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.551+0000 7fbc7aa00640 1 -- 172.21.15.81:0/1355348489 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7fbc7c059430 con 0x7fbc840d45f0 2024-09-10T20:39:27.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc840d45f0 msgr2=0x7fbc84157930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc840d45f0 0x7fbc84157930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c03a000 tx=0x7fbc7c039570 comp rx=0 tx=0).stop 2024-09-10T20:39:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 shutdown_connections 2024-09-10T20:39:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbc8415a6b0 0x7fbc84153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbc8415dcc0 0x7fbc84153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 --2- 172.21.15.81:0/1355348489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc840d45f0 0x7fbc84157930 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 >> 172.21.15.81:0/1355348489 conn(0x7fbc840d3a40 msgr2=0x7fbc840ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.553+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 shutdown_connections 2024-09-10T20:39:27.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.554+0000 7fbc83e00640 1 -- 172.21.15.81:0/1355348489 wait complete. 2024-09-10T20:39:27.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.563+0000 7fe83fe00640 1 -- 172.21.15.81:0/3326286175 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7fe84001d940 con 0x7fe848161810 2024-09-10T20:39:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.568+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe848161810 msgr2=0x7fe8481533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.568+0000 7fe84d600640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe848161810 0x7fe8481533c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe84000be00 tx=0x7fe84000bef0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.569+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 shutdown_connections 2024-09-10T20:39:27.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.569+0000 7fe84d600640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe848161810 0x7fe8481533c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.569+0000 7fe84d600640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe8480d4560 0x7fe8481f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.569+0000 7fe84d600640 1 --2- 172.21.15.81:0/3326286175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8480cea90 0x7fe8480c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.569+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 >> 172.21.15.81:0/3326286175 conn(0x7fe8480d3a40 msgr2=0x7fe8480d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.573+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 shutdown_connections 2024-09-10T20:39:27.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.573+0000 7fe84d600640 1 -- 172.21.15.81:0/3326286175 wait complete. 2024-09-10T20:39:27.607 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.603+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f88680ce8b0 con 0x7f886806fb70 2024-09-10T20:39:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.609+0000 7f885f400640 1 -- 172.21.15.81:0/1266375496 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f8858017020 con 0x7f886806fb70 2024-09-10T20:39:27.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886806fb70 msgr2=0x7f88680ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886806fb70 0x7f88680ccf00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8858005fd0 tx=0x7f885800dde0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 shutdown_connections 2024-09-10T20:39:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f886816b060 0x7f886816caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f88680aed80 0x7f886816c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 --2- 172.21.15.81:0/1266375496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f886806fb70 0x7f88680ccf00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 >> 172.21.15.81:0/1266375496 conn(0x7f886806cb50 msgr2=0x7f886806cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 shutdown_connections 2024-09-10T20:39:27.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.612+0000 7f886ce00640 1 -- 172.21.15.81:0/1266375496 wait complete. 2024-09-10T20:39:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.626+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f06b40aed60 con 0x7f06b4154110 2024-09-10T20:39:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.629+0000 7f06a7e00640 1 -- 172.21.15.81:0/2075407270 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v15)=0 v15) ==== 119+0+0 (secure 0 0 0) 0x7f06a8012d20 con 0x7f06b4154110 2024-09-10T20:39:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06b4154110 msgr2=0x7f06b40b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06b4154110 0x7f06b40b2680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06a800c760 tx=0x7f06a800cc20 comp rx=0 tx=0).stop 2024-09-10T20:39:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 shutdown_connections 2024-09-10T20:39:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06b4154110 0x7f06b40b2680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06b40cc220 0x7f06b40ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 --2- 172.21.15.81:0/2075407270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06b40c9f60 0x7f06b40b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 >> 172.21.15.81:0/2075407270 conn(0x7f06b40b1380 msgr2=0x7f06b415bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.631+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 shutdown_connections 2024-09-10T20:39:27.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.632+0000 7f06bb000640 1 -- 172.21.15.81:0/2075407270 wait complete. 2024-09-10T20:39:27.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.637+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f01a40c8210 con 0x7f01a415d390 2024-09-10T20:39:27.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.643+0000 7f01a1600640 1 -- 172.21.15.81:0/592110116 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7f0198003d20 con 0x7f01a415d390 2024-09-10T20:39:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01a415d390 msgr2=0x7f01a40c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01a415d390 0x7f01a40c9b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0198009850 tx=0x7f0198004dc0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 shutdown_connections 2024-09-10T20:39:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01a415d390 0x7f01a40c9b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01a40ccc80 0x7f01a40c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 --2- 172.21.15.81:0/592110116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01a406cb50 0x7f01a415ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 >> 172.21.15.81:0/592110116 conn(0x7f01a40b2280 msgr2=0x7f01a40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.645+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 shutdown_connections 2024-09-10T20:39:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.646+0000 7f01aa800640 1 -- 172.21.15.81:0/592110116 wait complete. 2024-09-10T20:39:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.647+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6e28005580 con 0x7f6e5006ec50 2024-09-10T20:39:27.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.653 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.651+0000 7f6e47e00640 1 -- 172.21.15.81:0/2993739315 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f6e3c0050b0 con 0x7f6e5006ec50 2024-09-10T20:39:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e5006ec50 msgr2=0x7f6e500b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e5006ec50 0x7f6e500b0cd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c031000 tx=0x7f6e3c005780 comp rx=0 tx=0).stop 2024-09-10T20:39:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 shutdown_connections 2024-09-10T20:39:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e500cf660 0x7f6e5013bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e5006ec50 0x7f6e500b0cd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 --2- 172.21.15.81:0/2993739315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5006e7e0 0x7f6e50167500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 >> 172.21.15.81:0/2993739315 conn(0x7f6e5006cb50 msgr2=0x7f6e50143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 shutdown_connections 2024-09-10T20:39:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.652+0000 7f6e55c00640 1 -- 172.21.15.81:0/2993739315 wait complete. 2024-09-10T20:39:27.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.663+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f2774074ff0 con 0x7f27740d1fb0 2024-09-10T20:39:27.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.668+0000 7f276a000640 1 -- 172.21.15.81:0/3532144001 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v18)=0 v18) ==== 125+0+0 (secure 0 0 0) 0x7f276003b460 con 0x7f27740d1fb0 2024-09-10T20:39:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.669+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27740d1fb0 msgr2=0x7f27740d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.669+0000 7f2779200640 1 --2- 172.21.15.81:0/3532144001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27740d1fb0 0x7f27740d0400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2760009850 tx=0x7f2760003960 comp rx=0 tx=0).stop 2024-09-10T20:39:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.669+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 shutdown_connections 2024-09-10T20:39:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.669+0000 7f2779200640 1 --2- 172.21.15.81:0/3532144001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f277415db50 0x7f27740c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.669+0000 7f2779200640 1 --2- 172.21.15.81:0/3532144001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f27740d1fb0 0x7f27740d0400 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.669+0000 7f2779200640 1 --2- 172.21.15.81:0/3532144001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27740b1070 0x7f27740b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.669+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 >> 172.21.15.81:0/3532144001 conn(0x7f27740d3a60 msgr2=0x7f27740ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.670+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 shutdown_connections 2024-09-10T20:39:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.670+0000 7f2779200640 1 -- 172.21.15.81:0/3532144001 wait complete. 2024-09-10T20:39:27.675 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.675 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.671+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9b28005850 con 0x7f9b440e1fd0 2024-09-10T20:39:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.675+0000 7f9b49600640 1 -- 172.21.15.81:0/875601377 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f9b4c06a410 con 0x7f9b440e1fd0 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 msgr2=0x7f9b44006130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 0x7f9b44006130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c066670 tx=0x7f9b4c069cc0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 shutdown_connections 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b440e1fd0 0x7f9b44006130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b44034080 0x7f9b440d7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 --2- 172.21.15.81:0/875601377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b44006ef0 0x7f9b44176290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 >> 172.21.15.81:0/875601377 conn(0x7f9b4401d790 msgr2=0x7f9b4400ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 shutdown_connections 2024-09-10T20:39:27.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.676+0000 7f9b54400640 1 -- 172.21.15.81:0/875601377 wait complete. 2024-09-10T20:39:27.695 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.695 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-10T20:39:27.695 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T20:39:27.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T20:39:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 -- 172.21.15.81:0/1724734429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc15da80 msgr2=0x7f7bfc161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 --2- 172.21.15.81:0/1724734429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc15da80 0x7f7bfc161610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0d3170 tx=0x7f7bf002a560 comp rx=0 tx=0).stop 2024-09-10T20:39:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 -- 172.21.15.81:0/1724734429 shutdown_connections 2024-09-10T20:39:27.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 --2- 172.21.15.81:0/1724734429 >> v2:172.21.15.143:3300/0 conn(0x7f7bfc0b0aa0 0x7f7bfc0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 --2- 172.21.15.81:0/1724734429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bfc161b50 0x7f7bfc161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 --2- 172.21.15.81:0/1724734429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc15da80 0x7f7bfc161610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 -- 172.21.15.81:0/1724734429 >> 172.21.15.81:0/1724734429 conn(0x7f7bfc0d3a20 msgr2=0x7f7bfc0d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 -- 172.21.15.81:0/1724734429 shutdown_connections 2024-09-10T20:39:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.884+0000 7f7c02e00640 1 -- 172.21.15.81:0/1724734429 wait complete. 2024-09-10T20:39:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.885+0000 7f7c02e00640 1 Processor -- start 2024-09-10T20:39:27.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.885+0000 7f7c02e00640 1 -- start start 2024-09-10T20:39:27.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.886+0000 7f7c02e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bfc0b0aa0 0x7f7bfc160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.886+0000 7f7c02e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bfc15da80 0x7f7bfc157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.886+0000 7f7c02e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc161b50 0x7f7bfc1f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:27.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.886+0000 7f7c02e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0b17d0 con 0x7f7bfc161b50 2024-09-10T20:39:27.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.886+0000 7f7c02e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0b1650 con 0x7f7bfc15da80 2024-09-10T20:39:27.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.886+0000 7f7c02e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc0b1950 con 0x7f7bfc0b0aa0 2024-09-10T20:39:27.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc161b50 0x7f7bfc1f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc161b50 0x7f7bfc1f73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37054/0 (socket says 172.21.15.81:37054) 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 -- 172.21.15.81:0/3417359077 learned_addr learned my addr 172.21.15.81:0/3417359077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c01a00640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bfc0b0aa0 0x7f7bfc160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c01000640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bfc15da80 0x7f7bfc157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 -- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bfc0b0aa0 msgr2=0x7f7bfc160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bfc0b0aa0 0x7f7bfc160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 -- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bfc15da80 msgr2=0x7f7bfc157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bfc15da80 0x7f7bfc157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 -- 172.21.15.81:0/3417359077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc160b30 con 0x7f7bfc161b50 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.887+0000 7f7c02400640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc161b50 0x7f7bfc1f73f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e980 tx=0x7f7bf400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.888+0000 7f7bf9600640 1 -- 172.21.15.81:0/3417359077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4004d20 con 0x7f7bfc161b50 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.888+0000 7f7bf9600640 1 -- 172.21.15.81:0/3417359077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bf400cb20 con 0x7f7bfc161b50 2024-09-10T20:39:27.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.888+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc0cc9e0 con 0x7f7bfc161b50 2024-09-10T20:39:27.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.888+0000 7f7bf9600640 1 -- 172.21.15.81:0/3417359077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4005020 con 0x7f7bfc161b50 2024-09-10T20:39:27.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.888+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc158310 con 0x7f7bfc161b50 2024-09-10T20:39:27.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.888+0000 7f7bf9600640 1 -- 172.21.15.81:0/3417359077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f7bf400f040 con 0x7f7bfc161b50 2024-09-10T20:39:27.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.888+0000 7f7bf9600640 1 -- 172.21.15.81:0/3417359077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7bf40118c0 con 0x7f7bfc161b50 2024-09-10T20:39:27.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.889+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bfc161610 con 0x7f7bfc161b50 2024-09-10T20:39:27.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.893+0000 7f7bf9600640 1 -- 172.21.15.81:0/3417359077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f7bf4016030 con 0x7f7bfc161b50 2024-09-10T20:39:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.960+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7bfc075750 con 0x7f7bfc161b50 2024-09-10T20:39:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.963+0000 7f7bf9600640 1 -- 172.21.15.81:0/3417359077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f7bf4011ac0 con 0x7f7bfc161b50 2024-09-10T20:39:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc161b50 msgr2=0x7f7bfc1f73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc161b50 0x7f7bfc1f73f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e980 tx=0x7f7bf400ee40 comp rx=0 tx=0).stop 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 shutdown_connections 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bfc161b50 0x7f7bfc1f73f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7bfc15da80 0x7f7bfc157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 --2- 172.21.15.81:0/3417359077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7bfc0b0aa0 0x7f7bfc160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 >> 172.21.15.81:0/3417359077 conn(0x7f7bfc0d3a20 msgr2=0x7f7bfc0d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 shutdown_connections 2024-09-10T20:39:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:27.964+0000 7f7c02e00640 1 -- 172.21.15.81:0/3417359077 wait complete. 2024-09-10T20:39:27.982 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T20:39:27.982 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T20:39:27.982 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:27.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T20:39:28.038 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:28.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T20:39:28.132 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:28.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T20:39:28.228 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:39:28.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T20:39:28.324 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:28.324 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T20:39:28.380 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:28.380 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T20:39:28.475 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:28.475 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T20:39:28.571 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:39:28.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T20:39:28.669 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 19c30155-6b91-4056-b040-1a86a4664e88 0 2024-09-10T20:39:28.863 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.859+0000 7fa924200640 1 -- 172.21.15.143:0/1244073511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 msgr2=0x7fa91c0d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:28.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.859+0000 7fa924200640 1 --2- 172.21.15.143:0/1244073511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 0x7fa91c0d2680 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa914005fd0 tx=0x7fa91402a8b0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.860+0000 7fa924200640 1 -- 172.21.15.143:0/1244073511 shutdown_connections 2024-09-10T20:39:28.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.860+0000 7fa924200640 1 --2- 172.21.15.143:0/1244073511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 0x7fa91c0d2680 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.860+0000 7fa924200640 1 --2- 172.21.15.143:0/1244073511 >> v2:172.21.15.81:3300/0 conn(0x7fa91c15ddb0 0x7fa91c0d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.860+0000 7fa924200640 1 -- 172.21.15.143:0/1244073511 >> 172.21.15.143:0/1244073511 conn(0x7fa91c0d3c30 msgr2=0x7fa91c0d4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:28.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.860+0000 7fa924200640 1 -- 172.21.15.143:0/1244073511 shutdown_connections 2024-09-10T20:39:28.864 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.860+0000 7fa924200640 1 -- 172.21.15.143:0/1244073511 wait complete. 2024-09-10T20:39:28.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.861+0000 7fa924200640 1 Processor -- start 2024-09-10T20:39:28.865 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.862+0000 7fa924200640 1 -- start start 2024-09-10T20:39:28.866 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.862+0000 7fa924200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa91c0d10b0 0x7fa91c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.862+0000 7fa924200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 0x7fa91c0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa924200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa91c15ddb0 0x7fa91c1f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa924200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c0b6c00 con 0x7fa91c0d10b0 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa924200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c0b6a80 con 0x7fa91c15ddb0 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa924200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa91c0b6d80 con 0x7fa91c0d21f0 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa91c15ddb0 0x7fa91c1f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa920e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 0x7fa91c0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa91c15ddb0 0x7fa91c1f7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45572/0 (socket says 172.21.15.143:45572) 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 -- 172.21.15.143:0/1818156826 learned_addr learned my addr 172.21.15.143:0/1818156826 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa921800640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa91c0d10b0 0x7fa91c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 -- 172.21.15.143:0/1818156826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 msgr2=0x7fa91c0cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 0x7fa91c0cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 -- 172.21.15.143:0/1818156826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa91c0d10b0 msgr2=0x7fa91c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:28.867 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa91c0d10b0 0x7fa91c0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.868 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.863+0000 7fa922200640 1 -- 172.21.15.143:0/1818156826 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c1f7610 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa922200640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa91c15ddb0 0x7fa91c1f7880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa914009b30 tx=0x7fa9140316e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa919600640 1 -- 172.21.15.143:0/1818156826 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914040070 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa919600640 1 -- 172.21.15.143:0/1818156826 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa914004040 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91c0cca60 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa919600640 1 -- 172.21.15.143:0/1818156826 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914004450 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91c0cd020 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa919600640 1 -- 172.21.15.143:0/1818156826 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa91404d030 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.864+0000 7fa919600640 1 -- 172.21.15.143:0/1818156826 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa914045c30 con 0x7fa91c15ddb0 2024-09-10T20:39:28.869 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.865+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91c0b9bb0 con 0x7fa91c15ddb0 2024-09-10T20:39:28.870 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.867+0000 7fa919600640 1 -- 172.21.15.143:0/1818156826 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fa9140045f0 con 0x7fa91c15ddb0 2024-09-10T20:39:28.944 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.941+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19c30155-6b91-4056-b040-1a86a4664e88", "id": 0} v 0) -- 0x7fa91c0d2680 con 0x7fa91c15ddb0 2024-09-10T20:39:28.948 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.945+0000 7fa919600640 1 -- 172.21.15.143:0/1818156826 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19c30155-6b91-4056-b040-1a86a4664e88", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa9140047d0 con 0x7fa91c15ddb0 2024-09-10T20:39:28.948 INFO:teuthology.orchestra.run.smithi143.stdout:0 2024-09-10T20:39:28.949 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa91c15ddb0 msgr2=0x7fa91c1f7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa91c15ddb0 0x7fa91c1f7880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa914009b30 tx=0x7fa9140316e0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 shutdown_connections 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa91c15ddb0 0x7fa91c1f7880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa91c0d21f0 0x7fa91c0cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 --2- 172.21.15.143:0/1818156826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa91c0d10b0 0x7fa91c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 >> 172.21.15.143:0/1818156826 conn(0x7fa91c0d3c30 msgr2=0x7fa91c0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 shutdown_connections 2024-09-10T20:39:28.950 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:28.946+0000 7fa924200640 1 -- 172.21.15.143:0/1818156826 wait complete. 2024-09-10T20:39:28.964 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 89867ff2-a374-4c4b-a833-3ec4923b4e03 1 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 -- 172.21.15.143:0/2465224721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc015da80 msgr2=0x7fccc0161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 --2- 172.21.15.143:0/2465224721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc015da80 0x7fccc0161610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fccb0005fd0 tx=0x7fccb002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 -- 172.21.15.143:0/2465224721 shutdown_connections 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 --2- 172.21.15.143:0/2465224721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc0161b50 0x7fccc0161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 --2- 172.21.15.143:0/2465224721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc015da80 0x7fccc0161610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 -- 172.21.15.143:0/2465224721 >> 172.21.15.143:0/2465224721 conn(0x7fccc00d3a20 msgr2=0x7fccc00d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 -- 172.21.15.143:0/2465224721 shutdown_connections 2024-09-10T20:39:29.118 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.114+0000 7fccbfe00640 1 -- 172.21.15.143:0/2465224721 wait complete. 2024-09-10T20:39:29.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.115+0000 7fccbfe00640 1 Processor -- start 2024-09-10T20:39:29.119 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.115+0000 7fccbfe00640 1 -- start start 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.116+0000 7fccbfe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc00b0aa0 0x7fccc01f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.116+0000 7fccbfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc015da80 0x7fccc00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.116+0000 7fccbfe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc0161b50 0x7fccc015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.116+0000 7fccbfe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fccc00cf980 con 0x7fccc015da80 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.116+0000 7fccbfe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fccc00cf800 con 0x7fccc0161b50 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.116+0000 7fccbfe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fccc00b1610 con 0x7fccc00b0aa0 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc00b0aa0 0x7fccc01f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbf400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc0161b50 0x7fccc015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.122 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc00b0aa0 0x7fccc01f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:56574/0 (socket says 172.21.15.143:56574) 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 -- 172.21.15.143:0/178574547 learned_addr learned my addr 172.21.15.143:0/178574547 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbe000640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc015da80 0x7fccc00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 -- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc0161b50 msgr2=0x7fccc015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc0161b50 0x7fccc015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 -- 172.21.15.143:0/178574547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc015da80 msgr2=0x7fccc00c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc015da80 0x7fccc00c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 -- 172.21.15.143:0/178574547 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc01f4980 con 0x7fccc00b0aa0 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbf400640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc0161b50 0x7fccc015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.117+0000 7fccbea00640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc00b0aa0 0x7fccc01f4330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fccb0000c00 tx=0x7fccb0003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.118+0000 7fccb6a00640 1 -- 172.21.15.143:0/178574547 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb003f070 con 0x7fccc00b0aa0 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.118+0000 7fccb6a00640 1 -- 172.21.15.143:0/178574547 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccb0005600 con 0x7fccc00b0aa0 2024-09-10T20:39:29.123 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.118+0000 7fccb6a00640 1 -- 172.21.15.143:0/178574547 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0035030 con 0x7fccc00b0aa0 2024-09-10T20:39:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.118+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc01f4c60 con 0x7fccc00b0aa0 2024-09-10T20:39:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.118+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc01f5220 con 0x7fccc00b0aa0 2024-09-10T20:39:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.118+0000 7fccb6a00640 1 -- 172.21.15.143:0/178574547 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fccb0004a00 con 0x7fccc00b0aa0 2024-09-10T20:39:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.118+0000 7fccb6a00640 1 -- 172.21.15.143:0/178574547 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fccb003bbc0 con 0x7fccc00b0aa0 2024-09-10T20:39:29.124 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.119+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc00b1b40 con 0x7fccc00b0aa0 2024-09-10T20:39:29.126 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.123+0000 7fccb6a00640 1 -- 172.21.15.143:0/178574547 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fccb003bdc0 con 0x7fccc00b0aa0 2024-09-10T20:39:29.201 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.197+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "89867ff2-a374-4c4b-a833-3ec4923b4e03", "id": 1} v 0) -- 0x7fccc015d280 con 0x7fccc00b0aa0 2024-09-10T20:39:29.206 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.202+0000 7fccb6a00640 1 -- 172.21.15.143:0/178574547 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89867ff2-a374-4c4b-a833-3ec4923b4e03", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fccb0004eb0 con 0x7fccc00b0aa0 2024-09-10T20:39:29.206 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc00b0aa0 msgr2=0x7fccc01f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc00b0aa0 0x7fccc01f4330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fccb0000c00 tx=0x7fccb0003820 comp rx=0 tx=0).stop 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 shutdown_connections 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccc0161b50 0x7fccc015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc015da80 0x7fccc00c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 --2- 172.21.15.143:0/178574547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccc00b0aa0 0x7fccc01f4330 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 >> 172.21.15.143:0/178574547 conn(0x7fccc00d3a20 msgr2=0x7fccc00b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.207 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.203+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 shutdown_connections 2024-09-10T20:39:29.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.204+0000 7fccbfe00640 1 -- 172.21.15.143:0/178574547 wait complete. 2024-09-10T20:39:29.222 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 83c8e5d3-77de-4127-a9fa-0708ae29bd1e 2 2024-09-10T20:39:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 -- 172.21.15.143:0/3529191940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f88160ec0 msgr2=0x7f0f880ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 --2- 172.21.15.143:0/3529191940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f88160ec0 0x7f0f880ce740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009830 tx=0x7f0f7802a480 comp rx=0 tx=0).stop 2024-09-10T20:39:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 -- 172.21.15.143:0/3529191940 shutdown_connections 2024-09-10T20:39:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 --2- 172.21.15.143:0/3529191940 >> v2:172.21.15.81:3300/0 conn(0x7f0f880cec80 0x7f0f880cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 --2- 172.21.15.143:0/3529191940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f88160ec0 0x7f0f880ce740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 -- 172.21.15.143:0/3529191940 >> 172.21.15.143:0/3529191940 conn(0x7f0f880d3aa0 msgr2=0x7f0f880d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.377 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 -- 172.21.15.143:0/3529191940 shutdown_connections 2024-09-10T20:39:29.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.373+0000 7f0f8d600640 1 -- 172.21.15.143:0/3529191940 wait complete. 2024-09-10T20:39:29.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.374+0000 7f0f8d600640 1 Processor -- start 2024-09-10T20:39:29.378 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.375+0000 7f0f8d600640 1 -- start start 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.375+0000 7f0f8d600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f880cec80 0x7f0f8815f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.375+0000 7f0f8d600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f88160ec0 0x7f0f880c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.375+0000 7f0f8d600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f88161620 0x7f0f88154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.375+0000 7f0f8d600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d48c0 con 0x7f0f88160ec0 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.375+0000 7f0f8d600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d2200 con 0x7f0f88161620 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.375+0000 7f0f8d600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880b1d50 con 0x7f0f880cec80 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f880cec80 0x7f0f8815f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.381 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f880cec80 0x7f0f8815f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:56592/0 (socket says 172.21.15.143:56592) 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f8cc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f88161620 0x7f0f88154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 -- 172.21.15.143:0/1336974186 learned_addr learned my addr 172.21.15.143:0/1336974186 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f7f400640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f88160ec0 0x7f0f880c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 -- 172.21.15.143:0/1336974186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f88161620 msgr2=0x7f0f88154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f88161620 0x7f0f88154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 -- 172.21.15.143:0/1336974186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f88160ec0 msgr2=0x7f0f880c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f88160ec0 0x7f0f880c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f87e00640 1 -- 172.21.15.143:0/1336974186 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f881f53a0 con 0x7f0f880cec80 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.376+0000 7f0f7f400640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f88160ec0 0x7f0f880c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f87e00640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f880cec80 0x7f0f8815f8c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f78000c00 tx=0x7f0f78032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f84c00640 1 -- 172.21.15.143:0/1336974186 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78040070 con 0x7f0f880cec80 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f84c00640 1 -- 172.21.15.143:0/1336974186 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f780038e0 con 0x7f0f880cec80 2024-09-10T20:39:29.382 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8815eb00 con 0x7f0f880cec80 2024-09-10T20:39:29.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f84c00640 1 -- 172.21.15.143:0/1336974186 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78003d30 con 0x7f0f880cec80 2024-09-10T20:39:29.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8815f3a0 con 0x7f0f880cec80 2024-09-10T20:39:29.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f84c00640 1 -- 172.21.15.143:0/1336974186 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0f7804d030 con 0x7f0f880cec80 2024-09-10T20:39:29.383 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.377+0000 7f0f84c00640 1 -- 172.21.15.143:0/1336974186 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f0f78045a90 con 0x7f0f880cec80 2024-09-10T20:39:29.384 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.378+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8815eef0 con 0x7f0f880cec80 2024-09-10T20:39:29.385 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.382+0000 7f0f84c00640 1 -- 172.21.15.143:0/1336974186 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0f78045670 con 0x7f0f880cec80 2024-09-10T20:39:29.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.455+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83c8e5d3-77de-4127-a9fa-0708ae29bd1e", "id": 2} v 0) -- 0x7f0f880cf0c0 con 0x7f0f880cec80 2024-09-10T20:39:29.463 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.460+0000 7f0f84c00640 1 -- 172.21.15.143:0/1336974186 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83c8e5d3-77de-4127-a9fa-0708ae29bd1e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f0f78031770 con 0x7f0f880cec80 2024-09-10T20:39:29.463 INFO:teuthology.orchestra.run.smithi143.stdout:2 2024-09-10T20:39:29.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f880cec80 msgr2=0x7f0f8815f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f880cec80 0x7f0f8815f8c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f78000c00 tx=0x7f0f78032c10 comp rx=0 tx=0).stop 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 shutdown_connections 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f88161620 0x7f0f88154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f88160ec0 0x7f0f880c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 --2- 172.21.15.143:0/1336974186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f880cec80 0x7f0f8815f8c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 >> 172.21.15.143:0/1336974186 conn(0x7f0f880d3aa0 msgr2=0x7f0f880d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 shutdown_connections 2024-09-10T20:39:29.465 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.461+0000 7f0f8d600640 1 -- 172.21.15.143:0/1336974186 wait complete. 2024-09-10T20:39:29.479 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 3fa9706d-3b77-4f7a-983e-8ba2994b58fc 3 2024-09-10T20:39:29.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 -- 172.21.15.143:0/4050056931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf290 msgr2=0x7f47641615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 --2- 172.21.15.143:0/4050056931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf290 0x7f47641615d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f47640d3490 tx=0x7f475002a560 comp rx=0 tx=0).stop 2024-09-10T20:39:29.635 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 -- 172.21.15.143:0/4050056931 shutdown_connections 2024-09-10T20:39:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 --2- 172.21.15.143:0/4050056931 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf290 0x7f47641615d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 --2- 172.21.15.143:0/4050056931 >> v2:172.21.15.81:3300/0 conn(0x7f47640cf6f0 0x7f4764161b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 --2- 172.21.15.143:0/4050056931 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f476415db80 0x7f47640d4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 -- 172.21.15.143:0/4050056931 >> 172.21.15.143:0/4050056931 conn(0x7f47640d3a00 msgr2=0x7f47640d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 -- 172.21.15.143:0/4050056931 shutdown_connections 2024-09-10T20:39:29.636 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.631+0000 7f4763200640 1 -- 172.21.15.143:0/4050056931 wait complete. 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.632+0000 7f4763200640 1 Processor -- start 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.633+0000 7f4763200640 1 -- start start 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.633+0000 7f4763200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47640cf290 0x7f47641f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4763200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf6f0 0x7f47640caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4763200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476415db80 0x7f47640cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4763200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47640b6850 con 0x7f476415db80 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4763200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f47640d0dd0 con 0x7f47640cf6f0 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4763200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f47640b69d0 con 0x7f47640cf290 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf6f0 0x7f47640caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.638 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf6f0 0x7f47640caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45618/0 (socket says 172.21.15.143:45618) 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 -- 172.21.15.143:0/3782809189 learned_addr learned my addr 172.21.15.143:0/3782809189 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761e00640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47640cf290 0x7f47641f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4762800640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476415db80 0x7f47640cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 -- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47640cf290 msgr2=0x7f47641f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47640cf290 0x7f47641f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 -- 172.21.15.143:0/3782809189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476415db80 msgr2=0x7f47640cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476415db80 0x7f47640cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.634+0000 7f4761400640 1 -- 172.21.15.143:0/3782809189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47641f4490 con 0x7f47640cf6f0 2024-09-10T20:39:29.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f4761400640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf6f0 0x7f47640caad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47500099c0 tx=0x7f47500038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:29.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f475a000640 1 -- 172.21.15.143:0/3782809189 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475003f070 con 0x7f47640cf6f0 2024-09-10T20:39:29.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f475a000640 1 -- 172.21.15.143:0/3782809189 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47500047a0 con 0x7f47640cf6f0 2024-09-10T20:39:29.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f475a000640 1 -- 172.21.15.143:0/3782809189 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750035030 con 0x7f47640cf6f0 2024-09-10T20:39:29.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4764160030 con 0x7f47640cf6f0 2024-09-10T20:39:29.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47641605f0 con 0x7f47640cf6f0 2024-09-10T20:39:29.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f475a000640 1 -- 172.21.15.143:0/3782809189 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f4750004bf0 con 0x7f47640cf6f0 2024-09-10T20:39:29.640 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.635+0000 7f475a000640 1 -- 172.21.15.143:0/3782809189 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f475003b7d0 con 0x7f47640cf6f0 2024-09-10T20:39:29.641 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.637+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47640b6f60 con 0x7f47640cf6f0 2024-09-10T20:39:29.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.639+0000 7f475a000640 1 -- 172.21.15.143:0/3782809189 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f4750004f10 con 0x7f47640cf6f0 2024-09-10T20:39:29.726 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.723+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3fa9706d-3b77-4f7a-983e-8ba2994b58fc", "id": 3} v 0) -- 0x7f47640b9980 con 0x7f47640cf6f0 2024-09-10T20:39:29.731 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.727+0000 7f475a000640 1 -- 172.21.15.143:0/3782809189 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3fa9706d-3b77-4f7a-983e-8ba2994b58fc", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f47500051d0 con 0x7f47640cf6f0 2024-09-10T20:39:29.731 INFO:teuthology.orchestra.run.smithi143.stdout:3 2024-09-10T20:39:29.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.728+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf6f0 msgr2=0x7f47640caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.728+0000 7f4763200640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf6f0 0x7f47640caad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47500099c0 tx=0x7f47500038a0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.729+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 shutdown_connections 2024-09-10T20:39:29.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.729+0000 7f4763200640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f476415db80 0x7f47640cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.729+0000 7f4763200640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f47640cf6f0 0x7f47640caad0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.732 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.729+0000 7f4763200640 1 --2- 172.21.15.143:0/3782809189 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47640cf290 0x7f47641f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.729+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 >> 172.21.15.143:0/3782809189 conn(0x7f47640d3a00 msgr2=0x7f47640b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.729+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 shutdown_connections 2024-09-10T20:39:29.733 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.729+0000 7f4763200640 1 -- 172.21.15.143:0/3782809189 wait complete. 2024-09-10T20:39:29.746 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 60735205-4db2-44f8-a938-28feae88b9b8 4 2024-09-10T20:39:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 -- 172.21.15.143:0/6654007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cdb30 msgr2=0x7f8b200b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 --2- 172.21.15.143:0/6654007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cdb30 0x7f8b200b1890 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009be0 tx=0x7f8b1802a850 comp rx=0 tx=0).stop 2024-09-10T20:39:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 -- 172.21.15.143:0/6654007 shutdown_connections 2024-09-10T20:39:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 --2- 172.21.15.143:0/6654007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cdb30 0x7f8b200b1890 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 --2- 172.21.15.143:0/6654007 >> v2:172.21.15.143:3300/0 conn(0x7f8b200cd6f0 0x7f8b200b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.901 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 -- 172.21.15.143:0/6654007 >> 172.21.15.143:0/6654007 conn(0x7f8b200d1a10 msgr2=0x7f8b200d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 -- 172.21.15.143:0/6654007 shutdown_connections 2024-09-10T20:39:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.897+0000 7f8b26c00640 1 -- 172.21.15.143:0/6654007 wait complete. 2024-09-10T20:39:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.899+0000 7f8b26c00640 1 Processor -- start 2024-09-10T20:39:29.902 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.899+0000 7f8b26c00640 1 -- start start 2024-09-10T20:39:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b26c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b200cd6f0 0x7f8b20150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b26c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b200cdb30 0x7f8b200c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b26c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cf850 0x7f8b201f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b26c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b200ce500 con 0x7f8b200cdb30 2024-09-10T20:39:29.905 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b26c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8b200ce380 con 0x7f8b200cd6f0 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b26c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8b200ce680 con 0x7f8b200cf850 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b1fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b200cd6f0 0x7f8b20150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b24c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cf850 0x7f8b201f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b1fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b200cd6f0 0x7f8b20150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45636/0 (socket says 172.21.15.143:45636) 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b1fe00640 1 -- 172.21.15.143:0/3322307066 learned_addr learned my addr 172.21.15.143:0/3322307066 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b17e00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b200cdb30 0x7f8b200c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b24c00640 1 -- 172.21.15.143:0/3322307066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b200cd6f0 msgr2=0x7f8b20150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b24c00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b200cd6f0 0x7f8b20150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b24c00640 1 -- 172.21.15.143:0/3322307066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b200cdb30 msgr2=0x7f8b200c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.906 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b24c00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b200cdb30 0x7f8b200c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b24c00640 1 -- 172.21.15.143:0/3322307066 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b200c7060 con 0x7f8b200cf850 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.900+0000 7f8b17e00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b200cdb30 0x7f8b200c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b24c00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cf850 0x7f8b201f5280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009000 tx=0x7f8b18032f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b1cc00640 1 -- 172.21.15.143:0/3322307066 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18041070 con 0x7f8b200cf850 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b1cc00640 1 -- 172.21.15.143:0/3322307066 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b18031a50 con 0x7f8b200cf850 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b1cc00640 1 -- 172.21.15.143:0/3322307066 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18037040 con 0x7f8b200cf850 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b200c7340 con 0x7f8b200cf850 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b200c7900 con 0x7f8b200cf850 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b1cc00640 1 -- 172.21.15.143:0/3322307066 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8b1803c460 con 0x7f8b200cf850 2024-09-10T20:39:29.907 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.901+0000 7f8b1cc00640 1 -- 172.21.15.143:0/3322307066 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8b18046960 con 0x7f8b200cf850 2024-09-10T20:39:29.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.902+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b200cfc30 con 0x7f8b200cf850 2024-09-10T20:39:29.908 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.904+0000 7f8b1cc00640 1 -- 172.21.15.143:0/3322307066 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f8b18046c00 con 0x7f8b200cf850 2024-09-10T20:39:29.982 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.978+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "60735205-4db2-44f8-a938-28feae88b9b8", "id": 4} v 0) -- 0x7f8b200c50a0 con 0x7f8b200cf850 2024-09-10T20:39:29.986 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.983+0000 7f8b1cc00640 1 -- 172.21.15.143:0/3322307066 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60735205-4db2-44f8-a938-28feae88b9b8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8b18046de0 con 0x7f8b200cf850 2024-09-10T20:39:29.986 INFO:teuthology.orchestra.run.smithi143.stdout:4 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cf850 msgr2=0x7f8b201f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cf850 0x7f8b201f5280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009000 tx=0x7f8b18032f90 comp rx=0 tx=0).stop 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 shutdown_connections 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b200cf850 0x7f8b201f5280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b200cdb30 0x7f8b200c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 --2- 172.21.15.143:0/3322307066 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b200cd6f0 0x7f8b20150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 >> 172.21.15.143:0/3322307066 conn(0x7f8b200d1a10 msgr2=0x7f8b200b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:29.988 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 shutdown_connections 2024-09-10T20:39:29.989 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:29.984+0000 7f8b26c00640 1 -- 172.21.15.143:0/3322307066 wait complete. 2024-09-10T20:39:30.002 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 294e189c-0ca0-440d-823d-103c42c6dab6 5 2024-09-10T20:39:30.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 -- 172.21.15.143:0/4137834115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c0cf2c0 msgr2=0x7f231c0b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.157 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 --2- 172.21.15.143:0/4137834115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c0cf2c0 0x7f231c0b1280 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f231c0a1900 tx=0x7f231402aa30 comp rx=0 tx=0).stop 2024-09-10T20:39:30.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 -- 172.21.15.143:0/4137834115 shutdown_connections 2024-09-10T20:39:30.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 --2- 172.21.15.143:0/4137834115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c0cf2c0 0x7f231c0b1280 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 --2- 172.21.15.143:0/4137834115 >> v2:172.21.15.81:3300/0 conn(0x7f231c0cee50 0x7f231c0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 -- 172.21.15.143:0/4137834115 >> 172.21.15.143:0/4137834115 conn(0x7f231c0d3aa0 msgr2=0x7f231c0d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:30.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 -- 172.21.15.143:0/4137834115 shutdown_connections 2024-09-10T20:39:30.158 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.153+0000 7f231be00640 1 -- 172.21.15.143:0/4137834115 wait complete. 2024-09-10T20:39:30.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.155+0000 7f231be00640 1 Processor -- start 2024-09-10T20:39:30.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.155+0000 7f231be00640 1 -- start start 2024-09-10T20:39:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f231c0cee50 0x7f231c1f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f231c0cf2c0 0x7f231c1f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c160ec0 0x7f231c09f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f231c0d2170 con 0x7f231c0cee50 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f231c0d1ff0 con 0x7f231c160ec0 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f231c0b17c0 con 0x7f231c0cf2c0 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f2313e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f231c0cf2c0 0x7f231c1f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231b400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c160ec0 0x7f231c09f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f2313e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f231c0cf2c0 0x7f231c1f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:56626/0 (socket says 172.21.15.143:56626) 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f2313e00640 1 -- 172.21.15.143:0/3359716737 learned_addr learned my addr 172.21.15.143:0/3359716737 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.156+0000 7f231aa00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f231c0cee50 0x7f231c1f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313e00640 1 -- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c160ec0 msgr2=0x7f231c09f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313e00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c160ec0 0x7f231c09f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313e00640 1 -- 172.21.15.143:0/3359716737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f231c0cee50 msgr2=0x7f231c1f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313e00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f231c0cee50 0x7f231c1f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313e00640 1 -- 172.21.15.143:0/3359716737 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c09ffa0 con 0x7f231c0cf2c0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f231b400640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c160ec0 0x7f231c09f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313e00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f231c0cf2c0 0x7f231c1f50d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f230400e9f0 tx=0x7f230400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313400640 1 -- 172.21.15.143:0/3359716737 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230400cd80 con 0x7f231c0cf2c0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313400640 1 -- 172.21.15.143:0/3359716737 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2304010430 con 0x7f231c0cf2c0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c0a0280 con 0x7f231c0cf2c0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.157+0000 7f2313400640 1 -- 172.21.15.143:0/3359716737 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304010840 con 0x7f231c0cf2c0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.158+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c0a0840 con 0x7f231c0cf2c0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.158+0000 7f2313400640 1 -- 172.21.15.143:0/3359716737 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f23040109e0 con 0x7f231c0cf2c0 2024-09-10T20:39:30.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.158+0000 7f2313400640 1 -- 172.21.15.143:0/3359716737 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f23040189a0 con 0x7f231c0cf2c0 2024-09-10T20:39:30.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.159+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231c0b1c70 con 0x7f231c0cf2c0 2024-09-10T20:39:30.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.161+0000 7f2313400640 1 -- 172.21.15.143:0/3359716737 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f2304010d00 con 0x7f231c0cf2c0 2024-09-10T20:39:30.259 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.255+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "294e189c-0ca0-440d-823d-103c42c6dab6", "id": 5} v 0) -- 0x7f231c0b9a20 con 0x7f231c0cf2c0 2024-09-10T20:39:30.263 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.259+0000 7f2313400640 1 -- 172.21.15.143:0/3359716737 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "294e189c-0ca0-440d-823d-103c42c6dab6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f2304018420 con 0x7f231c0cf2c0 2024-09-10T20:39:30.263 INFO:teuthology.orchestra.run.smithi143.stdout:5 2024-09-10T20:39:30.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f231c0cf2c0 msgr2=0x7f231c1f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f231c0cf2c0 0x7f231c1f50d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f230400e9f0 tx=0x7f230400eeb0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.264 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 shutdown_connections 2024-09-10T20:39:30.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f231c160ec0 0x7f231c09f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f231c0cf2c0 0x7f231c1f50d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 --2- 172.21.15.143:0/3359716737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f231c0cee50 0x7f231c1f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 >> 172.21.15.143:0/3359716737 conn(0x7f231c0d3aa0 msgr2=0x7f231c06dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:30.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 shutdown_connections 2024-09-10T20:39:30.265 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.261+0000 7f231be00640 1 -- 172.21.15.143:0/3359716737 wait complete. 2024-09-10T20:39:30.278 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 201fea3a-0302-4e05-b2e0-6e283996e641 6 2024-09-10T20:39:30.432 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.428+0000 7f714fe00640 1 -- 172.21.15.143:0/4054255892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f715015da80 msgr2=0x7f7150161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.428+0000 7f714fe00640 1 --2- 172.21.15.143:0/4054255892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f715015da80 0x7f7150161610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7140009860 tx=0x7f714002a5a0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.429+0000 7f714fe00640 1 -- 172.21.15.143:0/4054255892 shutdown_connections 2024-09-10T20:39:30.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.429+0000 7f714fe00640 1 --2- 172.21.15.143:0/4054255892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f715015da80 0x7f7150161610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.429+0000 7f714fe00640 1 -- 172.21.15.143:0/4054255892 >> 172.21.15.143:0/4054255892 conn(0x7f71500d3a20 msgr2=0x7f71500d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:30.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.429+0000 7f714fe00640 1 -- 172.21.15.143:0/4054255892 shutdown_connections 2024-09-10T20:39:30.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.429+0000 7f714fe00640 1 -- 172.21.15.143:0/4054255892 wait complete. 2024-09-10T20:39:30.433 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.430+0000 7f714fe00640 1 Processor -- start 2024-09-10T20:39:30.434 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.430+0000 7f714fe00640 1 -- start start 2024-09-10T20:39:30.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71500cf5f0 0x7f715014f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715015da80 0x7f715014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7150161b50 0x7f715015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71500b1c50 con 0x7f715015da80 2024-09-10T20:39:30.435 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f71500b1ad0 con 0x7f71500cf5f0 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f71500b1dd0 con 0x7f7150161b50 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71500cf5f0 0x7f715014f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714f400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7150161b50 0x7f715015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71500cf5f0 0x7f715014f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45672/0 (socket says 172.21.15.143:45672) 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714f400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7150161b50 0x7f715015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:56654/0 (socket says 172.21.15.143:56654) 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.431+0000 7f714ea00640 1 -- 172.21.15.143:0/2628763288 learned_addr learned my addr 172.21.15.143:0/2628763288 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f7147e00640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715015da80 0x7f715014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f714f400640 1 -- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71500cf5f0 msgr2=0x7f715014f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f714f400640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71500cf5f0 0x7f715014f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f714f400640 1 -- 172.21.15.143:0/2628763288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715015da80 msgr2=0x7f715014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f714f400640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715015da80 0x7f715014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f714f400640 1 -- 172.21.15.143:0/2628763288 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715015c600 con 0x7f7150161b50 2024-09-10T20:39:30.436 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f714ea00640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71500cf5f0 0x7f715014f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f714f400640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7150161b50 0x7f715015a1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f714800c730 tx=0x7f714800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f7146a00640 1 -- 172.21.15.143:0/2628763288 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148003b70 con 0x7f7150161b50 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.432+0000 7f7146a00640 1 -- 172.21.15.143:0/2628763288 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7148003d10 con 0x7f7150161b50 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.433+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715015c8e0 con 0x7f7150161b50 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.433+0000 7f7146a00640 1 -- 172.21.15.143:0/2628763288 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714800aab0 con 0x7f7150161b50 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.433+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f715015d180 con 0x7f7150161b50 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.433+0000 7f7146a00640 1 -- 172.21.15.143:0/2628763288 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f714800ac50 con 0x7f7150161b50 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.433+0000 7f7146a00640 1 -- 172.21.15.143:0/2628763288 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f71480056c0 con 0x7f7150161b50 2024-09-10T20:39:30.438 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.434+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71501623a0 con 0x7f7150161b50 2024-09-10T20:39:30.439 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.436+0000 7f7146a00640 1 -- 172.21.15.143:0/2628763288 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f71480050d0 con 0x7f7150161b50 2024-09-10T20:39:30.514 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.511+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "201fea3a-0302-4e05-b2e0-6e283996e641", "id": 6} v 0) -- 0x7f715006d100 con 0x7f7150161b50 2024-09-10T20:39:30.520 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.517+0000 7f7146a00640 1 -- 172.21.15.143:0/2628763288 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "201fea3a-0302-4e05-b2e0-6e283996e641", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f71480052b0 con 0x7f7150161b50 2024-09-10T20:39:30.520 INFO:teuthology.orchestra.run.smithi143.stdout:6 2024-09-10T20:39:30.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7150161b50 msgr2=0x7f715015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7150161b50 0x7f715015a1b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f714800c730 tx=0x7f714800cbf0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.521 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 shutdown_connections 2024-09-10T20:39:30.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7150161b50 0x7f715015a1b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f715015da80 0x7f715014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 --2- 172.21.15.143:0/2628763288 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71500cf5f0 0x7f715014f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 >> 172.21.15.143:0/2628763288 conn(0x7f71500d3a20 msgr2=0x7f71500ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:30.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 shutdown_connections 2024-09-10T20:39:30.522 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.518+0000 7f714fe00640 1 -- 172.21.15.143:0/2628763288 wait complete. 2024-09-10T20:39:30.536 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7 7 2024-09-10T20:39:30.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.687+0000 7f04d1a00640 1 -- 172.21.15.143:0/2998913857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc15da80 msgr2=0x7f04cc161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.691 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.687+0000 7f04d1a00640 1 --2- 172.21.15.143:0/2998913857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc15da80 0x7f04cc161610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0d39f0 tx=0x7f04bc02a5f0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.687+0000 7f04d1a00640 1 -- 172.21.15.143:0/2998913857 shutdown_connections 2024-09-10T20:39:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.687+0000 7f04d1a00640 1 --2- 172.21.15.143:0/2998913857 >> v2:172.21.15.81:3300/0 conn(0x7f04cc0cf5f0 0x7f04cc161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.687+0000 7f04d1a00640 1 --2- 172.21.15.143:0/2998913857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc15da80 0x7f04cc161610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.687+0000 7f04d1a00640 1 -- 172.21.15.143:0/2998913857 >> 172.21.15.143:0/2998913857 conn(0x7f04cc0d3a20 msgr2=0x7f04cc0d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.688+0000 7f04d1a00640 1 -- 172.21.15.143:0/2998913857 shutdown_connections 2024-09-10T20:39:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.688+0000 7f04d1a00640 1 -- 172.21.15.143:0/2998913857 wait complete. 2024-09-10T20:39:30.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.689+0000 7f04d1a00640 1 Processor -- start 2024-09-10T20:39:30.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.689+0000 7f04d1a00640 1 -- start start 2024-09-10T20:39:30.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04d1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc0cf5f0 0x7f04cc14de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04d1a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04cc15da80 0x7f04cc1f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04d1a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc161b50 0x7f04cc1f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04d1a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0b1540 con 0x7f04cc161b50 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04d1a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0b13c0 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04d1a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc0b16c0 con 0x7f04cc15da80 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04cbe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc0cf5f0 0x7f04cc14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04c3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04cc15da80 0x7f04cc1f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04cbe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc0cf5f0 0x7f04cc14de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:45692/0 (socket says 172.21.15.143:45692) 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.690+0000 7f04cbe00640 1 -- 172.21.15.143:0/1379595374 learned_addr learned my addr 172.21.15.143:0/1379595374 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04d1000640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc161b50 0x7f04cc1f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04cbe00640 1 -- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04cc15da80 msgr2=0x7f04cc1f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.695 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04cbe00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04cc15da80 0x7f04cc1f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04cbe00640 1 -- 172.21.15.143:0/1379595374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc161b50 msgr2=0x7f04cc1f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04cbe00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc161b50 0x7f04cc1f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04cbe00640 1 -- 172.21.15.143:0/1379595374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc14e380 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04c3e00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04cc15da80 0x7f04cc1f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04d1000640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc161b50 0x7f04cc1f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:30.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04cbe00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc0cf5f0 0x7f04cc14de40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04bc000c00 tx=0x7f04bc003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.691+0000 7f04c8c00640 1 -- 172.21.15.143:0/1379595374 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc03f070 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.692+0000 7f04c8c00640 1 -- 172.21.15.143:0/1379595374 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04bc0047a0 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.692+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc0cab90 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.692+0000 7f04c8c00640 1 -- 172.21.15.143:0/1379595374 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc035030 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.692+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc0cb150 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.692+0000 7f04c8c00640 1 -- 172.21.15.143:0/1379595374 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f04bc004bb0 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.692+0000 7f04c8c00640 1 -- 172.21.15.143:0/1379595374 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f04bc03b460 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.693+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04cc0b1be0 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.699 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.695+0000 7f04c8c00640 1 -- 172.21.15.143:0/1379595374 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f04bc004ed0 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.769+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7", "id": 7} v 0) -- 0x7f04cc0b6bd0 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.776 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.773+0000 7f04c8c00640 1 -- 172.21.15.143:0/1379595374 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f04bc0050b0 con 0x7f04cc0cf5f0 2024-09-10T20:39:30.776 INFO:teuthology.orchestra.run.smithi143.stdout:7 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc0cf5f0 msgr2=0x7f04cc14de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc0cf5f0 0x7f04cc14de40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04bc000c00 tx=0x7f04bc003820 comp rx=0 tx=0).stop 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 shutdown_connections 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04cc161b50 0x7f04cc1f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f04cc15da80 0x7f04cc1f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 --2- 172.21.15.143:0/1379595374 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f04cc0cf5f0 0x7f04cc14de40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 >> 172.21.15.143:0/1379595374 conn(0x7f04cc0d3a20 msgr2=0x7f04cc06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 shutdown_connections 2024-09-10T20:39:30.778 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:39:30.774+0000 7f04d1a00640 1 -- 172.21.15.143:0/1379595374 wait complete. 2024-09-10T20:39:30.792 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T20:39:30.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T20:39:30.797 INFO:tasks.ceph.osd.0:Started 2024-09-10T20:39:30.797 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T20:39:30.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T20:39:30.801 INFO:tasks.ceph.osd.1:Started 2024-09-10T20:39:30.801 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T20:39:30.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T20:39:30.805 INFO:tasks.ceph.osd.2:Started 2024-09-10T20:39:30.806 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T20:39:30.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T20:39:30.810 INFO:tasks.ceph.osd.3:Started 2024-09-10T20:39:30.810 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T20:39:30.810 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T20:39:30.814 INFO:tasks.ceph.osd.4:Started 2024-09-10T20:39:30.814 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T20:39:30.814 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T20:39:30.818 INFO:tasks.ceph.osd.5:Started 2024-09-10T20:39:30.818 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T20:39:30.818 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T20:39:30.822 INFO:tasks.ceph.osd.6:Started 2024-09-10T20:39:30.822 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T20:39:30.822 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T20:39:30.827 INFO:tasks.ceph.osd.7:Started 2024-09-10T20:39:30.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.037+0000 7f0b35000640 1 -- 172.21.15.81:0/2794739574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 msgr2=0x7f0b300aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.037+0000 7f0b35000640 1 --2- 172.21.15.81:0/2794739574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300aced0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0b30072740 tx=0x7f0b1802a4a0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.038+0000 7f0b35000640 1 -- 172.21.15.81:0/2794739574 shutdown_connections 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.038+0000 7f0b35000640 1 --2- 172.21.15.81:0/2794739574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300aced0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.038+0000 7f0b35000640 1 --2- 172.21.15.81:0/2794739574 >> v2:172.21.15.143:3300/0 conn(0x7f0b300b4550 0x7f0b30070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.038+0000 7f0b35000640 1 -- 172.21.15.81:0/2794739574 >> 172.21.15.81:0/2794739574 conn(0x7f0b300b1bf0 msgr2=0x7f0b300b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.038+0000 7f0b35000640 1 -- 172.21.15.81:0/2794739574 shutdown_connections 2024-09-10T20:39:31.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.038+0000 7f0b35000640 1 -- 172.21.15.81:0/2794739574 wait complete. 2024-09-10T20:39:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.039+0000 7f0b35000640 1 Processor -- start 2024-09-10T20:39:31.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.039+0000 7f0b35000640 1 -- start start 2024-09-10T20:39:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b35000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b300ad410 0x7f0b3009d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b35000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b35000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b300b4550 0x7f0b300b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b35000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3006d3e0 con 0x7f0b300add10 2024-09-10T20:39:31.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b35000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3006d260 con 0x7f0b300b4550 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b35000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3006d560 con 0x7f0b300ad410 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b27e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37098/0 (socket says 172.21.15.81:37098) 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.040+0000 7f0b27e00640 1 -- 172.21.15.81:0/2140319526 learned_addr learned my addr 172.21.15.81:0/2140319526 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b2de00640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b300ad410 0x7f0b3009d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b2e800640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b300b4550 0x7f0b300b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b27e00640 1 -- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b300ad410 msgr2=0x7f0b3009d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b27e00640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b300ad410 0x7f0b3009d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b27e00640 1 -- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b300b4550 msgr2=0x7f0b300b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b27e00640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b300b4550 0x7f0b300b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b27e00640 1 -- 172.21.15.81:0/2140319526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b30150760 con 0x7f0b300add10 2024-09-10T20:39:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b27e00640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300c71b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0b1802aa90 tx=0x7f0b18032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b26000640 1 -- 172.21.15.81:0/2140319526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18040070 con 0x7f0b300add10 2024-09-10T20:39:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b26000640 1 -- 172.21.15.81:0/2140319526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b18005310 con 0x7f0b300add10 2024-09-10T20:39:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b26000640 1 -- 172.21.15.81:0/2140319526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18005c90 con 0x7f0b300add10 2024-09-10T20:39:31.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.041+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b30150a40 con 0x7f0b300add10 2024-09-10T20:39:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.042+0000 7f0b26000640 1 -- 172.21.15.81:0/2140319526 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0b18004b30 con 0x7f0b300add10 2024-09-10T20:39:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.042+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b30151000 con 0x7f0b300add10 2024-09-10T20:39:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.043+0000 7f0b26000640 1 -- 172.21.15.81:0/2140319526 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0b180035f0 con 0x7f0b300add10 2024-09-10T20:39:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.043+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b30151200 con 0x7f0b300add10 2024-09-10T20:39:31.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.045+0000 7f0b26000640 1 -- 172.21.15.81:0/2140319526 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7f0b30151200 con 0x7f0b300add10 2024-09-10T20:39:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.107+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b3006da30 con 0x7f0b300add10 2024-09-10T20:39:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.107+0000 7f0b26000640 1 -- 172.21.15.81:0/2140319526 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0b180037f0 con 0x7f0b300add10 2024-09-10T20:39:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:31.112 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:30.770629+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:39:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 msgr2=0x7f0b300c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300c71b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0b1802aa90 tx=0x7f0b18032c10 comp rx=0 tx=0).stop 2024-09-10T20:39:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 shutdown_connections 2024-09-10T20:39:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b300b4550 0x7f0b300b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b300add10 0x7f0b300c71b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 --2- 172.21.15.81:0/2140319526 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0b300ad410 0x7f0b3009d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 >> 172.21.15.81:0/2140319526 conn(0x7f0b300b1bf0 msgr2=0x7f0b3006dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 shutdown_connections 2024-09-10T20:39:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:31.108+0000 7f0b35000640 1 -- 172.21.15.81:0/2140319526 wait complete. 2024-09-10T20:39:31.127 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T20:39:31.127 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T20:39:31.934 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T20:39:32.074 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 -- 172.21.15.81:0/584099070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0b30a0 msgr2=0x7fb17c06cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:32.074 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 --2- 172.21.15.81:0/584099070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0b30a0 0x7fb17c06cf60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb168009830 tx=0x7fb16802a510 comp rx=0 tx=0).stop 2024-09-10T20:39:32.075 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 -- 172.21.15.81:0/584099070 shutdown_connections 2024-09-10T20:39:32.075 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 --2- 172.21.15.81:0/584099070 >> v2:172.21.15.143:3300/0 conn(0x7fb17c0b2b30 0x7fb17c06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.075 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 --2- 172.21.15.81:0/584099070 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0b30a0 0x7fb17c06cf60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.075 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 -- 172.21.15.81:0/584099070 >> 172.21.15.81:0/584099070 conn(0x7fb17c0d3b10 msgr2=0x7fb17c0d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:32.075 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 -- 172.21.15.81:0/584099070 shutdown_connections 2024-09-10T20:39:32.075 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.070+0000 7fb17b200640 1 -- 172.21.15.81:0/584099070 wait complete. 2024-09-10T20:39:32.076 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.072+0000 7fb17b200640 1 Processor -- start 2024-09-10T20:39:32.076 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.072+0000 7fb17b200640 1 -- start start 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb17b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0b2b30 0x7fb17c1f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb17b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17c0b30a0 0x7fb17c1f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb17b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0d0520 0x7fb17c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb17b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c06db60 con 0x7fb17c0b30a0 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb17b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c06d9e0 con 0x7fb17c0b2b30 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb17b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb17c06dce0 con 0x7fb17c0d0520 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb179400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17c0b30a0 0x7fb17c1f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb179400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17c0b30a0 0x7fb17c1f8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37102/0 (socket says 172.21.15.81:37102) 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb179400640 1 -- 172.21.15.81:0/961079116 learned_addr learned my addr 172.21.15.81:0/961079116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb179e00640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0b2b30 0x7fb17c1f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:32.078 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.073+0000 7fb17a800640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0d0520 0x7fb17c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb179e00640 1 -- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0d0520 msgr2=0x7fb17c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb179e00640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0d0520 0x7fb17c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb179e00640 1 -- 172.21.15.81:0/961079116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17c0b30a0 msgr2=0x7fb17c1f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb179e00640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17c0b30a0 0x7fb17c1f8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb179e00640 1 -- 172.21.15.81:0/961079116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c1f8d50 con 0x7fb17c0b2b30 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb17a800640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0d0520 0x7fb17c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb179400640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17c0b30a0 0x7fb17c1f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:32.079 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb179e00640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0b2b30 0x7fb17c1f47c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00c3f0 tx=0x7fb16c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:32.080 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb172000640 1 -- 172.21.15.81:0/961079116 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c011790 con 0x7fb17c0b2b30 2024-09-10T20:39:32.080 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb172000640 1 -- 172.21.15.81:0/961079116 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb16c017070 con 0x7fb17c0b2b30 2024-09-10T20:39:32.080 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb172000640 1 -- 172.21.15.81:0/961079116 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c011ce0 con 0x7fb17c0b2b30 2024-09-10T20:39:32.080 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.074+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c0cbef0 con 0x7fb17c0b2b30 2024-09-10T20:39:32.081 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.075+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c1f5180 con 0x7fb17c0b2b30 2024-09-10T20:39:32.081 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.076+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17c0d0900 con 0x7fb17c0b2b30 2024-09-10T20:39:32.081 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.076+0000 7fb172000640 1 -- 172.21.15.81:0/961079116 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 2) ==== 50324+0+0 (secure 0 0 0) 0x7fb16c01c460 con 0x7fb17c0b2b30 2024-09-10T20:39:32.081 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.076+0000 7fb172000640 1 -- 172.21.15.81:0/961079116 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb16c051830 con 0x7fb17c0b2b30 2024-09-10T20:39:32.083 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.078+0000 7fb172000640 1 -- 172.21.15.81:0/961079116 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (secure 0 0 0) 0x7fb17c1f8d50 con 0x7fb17c0b2b30 2024-09-10T20:39:32.097 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-09-10T20:39:32.094+0000 7fd8999c3640 -1 Falling back to public interface 2024-09-10T20:39:32.137 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-09-10T20:39:32.134+0000 7fd0292e2640 -1 Falling back to public interface 2024-09-10T20:39:32.146 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.142+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb17c15d640 con 0x7fb17c0b2b30 2024-09-10T20:39:32.147 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.143+0000 7fb172000640 1 -- 172.21.15.81:0/961079116 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb16c01ac60 con 0x7fb17c0b2b30 2024-09-10T20:39:32.147 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-10T20:39:32.147 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:30.770629+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:39:32.148 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0b2b30 msgr2=0x7fb17c1f47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:32.148 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0b2b30 0x7fb17c1f47c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00c3f0 tx=0x7fb16c00c7f0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.148 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 shutdown_connections 2024-09-10T20:39:32.149 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb17c0d0520 0x7fb17c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.149 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb17c0b30a0 0x7fb17c1f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.149 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 --2- 172.21.15.81:0/961079116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb17c0b2b30 0x7fb17c1f47c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:32.149 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 >> 172.21.15.81:0/961079116 conn(0x7fb17c0d3b10 msgr2=0x7fb17c15c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:32.149 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 shutdown_connections 2024-09-10T20:39:32.149 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:32.144+0000 7fb17b200640 1 -- 172.21.15.81:0/961079116 wait complete. 2024-09-10T20:39:32.160 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T20:39:32.359 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T20:39:32.356+0000 7fbeed60f640 -1 Falling back to public interface 2024-09-10T20:39:32.390 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-09-10T20:39:32.387+0000 7f3136734640 -1 Falling back to public interface 2024-09-10T20:39:32.393 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-10T20:39:32.389+0000 7f521e817640 -1 Falling back to public interface 2024-09-10T20:39:32.393 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T20:39:32.389+0000 7f3740c22640 -1 Falling back to public interface 2024-09-10T20:39:32.393 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T20:39:32.389+0000 7f8aa5e1a640 -1 Falling back to public interface 2024-09-10T20:39:32.672 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-09-10T20:39:32.669+0000 7fe4f3fdd640 -1 Falling back to public interface 2024-09-10T20:39:32.856 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-09-10T20:39:32.852+0000 7fc2fc800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T20:39:32.856 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-09-10T20:39:32.853+0000 7fc2fc800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T20:39:36.044 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-09-10T20:39:36.041+0000 7fd8999c3640 -1 osd.5 0 log_to_monitors true 2024-09-10T20:39:36.148 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T20:39:36.144+0000 7f3740c22640 -1 osd.2 0 log_to_monitors true 2024-09-10T20:39:36.251 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T20:39:36.246+0000 7fbeed60f640 -1 osd.0 0 log_to_monitors true 2024-09-10T20:39:36.305 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-10T20:39:36.300+0000 7f521e817640 -1 osd.3 0 log_to_monitors true 2024-09-10T20:39:36.323 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-09-10T20:39:36.320+0000 7fd0292e2640 -1 osd.7 0 log_to_monitors true 2024-09-10T20:39:36.371 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T20:39:36.366+0000 7f8aa5e1a640 -1 osd.1 0 log_to_monitors true 2024-09-10T20:39:36.574 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-09-10T20:39:36.571+0000 7f3136734640 -1 osd.6 0 log_to_monitors true 2024-09-10T20:39:36.651 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-09-10T20:39:36.648+0000 7fe4f3fdd640 -1 osd.4 0 log_to_monitors true 2024-09-10T20:39:38.024 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-09-10T20:39:38.021+0000 7fd894800640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T20:39:38.034 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-09-10T20:39:38.031+0000 7fd88a800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:38.967 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T20:39:39.137 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.131+0000 7f7793200640 1 -- 172.21.15.81:0/3166288969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 msgr2=0x7f778c15e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:39.137 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.131+0000 7f7793200640 1 --2- 172.21.15.81:0/3166288969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c15e8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f778c072260 tx=0x7f778002a560 comp rx=0 tx=0).stop 2024-09-10T20:39:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.132+0000 7f7793200640 1 -- 172.21.15.81:0/3166288969 shutdown_connections 2024-09-10T20:39:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.132+0000 7f7793200640 1 --2- 172.21.15.81:0/3166288969 >> v2:172.21.15.143:3300/0 conn(0x7f778c0ad8d0 0x7f778c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.132+0000 7f7793200640 1 --2- 172.21.15.81:0/3166288969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c15e8b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.132+0000 7f7793200640 1 -- 172.21.15.81:0/3166288969 >> 172.21.15.81:0/3166288969 conn(0x7f778c06d300 msgr2=0x7f778c0b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.132+0000 7f7793200640 1 -- 172.21.15.81:0/3166288969 shutdown_connections 2024-09-10T20:39:39.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.132+0000 7f7793200640 1 -- 172.21.15.81:0/3166288969 wait complete. 2024-09-10T20:39:39.139 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.134+0000 7f7793200640 1 Processor -- start 2024-09-10T20:39:39.139 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.134+0000 7f7793200640 1 -- start start 2024-09-10T20:39:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7793200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f778c0ad8d0 0x7f778c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7793200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c1412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7793200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f778c161420 0x7f778c0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7793200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f778c161f80 con 0x7f778c0ced40 2024-09-10T20:39:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7793200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0aef70 con 0x7f778c161420 2024-09-10T20:39:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7793200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f778c162100 con 0x7f778c0ad8d0 2024-09-10T20:39:39.142 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7791e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f778c0ad8d0 0x7f778c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.135+0000 7f7791400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c1412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c1412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57102/0 (socket says 172.21.15.81:57102) 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 -- 172.21.15.81:0/3304938676 learned_addr learned my addr 172.21.15.81:0/3304938676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7792800640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f778c161420 0x7f778c0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 -- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f778c0ad8d0 msgr2=0x7f778c0b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f778c0ad8d0 0x7f778c0b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 -- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f778c161420 msgr2=0x7f778c0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f778c161420 0x7f778c0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 -- 172.21.15.81:0/3304938676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c14b8d0 con 0x7f778c0ced40 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7791400640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c1412b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f777c00d770 tx=0x7f777c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.136+0000 7f7786000640 1 -- 172.21.15.81:0/3304938676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c017070 con 0x7f778c0ced40 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.137+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778c14bbb0 con 0x7f778c0ced40 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.137+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778c156390 con 0x7f778c0ced40 2024-09-10T20:39:39.143 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.137+0000 7f7786000640 1 -- 172.21.15.81:0/3304938676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f777c009d20 con 0x7f778c0ced40 2024-09-10T20:39:39.144 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.137+0000 7f7786000640 1 -- 172.21.15.81:0/3304938676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c005280 con 0x7f778c0ced40 2024-09-10T20:39:39.145 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.138+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7768005290 con 0x7f778c0ced40 2024-09-10T20:39:39.145 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.139+0000 7f7786000640 1 -- 172.21.15.81:0/3304938676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 100545+0+0 (secure 0 0 0) 0x7f777c005420 con 0x7f778c0ced40 2024-09-10T20:39:39.145 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.140+0000 7f7786000640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7770077f10 0x7f777007a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:39.145 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.140+0000 7f7786000640 1 -- 172.21.15.81:0/3304938676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f777c0994b0 con 0x7f778c0ced40 2024-09-10T20:39:39.145 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.140+0000 7f7791e00640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7770077f10 0x7f777007a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:39.145 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.141+0000 7f7791e00640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7770077f10 0x7f777007a3d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7780033000 tx=0x7f7780004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:39.152 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.147+0000 7f7786000640 1 -- 172.21.15.81:0/3304938676 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f777c062730 con 0x7f778c0ced40 2024-09-10T20:39:39.392 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.387+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7768005850 con 0x7f778c0ced40 2024-09-10T20:39:39.444 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.439+0000 7f7786000640 1 -- 172.21.15.81:0/3304938676 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7f777c067160 con 0x7f778c0ced40 2024-09-10T20:39:39.444 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-10T20:39:39.445 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":13,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:38.108181+0000","last_up_change":"2024-09-10T20:39:38.108181+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7770077f10 msgr2=0x7f777007a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7770077f10 0x7f777007a3d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7780033000 tx=0x7f7780004730 comp rx=0 tx=0).stop 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 msgr2=0x7f778c1412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c1412b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f777c00d770 tx=0x7f777c00dc30 comp rx=0 tx=0).stop 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 shutdown_connections 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7770077f10 0x7f777007a3d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f778c161420 0x7f778c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.447 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f778c0ced40 0x7f778c1412b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.448 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 --2- 172.21.15.81:0/3304938676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f778c0ad8d0 0x7f778c0b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:39.448 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 >> 172.21.15.81:0/3304938676 conn(0x7f778c06d300 msgr2=0x7f778c1607d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:39.448 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 shutdown_connections 2024-09-10T20:39:39.448 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:39.442+0000 7f7793200640 1 -- 172.21.15.81:0/3304938676 wait complete. 2024-09-10T20:39:39.467 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-10T20:39:39.880 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-09-10T20:39:39.876+0000 7fd024200640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T20:39:39.886 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-09-10T20:39:39.882+0000 7fd01a200640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:39.948 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-09-10T20:39:39.944+0000 7fe4ef800640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T20:39:39.959 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-09-10T20:39:39.954+0000 7fe4e4e00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:39.996 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-09-10T20:39:39.992+0000 7f3131600640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T20:39:40.004 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-09-10T20:39:39.999+0000 7f3127600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:40.312 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-10T20:39:40.308+0000 7f5219000640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T20:39:40.323 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-10T20:39:40.319+0000 7f520f000640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:40.435 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T20:39:40.429+0000 7f8aa0c00640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T20:39:40.441 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T20:39:40.437+0000 7f8a96c00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:40.506 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T20:39:40.502+0000 7fbee7e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T20:39:40.509 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T20:39:40.504+0000 7f373be00640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T20:39:40.514 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T20:39:40.509+0000 7fbedde00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:40.518 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T20:39:40.514+0000 7f3731400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T20:39:46.274 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 -- 172.21.15.81:0/1595535039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0aea60 msgr2=0x7f0f9c06f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 --2- 172.21.15.81:0/1595535039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0aea60 0x7f0f9c06f1f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0cf4a0 tx=0x7f0f9402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 -- 172.21.15.81:0/1595535039 shutdown_connections 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 --2- 172.21.15.81:0/1595535039 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0aea60 0x7f0f9c06f1f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 --2- 172.21.15.81:0/1595535039 >> v2:172.21.15.143:3300/0 conn(0x7f0f9c0cdb00 0x7f0f9c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 -- 172.21.15.81:0/1595535039 >> 172.21.15.81:0/1595535039 conn(0x7f0f9c0b1570 msgr2=0x7f0f9c0b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 -- 172.21.15.81:0/1595535039 shutdown_connections 2024-09-10T20:39:46.425 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.419+0000 7f0fa3600640 1 -- 172.21.15.81:0/1595535039 wait complete. 2024-09-10T20:39:46.426 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.421+0000 7f0fa3600640 1 Processor -- start 2024-09-10T20:39:46.426 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.421+0000 7f0fa3600640 1 -- start start 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.422+0000 7f0fa3600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c0aea60 0x7f0f9c0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.422+0000 7f0fa3600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0cdb00 0x7f0f9c1f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.422+0000 7f0fa3600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f9c15b9e0 0x7f0f9c154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.422+0000 7f0fa3600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c06f730 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.422+0000 7f0fa3600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c0af2e0 con 0x7f0f9c0aea60 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.422+0000 7f0fa3600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9c06f8b0 con 0x7f0f9c0cdb00 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.422+0000 7f0fa1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f9c15b9e0 0x7f0f9c154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f9c15b9e0 0x7f0f9c154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48668/0 (socket says 172.21.15.81:48668) 2024-09-10T20:39:46.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 -- 172.21.15.81:0/2561898640 learned_addr learned my addr 172.21.15.81:0/2561898640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa0c00640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c0aea60 0x7f0f9c0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0f9be00640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0cdb00 0x7f0f9c1f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 -- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0cdb00 msgr2=0x7f0f9c1f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0cdb00 0x7f0f9c1f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 -- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c0aea60 msgr2=0x7f0f9c0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c0aea60 0x7f0f9c0c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 -- 172.21.15.81:0/2561898640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c0c5650 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.429 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0fa1600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f9c15b9e0 0x7f0f9c154890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009230 tx=0x7f0f94005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:46.430 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.423+0000 7f0f98c00640 1 -- 172.21.15.81:0/2561898640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9403f070 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.430 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.424+0000 7f0f98c00640 1 -- 172.21.15.81:0/2561898640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f94003c70 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.430 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.424+0000 7f0f98c00640 1 -- 172.21.15.81:0/2561898640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94035030 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.430 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.424+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c1f5ab0 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.430 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.424+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1f6070 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.430 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.425+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9c1f6270 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.431 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.426+0000 7f0f98c00640 1 -- 172.21.15.81:0/2561898640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0f9403b460 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.431 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.426+0000 7f0f98c00640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0f7c077f70 0x7f0f7c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.431 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.427+0000 7f0f98c00640 1 -- 172.21.15.81:0/2561898640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f0f940ba7e0 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.432 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.427+0000 7f0fa0c00640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0f7c077f70 0x7f0f7c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.432 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.428+0000 7f0fa0c00640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0f7c077f70 0x7f0f7c07a430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c001ce0 tx=0x7f0f8c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:46.436 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.432+0000 7f0f98c00640 1 -- 172.21.15.81:0/2561898640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0f9c1f6270 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.623 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.618+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f9c06fda0 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.623 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.618+0000 7f0f98c00640 1 -- 172.21.15.81:0/2561898640 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12884 (secure 0 0 0) 0x7f0f94083590 con 0x7f0f9c15b9e0 2024-09-10T20:39:46.624 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-10T20:39:46.624 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":18,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:43.875806+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:39:46.626 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0f7c077f70 msgr2=0x7f0f7c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.626 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0f7c077f70 0x7f0f7c07a430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c001ce0 tx=0x7f0f8c009040 comp rx=0 tx=0).stop 2024-09-10T20:39:46.626 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f9c15b9e0 msgr2=0x7f0f9c154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.626 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f9c15b9e0 0x7f0f9c154890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009230 tx=0x7f0f94005760 comp rx=0 tx=0).stop 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 shutdown_connections 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0f7c077f70 0x7f0f7c07a430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f9c15b9e0 0x7f0f9c154890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f9c0cdb00 0x7f0f9c1f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 --2- 172.21.15.81:0/2561898640 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f9c0aea60 0x7f0f9c0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 >> 172.21.15.81:0/2561898640 conn(0x7f0f9c0b1570 msgr2=0x7f0f9c155550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 shutdown_connections 2024-09-10T20:39:46.627 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T20:39:46.621+0000 7f0fa3600640 1 -- 172.21.15.81:0/2561898640 wait complete. 2024-09-10T20:39:46.639 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T20:39:46.639 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T20:39:46.639 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T20:39:46.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T20:39:46.644 INFO:tasks.ceph.mds.a:Started 2024-09-10T20:39:46.644 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T20:39:46.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T20:39:46.647 INFO:tasks.ceph.mds.c:Started 2024-09-10T20:39:46.647 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T20:39:46.648 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T20:39:46.652 INFO:tasks.ceph.mds.b:Started 2024-09-10T20:39:46.653 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T20:39:46.653 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T20:39:46.657 INFO:tasks.ceph.mds.d:Started 2024-09-10T20:39:46.657 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T20:39:46.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:39:46.774 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-10T20:39:46.774 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-10T20:39:46.791 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-09-10T20:39:46.791 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-09-10T20:39:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.818+0000 7fd95b200640 1 -- 172.21.15.81:0/3130544600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c161140 msgr2=0x7fd95c0b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.818+0000 7fd95b200640 1 --2- 172.21.15.81:0/3130544600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c161140 0x7fd95c0b21c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd94c005fd0 tx=0x7fd94c02a820 comp rx=0 tx=0).stop 2024-09-10T20:39:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.818+0000 7fd95b200640 1 -- 172.21.15.81:0/3130544600 shutdown_connections 2024-09-10T20:39:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.818+0000 7fd95b200640 1 --2- 172.21.15.81:0/3130544600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c161140 0x7fd95c0b21c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.818+0000 7fd95b200640 1 -- 172.21.15.81:0/3130544600 >> 172.21.15.81:0/3130544600 conn(0x7fd95c0d3ab0 msgr2=0x7fd95c0d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.818+0000 7fd95b200640 1 -- 172.21.15.81:0/3130544600 shutdown_connections 2024-09-10T20:39:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.818+0000 7fd95b200640 1 -- 172.21.15.81:0/3130544600 wait complete. 2024-09-10T20:39:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.820+0000 7fd95b200640 1 Processor -- start 2024-09-10T20:39:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.820+0000 7fd95b200640 1 -- start start 2024-09-10T20:39:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd95b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c06d060 0x7fd95c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd95b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd95c06e0a0 0x7fd95c0cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd95b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95c161140 0x7fd95c156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd95b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c1616a0 con 0x7fd95c06d060 2024-09-10T20:39:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd95b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c161520 con 0x7fd95c06e0a0 2024-09-10T20:39:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd95b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd95c06e770 con 0x7fd95c161140 2024-09-10T20:39:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c06d060 0x7fd95c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c06d060 0x7fd95c0cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48696/0 (socket says 172.21.15.81:48696) 2024-09-10T20:39:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 -- 172.21.15.81:0/3950691655 learned_addr learned my addr 172.21.15.81:0/3950691655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959400640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd95c06e0a0 0x7fd95c0cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd95a800640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95c161140 0x7fd95c156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 -- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95c161140 msgr2=0x7fd95c156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95c161140 0x7fd95c156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 -- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd95c06e0a0 msgr2=0x7fd95c0cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:46.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd95c06e0a0 0x7fd95c0cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:46.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.821+0000 7fd959e00640 1 -- 172.21.15.81:0/3950691655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c0ccf50 con 0x7fd95c06d060 2024-09-10T20:39:46.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.822+0000 7fd959e00640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c06d060 0x7fd95c0cb7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd94c006010 tx=0x7fd94c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:46.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.822+0000 7fd952000640 1 -- 172.21.15.81:0/3950691655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c037040 con 0x7fd95c06d060 2024-09-10T20:39:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.822+0000 7fd952000640 1 -- 172.21.15.81:0/3950691655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd94c042070 con 0x7fd95c06d060 2024-09-10T20:39:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.822+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c0cc9d0 con 0x7fd95c06d060 2024-09-10T20:39:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.822+0000 7fd952000640 1 -- 172.21.15.81:0/3950691655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0042a0 con 0x7fd95c06d060 2024-09-10T20:39:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.822+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c0b3350 con 0x7fd95c06d060 2024-09-10T20:39:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.823+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95c0b3030 con 0x7fd95c06d060 2024-09-10T20:39:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.824+0000 7fd952000640 1 -- 172.21.15.81:0/3950691655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd94c03a030 con 0x7fd95c06d060 2024-09-10T20:39:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.825+0000 7fd952000640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd93c077fa0 0x7fd93c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.825+0000 7fd952000640 1 -- 172.21.15.81:0/3950691655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fd94c0ba1f0 con 0x7fd95c06d060 2024-09-10T20:39:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.825+0000 7fd959400640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd93c077fa0 0x7fd93c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.826+0000 7fd959400640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd93c077fa0 0x7fd93c07a460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0cc390 tx=0x7fd948007e30 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:46.829+0000 7fd952000640 1 -- 172.21.15.81:0/3950691655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd94c082a80 con 0x7fd95c06d060 2024-09-10T20:39:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.045+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd95c15e8b0 con 0x7fd95c06d060 2024-09-10T20:39:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.046+0000 7fd952000640 1 -- 172.21.15.81:0/3950691655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fd94c0874b0 con 0x7fd95c06d060 2024-09-10T20:39:47.051 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:47.051 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"btime":"2024-09-10T20:39:46:777949+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T20:39:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-10T20:39:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd93c077fa0 msgr2=0x7fd93c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd93c077fa0 0x7fd93c07a460 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0cc390 tx=0x7fd948007e30 comp rx=0 tx=0).stop 2024-09-10T20:39:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c06d060 msgr2=0x7fd95c0cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c06d060 0x7fd95c0cb7e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd94c006010 tx=0x7fd94c032c90 comp rx=0 tx=0).stop 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 shutdown_connections 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd93c077fa0 0x7fd93c07a460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd95c161140 0x7fd95c156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd95c06e0a0 0x7fd95c0cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 --2- 172.21.15.81:0/3950691655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd95c06d060 0x7fd95c0cb7e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.048+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 >> 172.21.15.81:0/3950691655 conn(0x7fd95c0d3ab0 msgr2=0x7fd95c0d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.049+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 shutdown_connections 2024-09-10T20:39:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:47.049+0000 7fd95b200640 1 -- 172.21.15.81:0/3950691655 wait complete. 2024-09-10T20:39:47.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:39:47.113 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:39:49.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:39:49.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.231+0000 7f553e800640 1 -- 172.21.15.81:0/4130367935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5520003cf0 msgr2=0x7f55200040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.231+0000 7f553e800640 1 --2- 172.21.15.81:0/4130367935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5520003cf0 0x7f55200040f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f552c001830 tx=0x7f5520005830 comp rx=0 tx=0).stop 2024-09-10T20:39:49.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.231+0000 7f553e800640 1 -- 172.21.15.81:0/4130367935 shutdown_connections 2024-09-10T20:39:49.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.231+0000 7f553e800640 1 --2- 172.21.15.81:0/4130367935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5520003cf0 0x7f55200040f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.231+0000 7f553e800640 1 -- 172.21.15.81:0/4130367935 >> 172.21.15.81:0/4130367935 conn(0x7f55380d3ab0 msgr2=0x7f55380d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:49.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.232+0000 7f553e800640 1 -- 172.21.15.81:0/4130367935 shutdown_connections 2024-09-10T20:39:49.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.232+0000 7f553e800640 1 -- 172.21.15.81:0/4130367935 wait complete. 2024-09-10T20:39:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.233+0000 7f553e800640 1 Processor -- start 2024-09-10T20:39:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.233+0000 7f553e800640 1 -- start start 2024-09-10T20:39:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553e800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5520003cf0 0x7f553814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f553814e770 0x7f55381f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553e800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55380b8df0 0x7f55380b9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553e800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55381616a0 con 0x7f553814e770 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553e800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5538161520 con 0x7f55380b8df0 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553e800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f553806e770 con 0x7f5520003cf0 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f553814e770 0x7f55381f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f553814e770 0x7f55381f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48724/0 (socket says 172.21.15.81:48724) 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.234+0000 7f553ca00640 1 -- 172.21.15.81:0/2143297168 learned_addr learned my addr 172.21.15.81:0/2143297168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553de00640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55380b8df0 0x7f55380b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553d400640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5520003cf0 0x7f553814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553ca00640 1 -- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5520003cf0 msgr2=0x7f553814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553ca00640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5520003cf0 0x7f553814b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553ca00640 1 -- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55380b8df0 msgr2=0x7f55380b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553ca00640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55380b8df0 0x7f55380b9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553ca00640 1 -- 172.21.15.81:0/2143297168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553814bc00 con 0x7f553814e770 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553de00640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55380b8df0 0x7f55380b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553ca00640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f553814e770 0x7f55381f3df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5524001eb0 tx=0x7f552400e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f5535600640 1 -- 172.21.15.81:0/2143297168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524015020 con 0x7f553814e770 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f5535600640 1 -- 172.21.15.81:0/2143297168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5524011960 con 0x7f553814e770 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55381f7c70 con 0x7f553814e770 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f5535600640 1 -- 172.21.15.81:0/2143297168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524011d90 con 0x7f553814e770 2024-09-10T20:39:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.235+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55381f8230 con 0x7f553814e770 2024-09-10T20:39:49.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.236+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55380b31a0 con 0x7f553814e770 2024-09-10T20:39:49.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.238+0000 7f5535600640 1 -- 172.21.15.81:0/2143297168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f552401a400 con 0x7f553814e770 2024-09-10T20:39:49.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.238+0000 7f5535600640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5518077f70 0x7f551807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.238+0000 7f5535600640 1 -- 172.21.15.81:0/2143297168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f552409a2c0 con 0x7f553814e770 2024-09-10T20:39:49.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.239+0000 7f553d400640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5518077f70 0x7f551807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.240+0000 7f553d400640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5518077f70 0x7f551807a430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f552c032000 tx=0x7f552c001360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.243+0000 7f5535600640 1 -- 172.21.15.81:0/2143297168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f552401f020 con 0x7f553814e770 2024-09-10T20:39:49.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.463+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5538160710 con 0x7f553814e770 2024-09-10T20:39:49.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.464+0000 7f5535600640 1 -- 172.21.15.81:0/2143297168 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f553814bc00 con 0x7f553814e770 2024-09-10T20:39:49.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:49.468 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"btime":"2024-09-10T20:39:47:781202+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T20:39:49.468 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5518077f70 msgr2=0x7f551807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5518077f70 0x7f551807a430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f552c032000 tx=0x7f552c001360 comp rx=0 tx=0).stop 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f553814e770 msgr2=0x7f55381f3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f553814e770 0x7f55381f3df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5524001eb0 tx=0x7f552400e7f0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 shutdown_connections 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5518077f70 0x7f551807a430 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55380b8df0 0x7f55380b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f553814e770 0x7f55381f3df0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 --2- 172.21.15.81:0/2143297168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5520003cf0 0x7f553814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 >> 172.21.15.81:0/2143297168 conn(0x7f55380d3ab0 msgr2=0x7f55380d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:49.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 shutdown_connections 2024-09-10T20:39:49.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.466+0000 7f553e800640 1 -- 172.21.15.81:0/2143297168 wait complete. 2024-09-10T20:39:49.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T20:39:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.638+0000 7f06f0e00640 1 -- 172.21.15.81:0/3740825314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d00052e0 msgr2=0x7f06d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.638+0000 7f06f0e00640 1 --2- 172.21.15.81:0/3740825314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d00052e0 0x7f06d000b9c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06e4005fd0 tx=0x7f06d0005830 comp rx=0 tx=0).stop 2024-09-10T20:39:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.638+0000 7f06f0e00640 1 -- 172.21.15.81:0/3740825314 shutdown_connections 2024-09-10T20:39:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.638+0000 7f06f0e00640 1 --2- 172.21.15.81:0/3740825314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d00052e0 0x7f06d000b9c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.638+0000 7f06f0e00640 1 -- 172.21.15.81:0/3740825314 >> 172.21.15.81:0/3740825314 conn(0x7f06ec06cb50 msgr2=0x7f06ec06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.638+0000 7f06f0e00640 1 -- 172.21.15.81:0/3740825314 shutdown_connections 2024-09-10T20:39:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.638+0000 7f06f0e00640 1 -- 172.21.15.81:0/3740825314 wait complete. 2024-09-10T20:39:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.640+0000 7f06f0e00640 1 Processor -- start 2024-09-10T20:39:49.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.640+0000 7f06f0e00640 1 -- start start 2024-09-10T20:39:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.640+0000 7f06f0e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06d00052e0 0x7f06ec1f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06f0e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06ec1f4a40 0x7f06ec153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06f0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06ec0aec60 0x7f06ec06fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06f0e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec15ba60 con 0x7f06ec0aec60 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06f0e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec15fa60 con 0x7f06d00052e0 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06f0e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f06ec15bbe0 con 0x7f06ec1f4a40 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06ec0aec60 0x7f06ec06fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06ec0aec60 0x7f06ec06fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48748/0 (socket says 172.21.15.81:48748) 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 -- 172.21.15.81:0/845014160 learned_addr learned my addr 172.21.15.81:0/845014160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06e9e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06d00052e0 0x7f06ec1f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06e9400640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06ec1f4a40 0x7f06ec153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 -- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06ec1f4a40 msgr2=0x7f06ec153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06ec1f4a40 0x7f06ec153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 -- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06d00052e0 msgr2=0x7f06ec1f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06d00052e0 0x7f06ec1f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 -- 172.21.15.81:0/845014160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec153b50 con 0x7f06ec0aec60 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06e9e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06d00052e0 0x7f06ec1f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.641+0000 7f06ea800640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06ec0aec60 0x7f06ec06fb00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009f10 tx=0x7f06e4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.642+0000 7f06e2000640 1 -- 172.21.15.81:0/845014160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4038040 con 0x7f06ec0aec60 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.642+0000 7f06e2000640 1 -- 172.21.15.81:0/845014160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e402b670 con 0x7f06ec0aec60 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.642+0000 7f06e2000640 1 -- 172.21.15.81:0/845014160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4004d60 con 0x7f06ec0aec60 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.642+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec1f4f40 con 0x7f06ec0aec60 2024-09-10T20:39:49.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.642+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec1f5500 con 0x7f06ec0aec60 2024-09-10T20:39:49.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.643+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec0b2400 con 0x7f06ec0aec60 2024-09-10T20:39:49.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.644+0000 7f06e2000640 1 -- 172.21.15.81:0/845014160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f06e403b070 con 0x7f06ec0aec60 2024-09-10T20:39:49.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.645+0000 7f06e2000640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f06cc077fa0 0x7f06cc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:49.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.645+0000 7f06e2000640 1 -- 172.21.15.81:0/845014160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f06e40b94d0 con 0x7f06ec0aec60 2024-09-10T20:39:49.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.645+0000 7f06e9e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f06cc077fa0 0x7f06cc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:49.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.646+0000 7f06e9e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f06cc077fa0 0x7f06cc07a460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f06dc001eb0 tx=0x7f06dc000ff0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:49.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.649+0000 7f06e2000640 1 -- 172.21.15.81:0/845014160 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f06e404a060 con 0x7f06ec0aec60 2024-09-10T20:39:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.838+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f06ec15eec0 con 0x7f06ec0aec60 2024-09-10T20:39:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.838+0000 7f06e2000640 1 -- 172.21.15.81:0/845014160 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f06e40823b0 con 0x7f06ec0aec60 2024-09-10T20:39:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:49.843 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-10T20:39:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:39:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-10T20:39:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-10T20:39:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:39:49.843 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-10T20:39:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f06cc077fa0 msgr2=0x7f06cc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f06cc077fa0 0x7f06cc07a460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f06dc001eb0 tx=0x7f06dc000ff0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06ec0aec60 msgr2=0x7f06ec06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06ec0aec60 0x7f06ec06fb00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f06e4009f10 tx=0x7f06e4033670 comp rx=0 tx=0).stop 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 shutdown_connections 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f06cc077fa0 0x7f06cc07a460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06ec0aec60 0x7f06ec06fb00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f06ec1f4a40 0x7f06ec153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 --2- 172.21.15.81:0/845014160 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f06d00052e0 0x7f06ec1f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 >> 172.21.15.81:0/845014160 conn(0x7f06ec06cb50 msgr2=0x7f06ec0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 shutdown_connections 2024-09-10T20:39:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:49.841+0000 7f06f0e00640 1 -- 172.21.15.81:0/845014160 wait complete. 2024-09-10T20:39:49.861 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T20:39:49.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T20:39:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.017+0000 7fe98b200640 1 -- 172.21.15.81:0/2506200667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970004d40 msgr2=0x7fe9700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.017+0000 7fe98b200640 1 --2- 172.21.15.81:0/2506200667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970004d40 0x7fe9700051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe984001d50 tx=0x7fe970005830 comp rx=0 tx=0).stop 2024-09-10T20:39:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.017+0000 7fe98a800640 1 -- 172.21.15.81:0/2506200667 reap_dead start 2024-09-10T20:39:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.017+0000 7fe98b200640 1 -- 172.21.15.81:0/2506200667 shutdown_connections 2024-09-10T20:39:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.017+0000 7fe98b200640 1 -- 172.21.15.81:0/2506200667 >> 172.21.15.81:0/2506200667 conn(0x7fe98c06d500 msgr2=0x7fe98c0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.018+0000 7fe98b200640 1 -- 172.21.15.81:0/2506200667 shutdown_connections 2024-09-10T20:39:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.018+0000 7fe98b200640 1 -- 172.21.15.81:0/2506200667 wait complete. 2024-09-10T20:39:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.019+0000 7fe98b200640 1 Processor -- start 2024-09-10T20:39:50.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.019+0000 7fe98b200640 1 -- start start 2024-09-10T20:39:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe98c14c510 0x7fe98c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe98c1f8e20 0x7fe98c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c14c8f0 0x7fe98c0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c15be50 con 0x7fe98c14c8f0 2024-09-10T20:39:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c15bcd0 con 0x7fe98c1f8e20 2024-09-10T20:39:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe98c15bfd0 con 0x7fe98c14c510 2024-09-10T20:39:50.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c14c8f0 0x7fe98c0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c14c8f0 0x7fe98c0add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48754/0 (socket says 172.21.15.81:48754) 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.020+0000 7fe98a800640 1 -- 172.21.15.81:0/2495985101 learned_addr learned my addr 172.21.15.81:0/2495985101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe989400640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe98c1f8e20 0x7fe98c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe989e00640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe98c14c510 0x7fe98c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe98a800640 1 -- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe98c14c510 msgr2=0x7fe98c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe98a800640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe98c14c510 0x7fe98c14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe98a800640 1 -- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe98c1f8e20 msgr2=0x7fe98c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe98a800640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe98c1f8e20 0x7fe98c0ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe98a800640 1 -- 172.21.15.81:0/2495985101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c1f9300 con 0x7fe98c14c8f0 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe98a800640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c14c8f0 0x7fe98c0add90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe984001e70 tx=0x7fe984001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe982000640 1 -- 172.21.15.81:0/2495985101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840060b0 con 0x7fe98c14c8f0 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe982000640 1 -- 172.21.15.81:0/2495985101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe984006250 con 0x7fe98c14c8f0 2024-09-10T20:39:50.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe982000640 1 -- 172.21.15.81:0/2495985101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984006680 con 0x7fe98c14c8f0 2024-09-10T20:39:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.021+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c15db70 con 0x7fe98c14c8f0 2024-09-10T20:39:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.022+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c15e130 con 0x7fe98c14c8f0 2024-09-10T20:39:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.023+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98c0cf4d0 con 0x7fe98c14c8f0 2024-09-10T20:39:50.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.024+0000 7fe982000640 1 -- 172.21.15.81:0/2495985101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe984033480 con 0x7fe98c14c8f0 2024-09-10T20:39:50.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.024+0000 7fe982000640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe96c077f70 0x7fe96c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:50.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.025+0000 7fe982000640 1 -- 172.21.15.81:0/2495985101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe9840b9330 con 0x7fe98c14c8f0 2024-09-10T20:39:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.025+0000 7fe989e00640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe96c077f70 0x7fe96c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:50.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.025+0000 7fe989e00640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe96c077f70 0x7fe96c07a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe97c000fb0 tx=0x7fe97c0067a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:50.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.029+0000 7fe982000640 1 -- 172.21.15.81:0/2495985101 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe98c0cf4d0 con 0x7fe98c14c8f0 2024-09-10T20:39:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.214+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe98c0cec80 con 0x7fe98c14c8f0 2024-09-10T20:39:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.801+0000 7fe982000640 1 -- 172.21.15.81:0/2495985101 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fe984081be0 con 0x7fe98c14c8f0 2024-09-10T20:39:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe96c077f70 msgr2=0x7fe96c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe96c077f70 0x7fe96c07a430 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe97c000fb0 tx=0x7fe97c0067a0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c14c8f0 msgr2=0x7fe98c0add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c14c8f0 0x7fe98c0add90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe984001e70 tx=0x7fe984001a50 comp rx=0 tx=0).stop 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 shutdown_connections 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe96c077f70 0x7fe96c07a430 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe98c14c8f0 0x7fe98c0add90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.803+0000 7fe98b200640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe98c1f8e20 0x7fe98c0ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.804+0000 7fe98b200640 1 --2- 172.21.15.81:0/2495985101 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe98c14c510 0x7fe98c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.804+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 >> 172.21.15.81:0/2495985101 conn(0x7fe98c06d500 msgr2=0x7fe98c151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:50.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.804+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 shutdown_connections 2024-09-10T20:39:50.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.804+0000 7fe98b200640 1 -- 172.21.15.81:0/2495985101 wait complete. 2024-09-10T20:39:50.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T20:39:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 -- 172.21.15.81:0/2807992946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c15fa50 msgr2=0x7f029c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 --2- 172.21.15.81:0/2807992946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c15fa50 0x7f029c15bf30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f029c06e1c0 tx=0x7f029402aa30 comp rx=0 tx=0).stop 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 -- 172.21.15.81:0/2807992946 shutdown_connections 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 --2- 172.21.15.81:0/2807992946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c15fa50 0x7f029c15bf30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 --2- 172.21.15.81:0/2807992946 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f029c0cc160 0x7f029c15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 --2- 172.21.15.81:0/2807992946 >> v2:172.21.15.143:3300/0 conn(0x7f029c0aeea0 0x7f029c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 -- 172.21.15.81:0/2807992946 >> 172.21.15.81:0/2807992946 conn(0x7f029c0cf7e0 msgr2=0x7f029c0cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 -- 172.21.15.81:0/2807992946 shutdown_connections 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.990+0000 7f02a2a00640 1 -- 172.21.15.81:0/2807992946 wait complete. 2024-09-10T20:39:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.992+0000 7f02a2a00640 1 Processor -- start 2024-09-10T20:39:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.992+0000 7f02a2a00640 1 -- start start 2024-09-10T20:39:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f02a2a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f029c0aeea0 0x7f029c15d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f02a2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c0cc160 0x7f029c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f02a2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f029c15fa50 0x7f029c1f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f02a2a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f029c15c800 con 0x7f029c0cc160 2024-09-10T20:39:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f02a2a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f029c15c680 con 0x7f029c15fa50 2024-09-10T20:39:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f02a2a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f029c15c980 con 0x7f029c0aeea0 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f029b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c0cc160 0x7f029c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f029b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c0cc160 0x7f029c1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48764/0 (socket says 172.21.15.81:48764) 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f029b400640 1 -- 172.21.15.81:0/322291352 learned_addr learned my addr 172.21.15.81:0/322291352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f029be00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f029c0aeea0 0x7f029c15d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.993+0000 7f02a0a00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f029c15fa50 0x7f029c1f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f029b400640 1 -- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f029c0aeea0 msgr2=0x7f029c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f029b400640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f029c0aeea0 0x7f029c15d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f029b400640 1 -- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f029c15fa50 msgr2=0x7f029c1f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f029b400640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f029c15fa50 0x7f029c1f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f029b400640 1 -- 172.21.15.81:0/322291352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c15d590 con 0x7f029c0cc160 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f029b400640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c0cc160 0x7f029c1552f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f028800b4a0 tx=0x7f028800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f0293e00640 1 -- 172.21.15.81:0/322291352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288015020 con 0x7f029c0cc160 2024-09-10T20:39:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f0293e00640 1 -- 172.21.15.81:0/322291352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0288011920 con 0x7f029c0cc160 2024-09-10T20:39:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029c1f54e0 con 0x7f029c0cc160 2024-09-10T20:39:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f0293e00640 1 -- 172.21.15.81:0/322291352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288011d70 con 0x7f029c0cc160 2024-09-10T20:39:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.994+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029c157a80 con 0x7f029c0cc160 2024-09-10T20:39:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.995+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f029c0d05b0 con 0x7f029c0cc160 2024-09-10T20:39:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.997+0000 7f0293e00640 1 -- 172.21.15.81:0/322291352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f02880193b0 con 0x7f029c0cc160 2024-09-10T20:39:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.997+0000 7f0293e00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f027c077f70 0x7f027c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.998+0000 7f0293e00640 1 -- 172.21.15.81:0/322291352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f0288099ae0 con 0x7f029c0cc160 2024-09-10T20:39:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.998+0000 7f029be00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f027c077f70 0x7f027c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:50.999+0000 7f029be00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f027c077f70 0x7f027c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f028c009990 tx=0x7f028c009110 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.002+0000 7f0293e00640 1 -- 172.21.15.81:0/322291352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f028801f030 con 0x7f029c0cc160 2024-09-10T20:39:51.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.190+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f029c157f10 con 0x7f029c0cc160 2024-09-10T20:39:51.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.803+0000 7f0293e00640 1 -- 172.21.15.81:0/322291352 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f02880626a0 con 0x7f029c0cc160 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f027c077f70 msgr2=0x7f027c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f027c077f70 0x7f027c07a430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f028c009990 tx=0x7f028c009110 comp rx=0 tx=0).stop 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c0cc160 msgr2=0x7f029c1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c0cc160 0x7f029c1552f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f028800b4a0 tx=0x7f028800b8a0 comp rx=0 tx=0).stop 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 shutdown_connections 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f027c077f70 0x7f027c07a430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f029c15fa50 0x7f029c1f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f029c0cc160 0x7f029c1552f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 --2- 172.21.15.81:0/322291352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f029c0aeea0 0x7f029c15d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 >> 172.21.15.81:0/322291352 conn(0x7f029c0cf7e0 msgr2=0x7f029c0cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 shutdown_connections 2024-09-10T20:39:51.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:51.807+0000 7f02a2a00640 1 -- 172.21.15.81:0/322291352 wait complete. 2024-09-10T20:39:51.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T20:39:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 -- 172.21.15.81:0/304767359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc15c750 msgr2=0x7f3edc0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 --2- 172.21.15.81:0/304767359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc15c750 0x7f3edc0cf780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4005fd0 tx=0x7f3ed402a820 comp rx=0 tx=0).stop 2024-09-10T20:39:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 -- 172.21.15.81:0/304767359 shutdown_connections 2024-09-10T20:39:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 --2- 172.21.15.81:0/304767359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc15c750 0x7f3edc0cf780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 --2- 172.21.15.81:0/304767359 >> v2:172.21.15.143:3300/0 conn(0x7f3edc15b680 0x7f3edc15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 -- 172.21.15.81:0/304767359 >> 172.21.15.81:0/304767359 conn(0x7f3edc06cb50 msgr2=0x7f3edc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 -- 172.21.15.81:0/304767359 shutdown_connections 2024-09-10T20:39:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.002+0000 7f3ee2000640 1 -- 172.21.15.81:0/304767359 wait complete. 2024-09-10T20:39:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.004+0000 7f3ee2000640 1 Processor -- start 2024-09-10T20:39:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.004+0000 7f3ee2000640 1 -- start start 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.004+0000 7f3ee2000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc0741e0 0x7f3edc1f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.004+0000 7f3ee2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc15b680 0x7f3edc0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.004+0000 7f3ee2000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3edc15c750 0x7f3edc0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3ee2000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc0b29e0 con 0x7f3edc15b680 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3ee2000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc0b2860 con 0x7f3edc15c750 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3ee2000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3edc0b2b60 con 0x7f3edc0741e0 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc15b680 0x7f3edc0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc15b680 0x7f3edc0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48770/0 (socket says 172.21.15.81:48770) 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 -- 172.21.15.81:0/242510341 learned_addr learned my addr 172.21.15.81:0/242510341 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edbe00640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3edc15c750 0x7f3edc0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edb400640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc0741e0 0x7f3edc1f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 -- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc0741e0 msgr2=0x7f3edc1f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc0741e0 0x7f3edc1f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 -- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3edc15c750 msgr2=0x7f3edc0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3edc15c750 0x7f3edc0b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 -- 172.21.15.81:0/242510341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc1f6420 con 0x7f3edc15b680 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.005+0000 7f3edaa00640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc15b680 0x7f3edc0ad1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c490 tx=0x7f3ec800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.006+0000 7f3ed3400640 1 -- 172.21.15.81:0/242510341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8016020 con 0x7f3edc15b680 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.006+0000 7f3ed3400640 1 -- 172.21.15.81:0/242510341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ec8012940 con 0x7f3edc15b680 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.006+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3edc1f6140 con 0x7f3edc15b680 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.006+0000 7f3ed3400640 1 -- 172.21.15.81:0/242510341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8012d90 con 0x7f3edc15b680 2024-09-10T20:39:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.006+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3edc1f2610 con 0x7f3edc15b680 2024-09-10T20:39:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.007+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3edc1f2810 con 0x7f3edc15b680 2024-09-10T20:39:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.008+0000 7f3ed3400640 1 -- 172.21.15.81:0/242510341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3ec801b400 con 0x7f3edc15b680 2024-09-10T20:39:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.009+0000 7f3ed3400640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ebc077f70 0x7f3ebc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.009+0000 7f3ed3400640 1 -- 172.21.15.81:0/242510341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f3ec8099d00 con 0x7f3edc15b680 2024-09-10T20:39:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.009+0000 7f3edb400640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ebc077f70 0x7f3ebc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.010+0000 7f3edb400640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ebc077f70 0x7f3ebc07a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009b60 tx=0x7f3ecc005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.014+0000 7f3ed3400640 1 -- 172.21.15.81:0/242510341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3edc1f2810 con 0x7f3edc15b680 2024-09-10T20:39:52.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.230+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3edc0b3010 con 0x7f3edc15b680 2024-09-10T20:39:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.820+0000 7f3ed3400640 1 -- 172.21.15.81:0/242510341 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f3ec8020030 con 0x7f3edc15b680 2024-09-10T20:39:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T20:39:52.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.823+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ebc077f70 msgr2=0x7f3ebc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:52.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.823+0000 7f3ee2000640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ebc077f70 0x7f3ebc07a430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009b60 tx=0x7f3ecc005f90 comp rx=0 tx=0).stop 2024-09-10T20:39:52.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.823+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc15b680 msgr2=0x7f3edc0ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:52.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.823+0000 7f3ee2000640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc15b680 0x7f3edc0ad1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800c490 tx=0x7f3ec800c950 comp rx=0 tx=0).stop 2024-09-10T20:39:52.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.824+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 shutdown_connections 2024-09-10T20:39:52.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.824+0000 7f3ee2000640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ebc077f70 0x7f3ebc07a430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.824+0000 7f3ee2000640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3edc15c750 0x7f3edc0b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.824+0000 7f3ee2000640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3edc15b680 0x7f3edc0ad1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.824+0000 7f3ee2000640 1 --2- 172.21.15.81:0/242510341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3edc0741e0 0x7f3edc1f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.824+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 >> 172.21.15.81:0/242510341 conn(0x7f3edc06cb50 msgr2=0x7f3edc15d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.824+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 shutdown_connections 2024-09-10T20:39:52.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:52.825+0000 7f3ee2000640 1 -- 172.21.15.81:0/242510341 wait complete. 2024-09-10T20:39:52.863 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T20:39:52.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T20:39:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 -- 172.21.15.81:0/2852383420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815b680 msgr2=0x7f9bf815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 --2- 172.21.15.81:0/2852383420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815b680 0x7f9bf815ba60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80cd2b0 tx=0x7f9bec02a980 comp rx=0 tx=0).stop 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 -- 172.21.15.81:0/2852383420 shutdown_connections 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 --2- 172.21.15.81:0/2852383420 >> v2:172.21.15.143:3300/0 conn(0x7f9bf815c750 0x7f9bf80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 --2- 172.21.15.81:0/2852383420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815b680 0x7f9bf815ba60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 -- 172.21.15.81:0/2852383420 >> 172.21.15.81:0/2852383420 conn(0x7f9bf806cb50 msgr2=0x7f9bf806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 -- 172.21.15.81:0/2852383420 shutdown_connections 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.023+0000 7f9c00400640 1 -- 172.21.15.81:0/2852383420 wait complete. 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.025+0000 7f9c00400640 1 Processor -- start 2024-09-10T20:39:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.025+0000 7f9c00400640 1 -- start start 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9c00400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bf80741e0 0x7f9bf815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9c00400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bf815b680 0x7f9bf8154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9c00400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815c750 0x7f9bf81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9c00400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf80b2860 con 0x7f9bf815c750 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9c00400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf80b29e0 con 0x7f9bf80741e0 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9c00400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf80b2b60 con 0x7f9bf815b680 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9bfe400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815c750 0x7f9bf81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9bfe400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815c750 0x7f9bf81581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48780/0 (socket says 172.21.15.81:48780) 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9bfe400640 1 -- 172.21.15.81:0/3921422869 learned_addr learned my addr 172.21.15.81:0/3921422869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9bfda00640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bf80741e0 0x7f9bf815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.026+0000 7f9bfd000640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bf815b680 0x7f9bf8154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bfe400640 1 -- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bf815b680 msgr2=0x7f9bf8154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bfe400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bf815b680 0x7f9bf8154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bfe400640 1 -- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bf80741e0 msgr2=0x7f9bf815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bfe400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bf80741e0 0x7f9bf815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bfe400640 1 -- 172.21.15.81:0/3921422869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf815a730 con 0x7f9bf815c750 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bfe400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815c750 0x7f9bf81581a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b410 tx=0x7f9bf000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bf5600640 1 -- 172.21.15.81:0/3921422869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0015020 con 0x7f9bf815c750 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bf5600640 1 -- 172.21.15.81:0/3921422869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bf0011940 con 0x7f9bf815c750 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9bf5600640 1 -- 172.21.15.81:0/3921422869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0011d90 con 0x7f9bf815c750 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf815a9d0 con 0x7f9bf815c750 2024-09-10T20:39:53.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.027+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf81f54a0 con 0x7f9bf815c750 2024-09-10T20:39:53.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.028+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf80b3100 con 0x7f9bf815c750 2024-09-10T20:39:53.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.029+0000 7f9bf5600640 1 -- 172.21.15.81:0/3921422869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9bf001a400 con 0x7f9bf815c750 2024-09-10T20:39:53.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.030+0000 7f9bf5600640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9bd8077f70 0x7f9bd807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:53.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.030+0000 7f9bf5600640 1 -- 172.21.15.81:0/3921422869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9bf0099d60 con 0x7f9bf815c750 2024-09-10T20:39:53.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.031+0000 7f9bfda00640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9bd8077f70 0x7f9bd807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.031+0000 7f9bfda00640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9bd8077f70 0x7f9bd807a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9bec035000 tx=0x7f9bec03c040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:53.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.034+0000 7f9bf5600640 1 -- 172.21.15.81:0/3921422869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9bf001f020 con 0x7f9bf815c750 2024-09-10T20:39:53.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.230+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f9bf80cc490 con 0x7f9bf815c750 2024-09-10T20:39:53.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.835+0000 7f9bf5600640 1 -- 172.21.15.81:0/3921422869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f9bf0062210 con 0x7f9bf815c750 2024-09-10T20:39:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9bd8077f70 msgr2=0x7f9bd807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9bd8077f70 0x7f9bd807a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9bec035000 tx=0x7f9bec03c040 comp rx=0 tx=0).stop 2024-09-10T20:39:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815c750 msgr2=0x7f9bf81581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815c750 0x7f9bf81581a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000b410 tx=0x7f9bf000b8d0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 shutdown_connections 2024-09-10T20:39:53.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9bd8077f70 0x7f9bd807a430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf815c750 0x7f9bf81581a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bf815b680 0x7f9bf8154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 --2- 172.21.15.81:0/3921422869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bf80741e0 0x7f9bf815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:53.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.838+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 >> 172.21.15.81:0/3921422869 conn(0x7f9bf806cb50 msgr2=0x7f9bf806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:53.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.839+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 shutdown_connections 2024-09-10T20:39:53.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:53.839+0000 7f9c00400640 1 -- 172.21.15.81:0/3921422869 wait complete. 2024-09-10T20:39:53.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T20:39:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.027+0000 7f2378800640 1 -- 172.21.15.81:0/1503654515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 msgr2=0x7f2370140fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.027+0000 7f2378800640 1 --2- 172.21.15.81:0/1503654515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f2370140fc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2360009830 tx=0x7f236002a640 comp rx=0 tx=0).stop 2024-09-10T20:39:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.027+0000 7f2378800640 1 -- 172.21.15.81:0/1503654515 shutdown_connections 2024-09-10T20:39:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.027+0000 7f2378800640 1 --2- 172.21.15.81:0/1503654515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f2370140fc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.027+0000 7f2378800640 1 -- 172.21.15.81:0/1503654515 >> 172.21.15.81:0/1503654515 conn(0x7f23700cf820 msgr2=0x7f23700cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.028+0000 7f2378800640 1 -- 172.21.15.81:0/1503654515 shutdown_connections 2024-09-10T20:39:54.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.028+0000 7f2378800640 1 -- 172.21.15.81:0/1503654515 wait complete. 2024-09-10T20:39:54.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.029+0000 7f2378800640 1 Processor -- start 2024-09-10T20:39:54.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.029+0000 7f2378800640 1 -- start start 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.030+0000 7f2378800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f23701381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.030+0000 7f2378800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23701427c0 0x7f2370155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.030+0000 7f2378800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f237015e3a0 0x7f23701f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.030+0000 7f2378800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23700ae9c0 con 0x7f2370072d00 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.030+0000 7f2378800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f23700ae840 con 0x7f23701427c0 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.030+0000 7f2378800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f23700aeb40 con 0x7f237015e3a0 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.030+0000 7f2375e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f23701381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f23701381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48792/0 (socket says 172.21.15.81:48792) 2024-09-10T20:39:54.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 -- 172.21.15.81:0/1595493361 learned_addr learned my addr 172.21.15.81:0/1595493361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375400640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23701427c0 0x7f2370155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2376800640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f237015e3a0 0x7f23701f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 -- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f237015e3a0 msgr2=0x7f23701f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f237015e3a0 0x7f23701f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 -- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23701427c0 msgr2=0x7f2370155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23701427c0 0x7f2370155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 -- 172.21.15.81:0/1595493361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23701f7fd0 con 0x7f2370072d00 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2375e00640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f23701381c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f236400c450 tx=0x7f236400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f236a000640 1 -- 172.21.15.81:0/1595493361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23640052d0 con 0x7f2370072d00 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f236a000640 1 -- 172.21.15.81:0/1595493361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2364005470 con 0x7f2370072d00 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f236a000640 1 -- 172.21.15.81:0/1595493361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364012870 con 0x7f2370072d00 2024-09-10T20:39:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.031+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23701f82b0 con 0x7f2370072d00 2024-09-10T20:39:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.032+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23701f8870 con 0x7f2370072d00 2024-09-10T20:39:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.032+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2370069f40 con 0x7f2370072d00 2024-09-10T20:39:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.034+0000 7f236a000640 1 -- 172.21.15.81:0/1595493361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f23640035f0 con 0x7f2370072d00 2024-09-10T20:39:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.034+0000 7f236a000640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2354077f70 0x7f235407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.035+0000 7f236a000640 1 -- 172.21.15.81:0/1595493361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f23640999f0 con 0x7f2370072d00 2024-09-10T20:39:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.035+0000 7f2375400640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2354077f70 0x7f235407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.036+0000 7f2375400640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2354077f70 0x7f235407a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2360034000 tx=0x7f2360004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:54.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.038+0000 7f236a000640 1 -- 172.21.15.81:0/1595493361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2370069f40 con 0x7f2370072d00 2024-09-10T20:39:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:54.224+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f23700aeff0 con 0x7f2370072d00 2024-09-10T20:39:55.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.839+0000 7f236a000640 1 -- 172.21.15.81:0/1595493361 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f23640623b0 con 0x7f2370072d00 2024-09-10T20:39:55.844 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2024-09-10T20:39:55.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2354077f70 msgr2=0x7f235407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:55.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2354077f70 0x7f235407a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2360034000 tx=0x7f2360004730 comp rx=0 tx=0).stop 2024-09-10T20:39:55.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 msgr2=0x7f23701381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:55.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f23701381c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f236400c450 tx=0x7f236400c910 comp rx=0 tx=0).stop 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 shutdown_connections 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2354077f70 0x7f235407a430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f237015e3a0 0x7f23701f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23701427c0 0x7f2370155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 --2- 172.21.15.81:0/1595493361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2370072d00 0x7f23701381c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.843+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 >> 172.21.15.81:0/1595493361 conn(0x7f23700cf820 msgr2=0x7f237006cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.844+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 shutdown_connections 2024-09-10T20:39:55.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:55.844+0000 7f2378800640 1 -- 172.21.15.81:0/1595493361 wait complete. 2024-09-10T20:39:55.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T20:39:56.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.034+0000 7f5a2d800640 1 -- 172.21.15.81:0/578464534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a280741e0 msgr2=0x7f5a0c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:56.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.034+0000 7f5a2d800640 1 --2- 172.21.15.81:0/578464534 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a280741e0 0x7f5a0c004800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009b80 tx=0x7f5a0c005830 comp rx=0 tx=0).stop 2024-09-10T20:39:56.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.034+0000 7f5a27400640 1 -- 172.21.15.81:0/578464534 reap_dead start 2024-09-10T20:39:56.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.034+0000 7f5a2d800640 1 -- 172.21.15.81:0/578464534 shutdown_connections 2024-09-10T20:39:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.034+0000 7f5a2d800640 1 -- 172.21.15.81:0/578464534 >> 172.21.15.81:0/578464534 conn(0x7f5a2806cb50 msgr2=0x7f5a2806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.034+0000 7f5a2d800640 1 -- 172.21.15.81:0/578464534 shutdown_connections 2024-09-10T20:39:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.034+0000 7f5a2d800640 1 -- 172.21.15.81:0/578464534 wait complete. 2024-09-10T20:39:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.036+0000 7f5a2d800640 1 Processor -- start 2024-09-10T20:39:56.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.036+0000 7f5a2d800640 1 -- start start 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a2d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a280741e0 0x7f5a28154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a2d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a2815d320 0x7f5a2815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a2d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2806eab0 0x7f5a2806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a2d800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2815f860 con 0x7f5a280741e0 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a2d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2815f6e0 con 0x7f5a2815d320 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a2d800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2815f9e0 con 0x7f5a2806eab0 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a280741e0 0x7f5a28154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:56.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a280741e0 0x7f5a28154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52576/0 (socket says 172.21.15.81:52576) 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 -- 172.21.15.81:0/1746855851 learned_addr learned my addr 172.21.15.81:0/1746855851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a1fe00640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a2815d320 0x7f5a2815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a27400640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2806eab0 0x7f5a2806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 -- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2806eab0 msgr2=0x7f5a2806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2806eab0 0x7f5a2806ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 -- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a2815d320 msgr2=0x7f5a2815d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a2815d320 0x7f5a2815d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.037+0000 7f5a26a00640 1 -- 172.21.15.81:0/1746855851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2806f690 con 0x7f5a280741e0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.038+0000 7f5a26a00640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a280741e0 0x7f5a28154230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a18006630 tx=0x7f5a180039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.038+0000 7f5a1ea00640 1 -- 172.21.15.81:0/1746855851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18015020 con 0x7f5a280741e0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.038+0000 7f5a1ea00640 1 -- 172.21.15.81:0/1746855851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a18011900 con 0x7f5a280741e0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.038+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a2806f970 con 0x7f5a280741e0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.038+0000 7f5a1ea00640 1 -- 172.21.15.81:0/1746855851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18011cd0 con 0x7f5a280741e0 2024-09-10T20:39:56.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.038+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a2806ff30 con 0x7f5a280741e0 2024-09-10T20:39:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.039+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a280cc490 con 0x7f5a280741e0 2024-09-10T20:39:56.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.040+0000 7f5a1ea00640 1 -- 172.21.15.81:0/1746855851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a1801a400 con 0x7f5a280741e0 2024-09-10T20:39:56.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.042+0000 7f5a1ea00640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a04077f70 0x7f5a0407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.042+0000 7f5a1ea00640 1 -- 172.21.15.81:0/1746855851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f5a1809aeb0 con 0x7f5a280741e0 2024-09-10T20:39:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.042+0000 7f5a1fe00640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a04077f70 0x7f5a0407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:56.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.043+0000 7f5a1fe00640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a04077f70 0x7f5a0407a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a10035000 tx=0x7f5a100046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:56.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.047+0000 7f5a1ea00640 1 -- 172.21.15.81:0/1746855851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5a1801f020 con 0x7f5a280741e0 2024-09-10T20:39:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.229+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f5a280cbaf0 con 0x7f5a280741e0 2024-09-10T20:39:56.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.845+0000 7f5a1ea00640 1 -- 172.21.15.81:0/1746855851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f5a18062fa0 con 0x7f5a280741e0 2024-09-10T20:39:56.849 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T20:39:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a04077f70 msgr2=0x7f5a0407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a04077f70 0x7f5a0407a430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a10035000 tx=0x7f5a100046c0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a280741e0 msgr2=0x7f5a28154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a280741e0 0x7f5a28154230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a18006630 tx=0x7f5a180039c0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 shutdown_connections 2024-09-10T20:39:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a04077f70 0x7f5a0407a430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a2806eab0 0x7f5a2806ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a2815d320 0x7f5a2815d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 --2- 172.21.15.81:0/1746855851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a280741e0 0x7f5a28154230 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 >> 172.21.15.81:0/1746855851 conn(0x7f5a2806cb50 msgr2=0x7f5a2815e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 shutdown_connections 2024-09-10T20:39:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:56.848+0000 7f5a2d800640 1 -- 172.21.15.81:0/1746855851 wait complete. 2024-09-10T20:39:56.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T20:39:57.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.044+0000 7fd523e00640 1 -- 172.21.15.81:0/559567090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd508003c80 msgr2=0x7fd508004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:57.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.044+0000 7fd523e00640 1 --2- 172.21.15.81:0/559567090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd508003c80 0x7fd508004080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd514001830 tx=0x7fd508005830 comp rx=0 tx=0).stop 2024-09-10T20:39:57.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.044+0000 7fd523400640 1 -- 172.21.15.81:0/559567090 reap_dead start 2024-09-10T20:39:57.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.044+0000 7fd523e00640 1 -- 172.21.15.81:0/559567090 shutdown_connections 2024-09-10T20:39:57.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.044+0000 7fd523e00640 1 -- 172.21.15.81:0/559567090 >> 172.21.15.81:0/559567090 conn(0x7fd5240cc980 msgr2=0x7fd5240ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:57.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.045+0000 7fd523e00640 1 -- 172.21.15.81:0/559567090 shutdown_connections 2024-09-10T20:39:57.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.045+0000 7fd523e00640 1 -- 172.21.15.81:0/559567090 wait complete. 2024-09-10T20:39:57.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.046+0000 7fd523e00640 1 Processor -- start 2024-09-10T20:39:57.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.046+0000 7fd523e00640 1 -- start start 2024-09-10T20:39:57.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd523e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd508003c80 0x7fd524158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:57.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd523e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5240b1740 0x7fd5241f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:57.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd523e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5241f5550 0x7fd5241f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:57.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd523e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd524074b30 con 0x7fd5240b1740 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd523e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd5240749b0 con 0x7fd508003c80 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd523e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd5240cdad0 con 0x7fd5241f5550 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd51be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5240b1740 0x7fd5241f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd51be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5240b1740 0x7fd5241f29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52604/0 (socket says 172.21.15.81:52604) 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd51be00640 1 -- 172.21.15.81:0/1612143131 learned_addr learned my addr 172.21.15.81:0/1612143131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.047+0000 7fd523400640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5241f5550 0x7fd5241f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd522a00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd508003c80 0x7fd524158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51be00640 1 -- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5241f5550 msgr2=0x7fd5241f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51be00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5241f5550 0x7fd5241f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51be00640 1 -- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd508003c80 msgr2=0x7fd524158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51be00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd508003c80 0x7fd524158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51be00640 1 -- 172.21.15.81:0/1612143131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd524159d40 con 0x7fd5240b1740 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd522a00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd508003c80 0x7fd524158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51be00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5240b1740 0x7fd5241f29e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00e5c0 tx=0x7fd50c00ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51aa00640 1 -- 172.21.15.81:0/1612143131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c015070 con 0x7fd5240b1740 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51aa00640 1 -- 172.21.15.81:0/1612143131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd50c010980 con 0x7fd5240b1740 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd51aa00640 1 -- 172.21.15.81:0/1612143131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c010dd0 con 0x7fd5240b1740 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd524158ca0 con 0x7fd5240b1740 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.048+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd524159260 con 0x7fd5240b1740 2024-09-10T20:39:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.049+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5240ce060 con 0x7fd5240b1740 2024-09-10T20:39:57.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.050+0000 7fd51aa00640 1 -- 172.21.15.81:0/1612143131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd50c011460 con 0x7fd5240b1740 2024-09-10T20:39:57.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.051+0000 7fd51aa00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd500077f70 0x7fd50007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:57.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.051+0000 7fd51aa00640 1 -- 172.21.15.81:0/1612143131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fd50c09a710 con 0x7fd5240b1740 2024-09-10T20:39:57.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.052+0000 7fd522a00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd500077f70 0x7fd50007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:57.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.052+0000 7fd522a00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd500077f70 0x7fd50007a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd514032000 tx=0x7fd514001360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.055+0000 7fd51aa00640 1 -- 172.21.15.81:0/1612143131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd50c062800 con 0x7fd5240b1740 2024-09-10T20:39:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.278+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd5240692a0 con 0x7fd5240b1740 2024-09-10T20:39:57.795 INFO:tasks.ceph.mds.b.smithi143.stderr:2024-09-10T20:39:57.791+0000 7f6102000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:39:57.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.876+0000 7fd51aa00640 1 -- 172.21.15.81:0/1612143131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fd50c067230 con 0x7fd5240b1740 2024-09-10T20:39:57.880 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 4 to fsmap 2024-09-10T20:39:57.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.878+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd500077f70 msgr2=0x7fd50007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.878+0000 7fd523e00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd500077f70 0x7fd50007a430 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd514032000 tx=0x7fd514001360 comp rx=0 tx=0).stop 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.878+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5240b1740 msgr2=0x7fd5241f29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.878+0000 7fd523e00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5240b1740 0x7fd5241f29e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00e5c0 tx=0x7fd50c00ea80 comp rx=0 tx=0).stop 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 shutdown_connections 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd500077f70 0x7fd50007a430 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5241f5550 0x7fd5241f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5240b1740 0x7fd5241f29e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 --2- 172.21.15.81:0/1612143131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd508003c80 0x7fd524158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 >> 172.21.15.81:0/1612143131 conn(0x7fd5240cc980 msgr2=0x7fd52406d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 shutdown_connections 2024-09-10T20:39:57.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:57.879+0000 7fd523e00640 1 -- 172.21.15.81:0/1612143131 wait complete. 2024-09-10T20:39:57.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:39:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 -- 172.21.15.81:0/106604075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 msgr2=0x7f9b880b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 --2- 172.21.15.81:0/106604075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b880b21c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b8808dd80 tx=0x7f9b7802a4a0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 -- 172.21.15.81:0/106604075 shutdown_connections 2024-09-10T20:39:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 --2- 172.21.15.81:0/106604075 >> v2:172.21.15.143:3300/0 conn(0x7f9b8806d060 0x7f9b8806d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 --2- 172.21.15.81:0/106604075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b880b21c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 -- 172.21.15.81:0/106604075 >> 172.21.15.81:0/106604075 conn(0x7f9b880d3ab0 msgr2=0x7f9b880d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 -- 172.21.15.81:0/106604075 shutdown_connections 2024-09-10T20:39:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.053+0000 7f9b87e00640 1 -- 172.21.15.81:0/106604075 wait complete. 2024-09-10T20:39:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.054+0000 7f9b87e00640 1 Processor -- start 2024-09-10T20:39:58.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.055+0000 7f9b87e00640 1 -- start start 2024-09-10T20:39:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.055+0000 7f9b87e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8806d060 0x7f9b8809fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.055+0000 7f9b87e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8806e0a0 0x7f9b880a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.055+0000 7f9b87e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b8814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.055+0000 7f9b87e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8806f170 con 0x7f9b88161140 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.055+0000 7f9b87e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8806eff0 con 0x7f9b8806d060 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.055+0000 7f9b87e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9b88161520 con 0x7f9b8806e0a0 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b8814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b8814d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52624/0 (socket says 172.21.15.81:52624) 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 -- 172.21.15.81:0/4040759501 learned_addr learned my addr 172.21.15.81:0/4040759501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b86a00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8806d060 0x7f9b8809fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b7fe00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8806e0a0 0x7f9b880a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 -- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8806e0a0 msgr2=0x7f9b880a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8806e0a0 0x7f9b880a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 -- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8806d060 msgr2=0x7f9b8809fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8806d060 0x7f9b8809fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 -- 172.21.15.81:0/4040759501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8814d740 con 0x7f9b88161140 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b86a00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8806d060 0x7f9b8809fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b7fe00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8806e0a0 0x7f9b880a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.056+0000 7f9b87400640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b8814d200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000da70 tx=0x7f9b8000df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.057+0000 7f9b7ea00640 1 -- 172.21.15.81:0/4040759501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80017070 con 0x7f9b88161140 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.057+0000 7f9b7ea00640 1 -- 172.21.15.81:0/4040759501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b80003970 con 0x7f9b88161140 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.057+0000 7f9b7ea00640 1 -- 172.21.15.81:0/4040759501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80003dc0 con 0x7f9b88161140 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.057+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b880a0220 con 0x7f9b88161140 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.057+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b880a07e0 con 0x7f9b88161140 2024-09-10T20:39:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.058+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8806e850 con 0x7f9b88161140 2024-09-10T20:39:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.059+0000 7f9b7ea00640 1 -- 172.21.15.81:0/4040759501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9b80003f60 con 0x7f9b88161140 2024-09-10T20:39:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.060+0000 7f9b7ea00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b64077fa0 0x7f9b6407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.060+0000 7f9b7ea00640 1 -- 172.21.15.81:0/4040759501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9b8009a5e0 con 0x7f9b88161140 2024-09-10T20:39:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.060+0000 7f9b86a00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b64077fa0 0x7f9b6407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.061+0000 7f9b86a00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b64077fa0 0x7f9b6407a460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9b78034000 tx=0x7f9b78004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:58.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.064+0000 7f9b7ea00640 1 -- 172.21.15.81:0/4040759501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9b80062d00 con 0x7f9b88161140 2024-09-10T20:39:58.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.287+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b880c7150 con 0x7f9b88161140 2024-09-10T20:39:58.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.288+0000 7f9b7ea00640 1 -- 172.21.15.81:0/4040759501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7f9b80062600 con 0x7f9b88161140 2024-09-10T20:39:58.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:58.292 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-10T20:39:57:863867+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:39:57.279554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:39:58.293 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-10T20:39:58.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b64077fa0 msgr2=0x7f9b6407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b64077fa0 0x7f9b6407a460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9b78034000 tx=0x7f9b78004730 comp rx=0 tx=0).stop 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 msgr2=0x7f9b8814d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b8814d200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000da70 tx=0x7f9b8000df30 comp rx=0 tx=0).stop 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 shutdown_connections 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b64077fa0 0x7f9b6407a460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b88161140 0x7f9b8814d200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8806e0a0 0x7f9b880a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 --2- 172.21.15.81:0/4040759501 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8806d060 0x7f9b8809fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 >> 172.21.15.81:0/4040759501 conn(0x7f9b880d3ab0 msgr2=0x7f9b880b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 shutdown_connections 2024-09-10T20:39:58.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.290+0000 7f9b87e00640 1 -- 172.21.15.81:0/4040759501 wait complete. 2024-09-10T20:39:58.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:39:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.465+0000 7fb5af600640 1 -- 172.21.15.81:0/3004136488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c003c80 msgr2=0x7fb58c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.465+0000 7fb5af600640 1 --2- 172.21.15.81:0/3004136488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c003c80 0x7fb58c004080 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb59800c640 tx=0x7fb58c005830 comp rx=0 tx=0).stop 2024-09-10T20:39:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.465+0000 7fb5af600640 1 -- 172.21.15.81:0/3004136488 shutdown_connections 2024-09-10T20:39:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.465+0000 7fb5af600640 1 --2- 172.21.15.81:0/3004136488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c003c80 0x7fb58c004080 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.465+0000 7fb5af600640 1 -- 172.21.15.81:0/3004136488 >> 172.21.15.81:0/3004136488 conn(0x7fb5a806cb50 msgr2=0x7fb5a806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.465+0000 7fb5af600640 1 -- 172.21.15.81:0/3004136488 shutdown_connections 2024-09-10T20:39:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.465+0000 7fb5af600640 1 -- 172.21.15.81:0/3004136488 wait complete. 2024-09-10T20:39:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.467+0000 7fb5af600640 1 Processor -- start 2024-09-10T20:39:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.467+0000 7fb5af600640 1 -- start start 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5af600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb58c003c80 0x7fb5a81f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5af600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a8154210 0x7fb5a815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5af600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5a8155d30 0x7fb5a806f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5af600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a815f650 con 0x7fb5a8154210 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5af600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a815f4d0 con 0x7fb58c003c80 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5af600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a815f7d0 con 0x7fb5a8155d30 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a8154210 0x7fb5a815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a8154210 0x7fb5a815aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52638/0 (socket says 172.21.15.81:52638) 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 -- 172.21.15.81:0/977796074 learned_addr learned my addr 172.21.15.81:0/977796074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5acc00640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb58c003c80 0x7fb5a81f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5ad600640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5a8155d30 0x7fb5a806f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 -- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5a8155d30 msgr2=0x7fb5a806f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5a8155d30 0x7fb5a806f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 -- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb58c003c80 msgr2=0x7fb5a81f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb58c003c80 0x7fb5a81f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.468+0000 7fb5a7e00640 1 -- 172.21.15.81:0/977796074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a81f4be0 con 0x7fb5a8154210 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.469+0000 7fb5a7e00640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a8154210 0x7fb5a815aa90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb594011930 tx=0x7fb594011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.469+0000 7fb5a4c00640 1 -- 172.21.15.81:0/977796074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59400fe10 con 0x7fb5a8154210 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.469+0000 7fb5a4c00640 1 -- 172.21.15.81:0/977796074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb594004030 con 0x7fb5a8154210 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.469+0000 7fb5a4c00640 1 -- 172.21.15.81:0/977796074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594004440 con 0x7fb5a8154210 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.469+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a81566f0 con 0x7fb5a8154210 2024-09-10T20:39:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.469+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81f4ea0 con 0x7fb5a8154210 2024-09-10T20:39:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.470+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a80cf7d0 con 0x7fb5a8154210 2024-09-10T20:39:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.471+0000 7fb5a4c00640 1 -- 172.21.15.81:0/977796074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb5940035f0 con 0x7fb5a8154210 2024-09-10T20:39:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.472+0000 7fb5a4c00640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb588077fa0 0x7fb58807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.472+0000 7fb5a4c00640 1 -- 172.21.15.81:0/977796074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb59409ae90 con 0x7fb5a8154210 2024-09-10T20:39:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.472+0000 7fb5acc00640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb588077fa0 0x7fb58807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.473+0000 7fb5acc00640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb588077fa0 0x7fb58807a460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb598033000 tx=0x7fb5a81601b0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:58.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.476+0000 7fb5a4c00640 1 -- 172.21.15.81:0/977796074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb594062f60 con 0x7fb5a8154210 2024-09-10T20:39:58.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.665+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5a80cc490 con 0x7fb5a8154210 2024-09-10T20:39:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.666+0000 7fb5a4c00640 1 -- 172.21.15.81:0/977796074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7fb59409c090 con 0x7fb5a8154210 2024-09-10T20:39:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:58.671 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.668+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb588077fa0 msgr2=0x7fb58807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.668+0000 7fb5af600640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb588077fa0 0x7fb58807a460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb598033000 tx=0x7fb5a81601b0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.668+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a8154210 msgr2=0x7fb5a815aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.668+0000 7fb5af600640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a8154210 0x7fb5a815aa90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb594011930 tx=0x7fb594011df0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 shutdown_connections 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb588077fa0 0x7fb58807a460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb5a8155d30 0x7fb5a806f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a8154210 0x7fb5a815aa90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 --2- 172.21.15.81:0/977796074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb58c003c80 0x7fb5a81f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 >> 172.21.15.81:0/977796074 conn(0x7fb5a806cb50 msgr2=0x7fb5a8072450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 shutdown_connections 2024-09-10T20:39:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.669+0000 7fb5af600640 1 -- 172.21.15.81:0/977796074 wait complete. 2024-09-10T20:39:58.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.841+0000 7f3bde400640 1 -- 172.21.15.81:0/2465772022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd806eb60 msgr2=0x7f3bd806efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.841+0000 7f3bde400640 1 --2- 172.21.15.81:0/2465772022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd806eb60 0x7f3bd806efd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0005fd0 tx=0x7f3bd002ab20 comp rx=0 tx=0).stop 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.842+0000 7f3bde400640 1 -- 172.21.15.81:0/2465772022 shutdown_connections 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.842+0000 7f3bde400640 1 --2- 172.21.15.81:0/2465772022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd806eb60 0x7f3bd806efd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.842+0000 7f3bde400640 1 --2- 172.21.15.81:0/2465772022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd815b4d0 0x7f3bd815ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.842+0000 7f3bde400640 1 -- 172.21.15.81:0/2465772022 >> 172.21.15.81:0/2465772022 conn(0x7f3bd806cb50 msgr2=0x7f3bd806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.842+0000 7f3bde400640 1 -- 172.21.15.81:0/2465772022 shutdown_connections 2024-09-10T20:39:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.842+0000 7f3bde400640 1 -- 172.21.15.81:0/2465772022 wait complete. 2024-09-10T20:39:58.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.843+0000 7f3bde400640 1 Processor -- start 2024-09-10T20:39:58.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.843+0000 7f3bde400640 1 -- start start 2024-09-10T20:39:58.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bde400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd806eb60 0x7f3bd80cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bde400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd80cf810 0x7f3bd80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bde400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd815b4d0 0x7f3bd80b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bde400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80b2da0 con 0x7f3bd815b4d0 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bde400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80b2c20 con 0x7f3bd80cf810 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bde400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd80b2f20 con 0x7f3bd806eb60 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bd7400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd806eb60 0x7f3bd80cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bd7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd815b4d0 0x7f3bd80b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bd7400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd806eb60 0x7f3bd80cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:52478/0 (socket says 172.21.15.81:52478) 2024-09-10T20:39:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.844+0000 7f3bd7400640 1 -- 172.21.15.81:0/1308196849 learned_addr learned my addr 172.21.15.81:0/1308196849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd6a00640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd80cf810 0x7f3bd80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd7e00640 1 -- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd806eb60 msgr2=0x7f3bd80cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd7e00640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd806eb60 0x7f3bd80cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd7e00640 1 -- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd80cf810 msgr2=0x7f3bd80c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd7e00640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd80cf810 0x7f3bd80c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd7e00640 1 -- 172.21.15.81:0/1308196849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd80c4d10 con 0x7f3bd815b4d0 2024-09-10T20:39:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd7400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd806eb60 0x7f3bd80cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:39:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bd7e00640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd815b4d0 0x7f3bd80b0c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0032000 tx=0x7f3bd0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bcf400640 1 -- 172.21.15.81:0/1308196849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0044070 con 0x7f3bd815b4d0 2024-09-10T20:39:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bcf400640 1 -- 172.21.15.81:0/1308196849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bd0003e00 con 0x7f3bd815b4d0 2024-09-10T20:39:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bcf400640 1 -- 172.21.15.81:0/1308196849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00044b0 con 0x7f3bd815b4d0 2024-09-10T20:39:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.845+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd8147ec0 con 0x7f3bd815b4d0 2024-09-10T20:39:58.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.846+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd81452d0 con 0x7f3bd815b4d0 2024-09-10T20:39:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.847+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd80b3440 con 0x7f3bd815b4d0 2024-09-10T20:39:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.848+0000 7f3bcf400640 1 -- 172.21.15.81:0/1308196849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3bd0004650 con 0x7f3bd815b4d0 2024-09-10T20:39:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.849+0000 7f3bcf400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3bb8077fa0 0x7f3bb807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.849+0000 7f3bcf400640 1 -- 172.21.15.81:0/1308196849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3bd00ba890 con 0x7f3bd815b4d0 2024-09-10T20:39:58.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.849+0000 7f3bd7400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3bb8077fa0 0x7f3bb807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:58.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.850+0000 7f3bd7400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3bb8077fa0 0x7f3bb807a460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8011440 tx=0x7f3bc8005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:58.853+0000 7f3bcf400640 1 -- 172.21.15.81:0/1308196849 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3bd0032030 con 0x7f3bd815b4d0 2024-09-10T20:39:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.038+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bd80b4750 con 0x7f3bd815b4d0 2024-09-10T20:39:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.039+0000 7f3bcf400640 1 -- 172.21.15.81:0/1308196849 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7f3bd00828d0 con 0x7f3bd815b4d0 2024-09-10T20:39:59.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:59.044 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3bb8077fa0 msgr2=0x7f3bb807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3bb8077fa0 0x7f3bb807a460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8011440 tx=0x7f3bc8005f90 comp rx=0 tx=0).stop 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd815b4d0 msgr2=0x7f3bd80b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd815b4d0 0x7f3bd80b0c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0032000 tx=0x7f3bd0003c10 comp rx=0 tx=0).stop 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 shutdown_connections 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3bb8077fa0 0x7f3bb807a460 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd815b4d0 0x7f3bd80b0c60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3bd80cf810 0x7f3bd80c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 --2- 172.21.15.81:0/1308196849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3bd806eb60 0x7f3bd80cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 >> 172.21.15.81:0/1308196849 conn(0x7f3bd806cb50 msgr2=0x7f3bd80734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 shutdown_connections 2024-09-10T20:39:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.042+0000 7f3bde400640 1 -- 172.21.15.81:0/1308196849 wait complete. 2024-09-10T20:39:59.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.234+0000 7f8cd4a00640 1 -- 172.21.15.81:0/2553496868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00b5510 msgr2=0x7f8cd00b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.234+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/2553496868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00b5510 0x7f8cd00b5970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00d36d0 tx=0x7f8cc802a5f0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.234+0000 7f8cd4a00640 1 -- 172.21.15.81:0/2553496868 shutdown_connections 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.234+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/2553496868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00b5510 0x7f8cd00b5970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.234+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/2553496868 >> v2:172.21.15.143:3300/0 conn(0x7f8cd00cecb0 0x7f8cd00b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.234+0000 7f8cd4a00640 1 -- 172.21.15.81:0/2553496868 >> 172.21.15.81:0/2553496868 conn(0x7f8cd008d460 msgr2=0x7f8cd009cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.234+0000 7f8cd4a00640 1 -- 172.21.15.81:0/2553496868 shutdown_connections 2024-09-10T20:39:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.235+0000 7f8cd4a00640 1 -- 172.21.15.81:0/2553496868 wait complete. 2024-09-10T20:39:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.236+0000 7f8cd4a00640 1 Processor -- start 2024-09-10T20:39:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.236+0000 7f8cd4a00640 1 -- start start 2024-09-10T20:39:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8cd4a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cd00b5510 0x7f8cd00b9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8cd4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00cecb0 0x7f8cd01614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8cd4a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cd015d8a0 0x7f8cd01619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8cd4a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00d04a0 con 0x7f8cd00cecb0 2024-09-10T20:39:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8cd4a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00d0320 con 0x7f8cd00b5510 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8cd4a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd00d0620 con 0x7f8cd015d8a0 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8ccde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00cecb0 0x7f8cd01614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8ccde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00cecb0 0x7f8cd01614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52670/0 (socket says 172.21.15.81:52670) 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8ccde00640 1 -- 172.21.15.81:0/767703262 learned_addr learned my addr 172.21.15.81:0/767703262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.237+0000 7f8cce800640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cd00b5510 0x7f8cd00b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8ccf200640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cd015d8a0 0x7f8cd01619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8ccde00640 1 -- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cd015d8a0 msgr2=0x7f8cd01619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8ccde00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cd015d8a0 0x7f8cd01619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8ccde00640 1 -- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cd00b5510 msgr2=0x7f8cd00b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8ccde00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cd00b5510 0x7f8cd00b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8ccde00640 1 -- 172.21.15.81:0/767703262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd015e340 con 0x7f8cd00cecb0 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8ccde00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00cecb0 0x7f8cd01614a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00e9f0 tx=0x7f8cbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8cc6a00640 1 -- 172.21.15.81:0/767703262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00ccc0 con 0x7f8cd00cecb0 2024-09-10T20:39:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8cc6a00640 1 -- 172.21.15.81:0/767703262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cbc010430 con 0x7f8cd00cecb0 2024-09-10T20:39:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8cc6a00640 1 -- 172.21.15.81:0/767703262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc010840 con 0x7f8cd00cecb0 2024-09-10T20:39:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd01f47f0 con 0x7f8cd00cecb0 2024-09-10T20:39:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.238+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd01f4db0 con 0x7f8cd00cecb0 2024-09-10T20:39:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.239+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd00b5970 con 0x7f8cd00cecb0 2024-09-10T20:39:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.241+0000 7f8cc6a00640 1 -- 172.21.15.81:0/767703262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8cbc0109e0 con 0x7f8cd00cecb0 2024-09-10T20:39:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.241+0000 7f8cc6a00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cb0077f70 0x7f8cb007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.242+0000 7f8cc6a00640 1 -- 172.21.15.81:0/767703262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8cbc09abc0 con 0x7f8cd00cecb0 2024-09-10T20:39:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.242+0000 7f8cce800640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cb0077f70 0x7f8cb007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.243+0000 7f8cce800640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cb0077f70 0x7f8cb007a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0001e20 tx=0x7f8cc0009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:59.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.245+0000 7f8cc6a00640 1 -- 172.21.15.81:0/767703262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8cd015e340 con 0x7f8cd00cecb0 2024-09-10T20:39:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.463+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cd00b35c0 con 0x7f8cd00cecb0 2024-09-10T20:39:59.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.464+0000 7f8cc6a00640 1 -- 172.21.15.81:0/767703262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7f8cbc062c90 con 0x7f8cd00cecb0 2024-09-10T20:39:59.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:59.468 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-10T20:39:57:863867+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:39:57.279554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:39:59.468 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cb0077f70 msgr2=0x7f8cb007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cb0077f70 0x7f8cb007a430 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0001e20 tx=0x7f8cc0009040 comp rx=0 tx=0).stop 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00cecb0 msgr2=0x7f8cd01614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00cecb0 0x7f8cd01614a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00e9f0 tx=0x7f8cbc00eeb0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 shutdown_connections 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cb0077f70 0x7f8cb007a430 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8cd015d8a0 0x7f8cd01619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cd00cecb0 0x7f8cd01614a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 --2- 172.21.15.81:0/767703262 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8cd00b5510 0x7f8cd00b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 >> 172.21.15.81:0/767703262 conn(0x7f8cd008d460 msgr2=0x7f8cd00ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 shutdown_connections 2024-09-10T20:39:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.466+0000 7f8cd4a00640 1 -- 172.21.15.81:0/767703262 wait complete. 2024-09-10T20:39:59.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.639+0000 7f7095600640 1 -- 172.21.15.81:0/2880825859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 msgr2=0x7f70900cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.639+0000 7f7095600640 1 --2- 172.21.15.81:0/2880825859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f70900cf780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7088005fd0 tx=0x7f708802aa00 comp rx=0 tx=0).stop 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.640+0000 7f7095600640 1 -- 172.21.15.81:0/2880825859 shutdown_connections 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.640+0000 7f7095600640 1 --2- 172.21.15.81:0/2880825859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f70900cf780 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.640+0000 7f7095600640 1 --2- 172.21.15.81:0/2880825859 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70900741e0 0x7f709015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.640+0000 7f7095600640 1 -- 172.21.15.81:0/2880825859 >> 172.21.15.81:0/2880825859 conn(0x7f709006cb50 msgr2=0x7f709006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.640+0000 7f7095600640 1 -- 172.21.15.81:0/2880825859 shutdown_connections 2024-09-10T20:39:59.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.640+0000 7f7095600640 1 -- 172.21.15.81:0/2880825859 wait complete. 2024-09-10T20:39:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.641+0000 7f7095600640 1 Processor -- start 2024-09-10T20:39:59.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.641+0000 7f7095600640 1 -- start start 2024-09-10T20:39:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.642+0000 7f7095600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70900741e0 0x7f70900b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.642+0000 7f7095600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f709015b680 0x7f709006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.642+0000 7f7095600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f709006f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.642+0000 7f7095600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70900b29e0 con 0x7f709015c750 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.642+0000 7f7095600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f70900b2860 con 0x7f709015b680 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.642+0000 7f7095600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f70900b2b60 con 0x7f70900741e0 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f709006f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708ea00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70900741e0 0x7f70900b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f709006f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52686/0 (socket says 172.21.15.81:52686) 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 -- 172.21.15.81:0/141346989 learned_addr learned my addr 172.21.15.81:0/141346989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708e000640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f709015b680 0x7f709006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 -- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70900741e0 msgr2=0x7f70900b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70900741e0 0x7f70900b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 -- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f709015b680 msgr2=0x7f709006f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f709015b680 0x7f709006f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 -- 172.21.15.81:0/141346989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70900b1500 con 0x7f709015c750 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f708f400640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f709006f5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7088006010 tx=0x7f7088003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.643+0000 7f7086a00640 1 -- 172.21.15.81:0/141346989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088046070 con 0x7f709015c750 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.644+0000 7f7086a00640 1 -- 172.21.15.81:0/141346989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7088004540 con 0x7f709015c750 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.644+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70900b17a0 con 0x7f709015c750 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.644+0000 7f7086a00640 1 -- 172.21.15.81:0/141346989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088033070 con 0x7f709015c750 2024-09-10T20:39:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.644+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70900b11b0 con 0x7f709015c750 2024-09-10T20:39:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.645+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70900af220 con 0x7f709015c750 2024-09-10T20:39:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.646+0000 7f7086a00640 1 -- 172.21.15.81:0/141346989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7088040030 con 0x7f709015c750 2024-09-10T20:39:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.646+0000 7f7086a00640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7070077f70 0x7f707007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:39:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.647+0000 7f7086a00640 1 -- 172.21.15.81:0/141346989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f70880baff0 con 0x7f709015c750 2024-09-10T20:39:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.647+0000 7f708ea00640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7070077f70 0x7f707007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:39:59.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.648+0000 7f708ea00640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7070077f70 0x7f707007a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70800017f0 tx=0x7f7080009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:39:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.651+0000 7f7086a00640 1 -- 172.21.15.81:0/141346989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f708803e070 con 0x7f709015c750 2024-09-10T20:39:59.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.837+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70900b3100 con 0x7f709015c750 2024-09-10T20:39:59.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.839+0000 7f7086a00640 1 -- 172.21.15.81:0/141346989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7f70880830c0 con 0x7f709015c750 2024-09-10T20:39:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:39:59.843 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:39:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7070077f70 msgr2=0x7f707007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7070077f70 0x7f707007a430 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f70800017f0 tx=0x7f7080009040 comp rx=0 tx=0).stop 2024-09-10T20:39:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 msgr2=0x7f709006f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:39:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f709006f5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7088006010 tx=0x7f7088003f10 comp rx=0 tx=0).stop 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 shutdown_connections 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7070077f70 0x7f707007a430 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f709015c750 0x7f709006f5f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f709015b680 0x7f709006f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 --2- 172.21.15.81:0/141346989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70900741e0 0x7f70900b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 >> 172.21.15.81:0/141346989 conn(0x7f709006cb50 msgr2=0x7f7090072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 shutdown_connections 2024-09-10T20:39:59.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:39:59.841+0000 7f7095600640 1 -- 172.21.15.81:0/141346989 wait complete. 2024-09-10T20:40:00.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:39:52.231273+0000', 'modified': '2024-09-10T20:39:57.279554+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4381': {'gid': 4381, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/3994739210', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6835', 'nonce': 3994739210}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3994739210}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4381, 'qdb_cluster': [4381]} 2024-09-10T20:40:00.267 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T20:40:00.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T20:40:00.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.425+0000 7f18e9c00640 1 -- 172.21.15.81:0/1700822142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c8004800 msgr2=0x7f18c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.425+0000 7f18e9c00640 1 --2- 172.21.15.81:0/1700822142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18c8004800 0x7f18c8004c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f18e40745c0 tx=0x7f18c8005830 comp rx=0 tx=0).stop 2024-09-10T20:40:00.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.425+0000 7f18e3400640 1 -- 172.21.15.81:0/1700822142 reap_dead start 2024-09-10T20:40:00.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.425+0000 7f18e9c00640 1 -- 172.21.15.81:0/1700822142 shutdown_connections 2024-09-10T20:40:00.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.425+0000 7f18e9c00640 1 -- 172.21.15.81:0/1700822142 >> 172.21.15.81:0/1700822142 conn(0x7f18e406cb50 msgr2=0x7f18e406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.425+0000 7f18e9c00640 1 -- 172.21.15.81:0/1700822142 shutdown_connections 2024-09-10T20:40:00.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.425+0000 7f18e9c00640 1 -- 172.21.15.81:0/1700822142 wait complete. 2024-09-10T20:40:00.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.427+0000 7f18e9c00640 1 Processor -- start 2024-09-10T20:40:00.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.427+0000 7f18e9c00640 1 -- start start 2024-09-10T20:40:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e9c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18c8004800 0x7f18e4158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e9c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e41590b0 0x7f18e41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e9c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e414eab0 0x7f18e4151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e9c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18e415f920 con 0x7f18e414eab0 2024-09-10T20:40:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e9c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f18e415f7a0 con 0x7f18e41590b0 2024-09-10T20:40:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e9c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f18e415faa0 con 0x7f18c8004800 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e414eab0 0x7f18e4151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e414eab0 0x7f18e4151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52716/0 (socket says 172.21.15.81:52716) 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 -- 172.21.15.81:0/2246919308 learned_addr learned my addr 172.21.15.81:0/2246919308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e2000640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e41590b0 0x7f18e41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e2a00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18c8004800 0x7f18e4158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 -- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18c8004800 msgr2=0x7f18e4158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18c8004800 0x7f18e4158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 -- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e41590b0 msgr2=0x7f18e41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e41590b0 0x7f18e41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e3400640 1 -- 172.21.15.81:0/2246919308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e414f050 con 0x7f18e414eab0 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.428+0000 7f18e2a00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18c8004800 0x7f18e4158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:00.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.429+0000 7f18e3400640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e414eab0 0x7f18e4151a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18e40cd280 tx=0x7f18dc001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.429+0000 7f18daa00640 1 -- 172.21.15.81:0/2246919308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc011430 con 0x7f18e414eab0 2024-09-10T20:40:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.429+0000 7f18daa00640 1 -- 172.21.15.81:0/2246919308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18dc0115d0 con 0x7f18e414eab0 2024-09-10T20:40:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.429+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e4150a10 con 0x7f18e414eab0 2024-09-10T20:40:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.429+0000 7f18daa00640 1 -- 172.21.15.81:0/2246919308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc011a20 con 0x7f18e414eab0 2024-09-10T20:40:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.429+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e4150fd0 con 0x7f18e414eab0 2024-09-10T20:40:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.431+0000 7f18daa00640 1 -- 172.21.15.81:0/2246919308 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f18dc011bc0 con 0x7f18e414eab0 2024-09-10T20:40:00.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.432+0000 7f18daa00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f18c0077f70 0x7f18c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.432+0000 7f18daa00640 1 -- 172.21.15.81:0/2246919308 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f18dc09a780 con 0x7f18e414eab0 2024-09-10T20:40:00.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.432+0000 7f18eca8e740 1 Processor -- start 2024-09-10T20:40:00.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.432+0000 7f18e2a00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f18c0077f70 0x7f18c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18eca8e740 1 -- start start 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18e2a00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f18c0077f70 0x7f18c007a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006fd0 tx=0x7f18d4006b20 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c19374f20 0x560c193a0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374000 0x560c193a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18eca8e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560c192fd430 con 0x560c19374000 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560c192ed5d0 con 0x560c193bf8b0 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.433+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560c192dca00 con 0x560c19374f20 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374000 0x560c193a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374000 0x560c193a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52718/0 (socket says 172.21.15.81:52718) 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 -- 172.21.15.81:0/1162071458 learned_addr learned my addr 172.21.15.81:0/1162071458 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e2a00640 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e2000640 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c19374f20 0x560c193a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 -- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c19374f20 msgr2=0x560c193a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c19374f20 0x560c193a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 -- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 msgr2=0x560c193bfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 -- 172.21.15.81:0/1162071458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c192a5520 con 0x560c19374000 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18e3400640 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374000 0x560c193a0b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0626a0 tx=0x7f18dc0621a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1cc440ecc278c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18d3400640 1 -- 172.21.15.81:0/1162071458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc062360 con 0x560c19374000 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18d3400640 1 -- 172.21.15.81:0/1162071458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18dc062850 con 0x560c19374000 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.434+0000 7f18d3400640 1 -- 172.21.15.81:0/1162071458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc061cb0 con 0x560c19374000 2024-09-10T20:40:00.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 -- 172.21.15.81:0/1162071458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374000 msgr2=0x560c193a0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374000 0x560c193a0b50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f18dc0626a0 tx=0x7f18dc0621a0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 -- 172.21.15.81:0/1162071458 shutdown_connections 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374000 0x560c193a0b50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c19374f20 0x560c193a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1162071458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 -- 172.21.15.81:0/1162071458 >> 172.21.15.81:0/1162071458 conn(0x560c19375ff0 msgr2=0x560c19379a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 -- 172.21.15.81:0/1162071458 shutdown_connections 2024-09-10T20:40:00.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.435+0000 7f18eca8e740 1 -- 172.21.15.81:0/1162071458 wait complete. 2024-09-10T20:40:00.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.436+0000 7f18eca8e740 1 -- start start 2024-09-10T20:40:00.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.436+0000 7f18eca8e740 1 Processor -- start 2024-09-10T20:40:00.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 0x560c193b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c193bf8b0 0x560c193bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18eca8e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560c19283330 con 0x560c193bf8b0 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560c192e0810 con 0x560c19374f20 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560c1904d620 con 0x560c1939bca0 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18eca8e740 10 client.0 _ll_register_callbacks cb 0x560c19288420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18e2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c193bf8b0 0x560c193bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18e2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c193bf8b0 0x560c193bcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52732/0 (socket says 172.21.15.81:52732) 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18e2000640 1 -- 172.21.15.81:0/266467242 learned_addr learned my addr 172.21.15.81:0/266467242 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18e2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 0x560c193b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.437+0000 7f18e3400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18e2000640 1 -- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 msgr2=0x560c193bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18e2000640 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18e2000640 1 -- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 msgr2=0x560c193b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18e2000640 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 0x560c193b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18e2000640 1 -- 172.21.15.81:0/266467242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c1903e850 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18e2000640 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c193bf8b0 0x560c193bcfd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00bac0 tx=0x7f18cc00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154ea7f068acf487 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18c7e00640 1 -- 172.21.15.81:0/266467242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc044070 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18c7e00640 1 -- 172.21.15.81:0/266467242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f18cc0346a0 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18dc062850 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18c7e00640 1 -- 172.21.15.81:0/266467242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f18cc039040 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18eca8e740 10 client.4455 fetch_fsmap learned FSMap version 7 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.438+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560c190b56b0 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18c7e00640 1 -- 172.21.15.81:0/266467242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18dc062850 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18c7e00640 1 -- 172.21.15.81:0/266467242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f18cc054080 con 0x560c193bf8b0 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18eca8e740 10 client.4455 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18eca8e740 10 client.4455 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18eca8e740 20 client.4455 populate_metadata read hostname 'smithi081' 2024-09-10T20:40:00.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18eca8e740 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193de930 0x560c193e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18eca8e740 4 client.4455 mds_command: new command op to 4381 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:40:00.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 --> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c192ef520 con 0x560c193de930 2024-09-10T20:40:00.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.439+0000 7f18e2a00640 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193de930 0x560c193e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.440+0000 7f18e2a00640 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193de930 0x560c193e0d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48c61cbae9f9504d server_cookie=bc19566f5690d8dd in_seq=0 out_seq=0 2024-09-10T20:40:00.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.440+0000 7f18c7e00640 10 client.4455 ms_handle_connect on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:00.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.441+0000 7f18c7e00640 1 -- 172.21.15.81:0/266467242 <== mds.0 v2:172.21.15.143:6835/3994739210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c192ef520 con 0x560c193de930 2024-09-10T20:40:00.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.441+0000 7f18c7e00640 10 client.4455 handle_command_reply: tid=0 2024-09-10T20:40:00.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.441+0000 7f18eca8e740 1 client.4455 shutdown 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c193bf8b0 msgr2=0x560c193bcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c193bf8b0 0x560c193bcfd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00bac0 tx=0x7f18cc00b6a0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 shutdown_connections 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193de930 0x560c193e0d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c193bf8b0 0x560c193bcfd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18c7e00640 0 client.4455 ms_handle_reset on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 --2- 172.21.15.81:0/266467242 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 0x560c193b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 >> 172.21.15.81:0/266467242 conn(0x560c19374000 msgr2=0x560c193a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 shutdown_connections 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 1 -- 172.21.15.81:0/266467242 wait complete. 2024-09-10T20:40:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.442+0000 7f18eca8e740 20 client.4455 trim_cache size 0 max 16384 2024-09-10T20:40:00.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.461+0000 7f18eca8e740 1 Processor -- start 2024-09-10T20:40:00.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.461+0000 7f18eca8e740 1 -- start start 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.461+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 0x560c1939a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c1939bca0 0x560c19374420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c193bf8b0 0x560c193bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18eca8e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18e41fd7d0 con 0x560c1939bca0 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f18e4070440 con 0x560c19374f20 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f18e41f3180 con 0x560c193bf8b0 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c1939bca0 0x560c19374420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c1939bca0 0x560c19374420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52736/0 (socket says 172.21.15.81:52736) 2024-09-10T20:40:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 -- 172.21.15.81:0/1821952432 learned_addr learned my addr 172.21.15.81:0/1821952432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 -- 172.21.15.81:0/1821952432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c193bf8b0 msgr2=0x560c193bcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 --2- 172.21.15.81:0/1821952432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c193bf8b0 0x560c193bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 -- 172.21.15.81:0/1821952432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 msgr2=0x560c1939a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 --2- 172.21.15.81:0/1821952432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 0x560c1939a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 -- 172.21.15.81:0/1821952432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c1939c490 con 0x560c1939bca0 2024-09-10T20:40:00.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.462+0000 7f18e2000640 1 --2- 172.21.15.81:0/1821952432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c1939bca0 0x560c19374420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f18cc005e70 tx=0x7f18cc005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c6c71e515adfa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18d2a00640 1 -- 172.21.15.81:0/1821952432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc044040 con 0x560c1939bca0 2024-09-10T20:40:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18d2a00640 1 -- 172.21.15.81:0/1821952432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18cc042070 con 0x560c1939bca0 2024-09-10T20:40:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18d2a00640 1 -- 172.21.15.81:0/1821952432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0496c0 con 0x560c1939bca0 2024-09-10T20:40:00.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 -- 172.21.15.81:0/1821952432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c1939bca0 msgr2=0x560c19374420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1821952432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c1939bca0 0x560c19374420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f18cc005e70 tx=0x7f18cc005ea0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 -- 172.21.15.81:0/1821952432 shutdown_connections 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1821952432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c193bf8b0 0x560c193bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1821952432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c1939bca0 0x560c19374420 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 --2- 172.21.15.81:0/1821952432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c19374f20 0x560c1939a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 -- 172.21.15.81:0/1821952432 >> 172.21.15.81:0/1821952432 conn(0x560c19374000 msgr2=0x560c193b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 -- 172.21.15.81:0/1821952432 shutdown_connections 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.463+0000 7f18eca8e740 1 -- 172.21.15.81:0/1821952432 wait complete. 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.464+0000 7f18eca8e740 1 -- start start 2024-09-10T20:40:00.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.464+0000 7f18eca8e740 1 Processor -- start 2024-09-10T20:40:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374f20 0x560c194436e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18eca8e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18eca8e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560c19389fe0 con 0x560c19374f20 2024-09-10T20:40:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560c193bde20 con 0x560c193bf8b0 2024-09-10T20:40:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18eca8e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560c193bae10 con 0x560c1939bca0 2024-09-10T20:40:00.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18eca8e740 10 client.0 _ll_register_callbacks cb 0x7f18c800c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18e2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374f20 0x560c194436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18e2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374f20 0x560c194436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52742/0 (socket says 172.21.15.81:52742) 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.465+0000 7f18e2a00640 1 -- 172.21.15.81:0/2498924592 learned_addr learned my addr 172.21.15.81:0/2498924592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e2000640 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e3400640 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e2a00640 1 -- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 msgr2=0x560c193bcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e2a00640 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e2a00640 1 -- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 msgr2=0x560c193bd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e2a00640 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e2a00640 1 -- 172.21.15.81:0/2498924592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c19388ab0 con 0x560c19374f20 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18e2a00640 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374f20 0x560c194436e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x560c193bb2c0 tx=0x7f18e415c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79ca19639fa8921 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:40:00.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18c7e00640 1 -- 172.21.15.81:0/2498924592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4012910 con 0x560c19374f20 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18c7e00640 1 -- 172.21.15.81:0/2498924592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f18d402dc20 con 0x560c19374f20 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18cc042070 con 0x560c19374f20 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.466+0000 7f18c7e00640 1 -- 172.21.15.81:0/2498924592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f18d4038050 con 0x560c19374f20 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 10 client.4461 fetch_fsmap learned FSMap version 7 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560c1937a130 con 0x560c19374f20 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18c7e00640 1 -- 172.21.15.81:0/2498924592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18cc042070 con 0x560c19374f20 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18c7e00640 1 -- 172.21.15.81:0/2498924592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f18d4030070 con 0x560c19374f20 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 10 client.4461 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 10 client.4461 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 20 client.4461 populate_metadata read hostname 'smithi081' 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193a6b10 0x560c19447560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 4 client.4461 mds_command: new command op to 4381 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 --> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] -- command(tid 0: {"prefix": "status"}) -- 0x560c192eafd0 con 0x560c193a6b10 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.467+0000 7f18e2000640 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193a6b10 0x560c19447560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18e2000640 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193a6b10 0x560c19447560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8477bd4790ae6da server_cookie=e2414cf2d1440fd0 in_seq=0 out_seq=0 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18c7e00640 10 client.4461 ms_handle_connect on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18c7e00640 1 -- 172.21.15.81:0/2498924592 <== mds.0 v2:172.21.15.143:6835/3994739210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560c192eafd0 con 0x560c193a6b10 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18c7e00640 10 client.4461 handle_command_reply: tid=0 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 client.4461 shutdown 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374f20 msgr2=0x560c194436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374f20 0x560c194436e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x560c193bb2c0 tx=0x7f18e415c400 comp rx=0 tx=0).stop 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 shutdown_connections 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x560c193a6b10 0x560c19447560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560c193bf8b0 0x560c193bd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560c1939bca0 0x560c193bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 --2- 172.21.15.81:0/2498924592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560c19374f20 0x560c194436e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18c7e00640 0 client.4461 ms_handle_reset on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 >> 172.21.15.81:0/2498924592 conn(0x560c19374000 msgr2=0x560c19374420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 shutdown_connections 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 1 -- 172.21.15.81:0/2498924592 wait complete. 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.468+0000 7f18eca8e740 20 client.4461 trim_cache size 0 max 16384 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0ea88071-0b16-46b5-b258-7e2fd8f41721", 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-10T20:40:00.477 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4381, 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 7.6459979450000004, 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 26, 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 26, 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.676932900000001 2024-09-10T20:40:00.478 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f18c0077f70 msgr2=0x7f18c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f18c0077f70 0x7f18c007a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006fd0 tx=0x7f18d4006b20 comp rx=0 tx=0).stop 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e414eab0 msgr2=0x7f18e4151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e414eab0 0x7f18e4151a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18e40cd280 tx=0x7f18dc001630 comp rx=0 tx=0).stop 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 shutdown_connections 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f18c0077f70 0x7f18c007a430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e414eab0 0x7f18e4151a30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f18e41590b0 0x7f18e41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 --2- 172.21.15.81:0/2246919308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f18c8004800 0x7f18e4158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 >> 172.21.15.81:0/2246919308 conn(0x7f18e406cb50 msgr2=0x7f18e40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 shutdown_connections 2024-09-10T20:40:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.469+0000 7f18e9c00640 1 -- 172.21.15.81:0/2246919308 wait complete. 2024-09-10T20:40:00.489 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:40:00.489 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:00.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:40:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.641+0000 7ff92b200640 1 -- 172.21.15.81:0/4079537974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92406e0a0 msgr2=0x7ff9240d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.642+0000 7ff92b200640 1 --2- 172.21.15.81:0/4079537974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92406e0a0 0x7ff9240d2090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff914009830 tx=0x7ff91402a480 comp rx=0 tx=0).stop 2024-09-10T20:40:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.642+0000 7ff92b200640 1 -- 172.21.15.81:0/4079537974 shutdown_connections 2024-09-10T20:40:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.642+0000 7ff92b200640 1 --2- 172.21.15.81:0/4079537974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9240d25d0 0x7ff92406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.642+0000 7ff92b200640 1 --2- 172.21.15.81:0/4079537974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92406e0a0 0x7ff9240d2090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.642+0000 7ff92b200640 1 -- 172.21.15.81:0/4079537974 >> 172.21.15.81:0/4079537974 conn(0x7ff9240d3ab0 msgr2=0x7ff9240d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.642+0000 7ff92b200640 1 -- 172.21.15.81:0/4079537974 shutdown_connections 2024-09-10T20:40:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.642+0000 7ff92b200640 1 -- 172.21.15.81:0/4079537974 wait complete. 2024-09-10T20:40:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.643+0000 7ff92b200640 1 Processor -- start 2024-09-10T20:40:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.643+0000 7ff92b200640 1 -- start start 2024-09-10T20:40:00.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.644+0000 7ff92b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92406e0a0 0x7ff92415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.644+0000 7ff92b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff924161140 0x7ff9240cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.644+0000 7ff92b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92415a750 0x7ff9241f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.644+0000 7ff92b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff92406e8f0 con 0x7ff92415a750 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.644+0000 7ff92b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff92406e770 con 0x7ff924161140 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.644+0000 7ff92b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff9240b3030 con 0x7ff92406e0a0 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92415a750 0x7ff9241f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92415a750 0x7ff9241f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52752/0 (socket says 172.21.15.81:52752) 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 -- 172.21.15.81:0/2590510623 learned_addr learned my addr 172.21.15.81:0/2590510623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff929400640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff924161140 0x7ff9240cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff929e00640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92406e0a0 0x7ff92415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 -- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92406e0a0 msgr2=0x7ff92415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92406e0a0 0x7ff92415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 -- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff924161140 msgr2=0x7ff9240cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff924161140 0x7ff9240cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 -- 172.21.15.81:0/2590510623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92415afa0 con 0x7ff92415a750 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff929e00640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92406e0a0 0x7ff92415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92a800640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92415a750 0x7ff9241f4210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff92000eb10 tx=0x7ff92000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff91e000640 1 -- 172.21.15.81:0/2590510623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920004b20 con 0x7ff92415a750 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff91e000640 1 -- 172.21.15.81:0/2590510623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff920004ce0 con 0x7ff92415a750 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff91e000640 1 -- 172.21.15.81:0/2590510623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920005280 con 0x7ff92415a750 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.645+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff924158b10 con 0x7ff92415a750 2024-09-10T20:40:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.646+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff924158db0 con 0x7ff92415a750 2024-09-10T20:40:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.647+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92406d760 con 0x7ff92415a750 2024-09-10T20:40:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.648+0000 7ff91e000640 1 -- 172.21.15.81:0/2590510623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff920005420 con 0x7ff92415a750 2024-09-10T20:40:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.649+0000 7ff91e000640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff908077f70 0x7ff90807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.649+0000 7ff91e000640 1 -- 172.21.15.81:0/2590510623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff92009af10 con 0x7ff92415a750 2024-09-10T20:40:00.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.649+0000 7ff929e00640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff908077f70 0x7ff90807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.650+0000 7ff929e00640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff908077f70 0x7ff90807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff918001220 tx=0x7ff918009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:00.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.653+0000 7ff91e000640 1 -- 172.21.15.81:0/2590510623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff920063640 con 0x7ff92415a750 2024-09-10T20:40:00.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.880+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff9240d4210 con 0x7ff92415a750 2024-09-10T20:40:00.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.880+0000 7ff91e000640 1 -- 172.21.15.81:0/2590510623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7ff920062f40 con 0x7ff92415a750 2024-09-10T20:40:00.885 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T20:40:00.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff908077f70 msgr2=0x7ff90807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff908077f70 0x7ff90807a430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff918001220 tx=0x7ff918009040 comp rx=0 tx=0).stop 2024-09-10T20:40:00.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92415a750 msgr2=0x7ff9241f4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:00.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92415a750 0x7ff9241f4210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff92000eb10 tx=0x7ff92000c2d0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 shutdown_connections 2024-09-10T20:40:00.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff908077f70 0x7ff90807a430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff92415a750 0x7ff9241f4210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff924161140 0x7ff9240cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 --2- 172.21.15.81:0/2590510623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92406e0a0 0x7ff92415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:00.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 >> 172.21.15.81:0/2590510623 conn(0x7ff9240d3ab0 msgr2=0x7ff9240b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:00.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 shutdown_connections 2024-09-10T20:40:00.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:00.883+0000 7ff92b200640 1 -- 172.21.15.81:0/2590510623 wait complete. 2024-09-10T20:40:00.902 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T20:40:00.902 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:40:00.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-10T20:40:00.903 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T20:40:00.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:00.903 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T20:40:00.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:40:00.903 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:40:00.903 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T20:40:00.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:00.904 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-10T20:40:00.939 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:00.939 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:00.939 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:00.940 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:40:00.941 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:00.941 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:40:00.941 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42720sec preferred_lft 42720sec 2024-09-10T20:40:00.941 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-10T20:40:00.941 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:00.941 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T20:40:00.942 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:00.942 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:00.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-10T20:40:00.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-10T20:40:00.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-10T20:40:00.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T20:40:00.942 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:01.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:01.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:01.358 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:40:01.416 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-10T20:40:01.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:01.419 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-10T20:40:01.464 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-10T20:40:01.464 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:40:01.464 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:40:01.464 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:40:01.464 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:40:01.465 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:01.465 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:01.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:40:01.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:40:01.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:40:01.465 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:02.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:02.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:02.162 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-10T20:40:02.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:02.198 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-10T20:40:02.274 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:02.275 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:02.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T20:40:02.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T20:40:02.275 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:02.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:02.453 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T20:40:02.454 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:02.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:02.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:02.714 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:02.714 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:02.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-10T20:40:02.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T20:40:02.714 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:02.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:02.882 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T20:40:02.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:02.882 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:02.917 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T20:40:02.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:02.918 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:02.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:40:03.090 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:40:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:40:03.129 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:40:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:40:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:40:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:40:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:40:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:40:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T20:40:03.130 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T20:40:03.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:03.131 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:40:03.207 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:40:03.207 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T20:40:03.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:40:03.308 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:03.345 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:40:03.346 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T20:40:03.348 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T20:40:03.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:03.349 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:40:03.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2024-09-10T20:40:03.405+0000 7fbbe26d3480 -1 init, newargv = 0x563ea891acf0 newargc=15 2024-09-10T20:40:03.409 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[43018]: starting ceph client 2024-09-10T20:40:03.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[43018]: starting fuse 2024-09-10T20:40:03.428 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-10T20:40:03.428 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T20:40:03.429 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-10T20:40:03.430 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-10T20:40:03.431 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:40:03.431 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:03.431 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2024-09-10T20:40:03.431 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-10T20:40:03.593 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.43018.asok 2024-09-10T20:40:03.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:03.607 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43018.asok 2024-09-10T20:40:03.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:03.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43018.asok status 2024-09-10T20:40:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:40:03.789 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "43018", 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4476, 2024-09-10T20:40:03.790 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4476 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 805422040 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:40:03.791 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 805422040 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4476 192.168.0.1:0/805422040", 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/805422040", 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 26, 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-10T20:40:03.792 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:40:03.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:03.801 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-10T20:40:03.801 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:03.837 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-10T20:40:03.837 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:03.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:03.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:03.935 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T20:40:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T20:40:04.058 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2024-09-10T20:40:04.058 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T20:40:04.058 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:04.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:04.066 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:04.066 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:04.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:04.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 -- 172.21.15.81:0/1341613821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0154cf0 msgr2=0x7faee015bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 --2- 172.21.15.81:0/1341613821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0154cf0 0x7faee015bef0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faee015f400 tx=0x7faed002a5f0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 -- 172.21.15.81:0/1341613821 shutdown_connections 2024-09-10T20:40:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 --2- 172.21.15.81:0/1341613821 >> v2:172.21.15.143:3300/0 conn(0x7faee0073560 0x7faee00739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 --2- 172.21.15.81:0/1341613821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee0154cf0 0x7faee015bef0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 -- 172.21.15.81:0/1341613821 >> 172.21.15.81:0/1341613821 conn(0x7faee006cb50 msgr2=0x7faee006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 -- 172.21.15.81:0/1341613821 shutdown_connections 2024-09-10T20:40:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.297+0000 7faee7c00640 1 -- 172.21.15.81:0/1341613821 wait complete. 2024-09-10T20:40:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.299+0000 7faee7c00640 1 Processor -- start 2024-09-10T20:40:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.299+0000 7faee7c00640 1 -- start start 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee7c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faee0073560 0x7faee00cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee7c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faee0154cf0 0x7faee0145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee7c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee015ae80 0x7faee0156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee7c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faee006fa30 con 0x7faee015ae80 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee7c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faee006f8b0 con 0x7faee0073560 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee7c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faee006fbb0 con 0x7faee0154cf0 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee5200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faee0073560 0x7faee00cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee015ae80 0x7faee0156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee5200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faee0073560 0x7faee00cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:49258/0 (socket says 172.21.15.81:49258) 2024-09-10T20:40:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee015ae80 0x7faee0156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52768/0 (socket says 172.21.15.81:52768) 2024-09-10T20:40:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faee5200640 1 -- 172.21.15.81:0/4127380713 learned_addr learned my addr 172.21.15.81:0/4127380713 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.300+0000 7faedfe00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faee0154cf0 0x7faee0145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee5c00640 1 -- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faee0154cf0 msgr2=0x7faee0145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee5c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faee0154cf0 0x7faee0145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee5c00640 1 -- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faee0073560 msgr2=0x7faee00cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee5c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faee0073560 0x7faee00cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee5c00640 1 -- 172.21.15.81:0/4127380713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee01f2e60 con 0x7faee015ae80 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee5c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee015ae80 0x7faee0156f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faed800c730 tx=0x7faed800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faedcc00640 1 -- 172.21.15.81:0/4127380713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8017070 con 0x7faee015ae80 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faedcc00640 1 -- 172.21.15.81:0/4127380713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faed8003c60 con 0x7faee015ae80 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faedcc00640 1 -- 172.21.15.81:0/4127380713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed80052d0 con 0x7faee015ae80 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee01f2b80 con 0x7faee015ae80 2024-09-10T20:40:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.301+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee00cf070 con 0x7faee015ae80 2024-09-10T20:40:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.302+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee00739f0 con 0x7faee015ae80 2024-09-10T20:40:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.303+0000 7faedcc00640 1 -- 172.21.15.81:0/4127380713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faed8005470 con 0x7faee015ae80 2024-09-10T20:40:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.304+0000 7faedcc00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faec0077f70 0x7faec007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.304+0000 7faedcc00640 1 -- 172.21.15.81:0/4127380713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faed80997d0 con 0x7faee015ae80 2024-09-10T20:40:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.305+0000 7faee5200640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faec0077f70 0x7faec007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.305+0000 7faee5200640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faec0077f70 0x7faec007a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faed00096c0 tx=0x7faed0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.309+0000 7faedcc00640 1 -- 172.21.15.81:0/4127380713 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faed8061930 con 0x7faee015ae80 2024-09-10T20:40:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.503+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faee015d600 con 0x7faee015ae80 2024-09-10T20:40:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.503+0000 7faedcc00640 1 -- 172.21.15.81:0/4127380713 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7faed8066360 con 0x7faee015ae80 2024-09-10T20:40:04.507 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faec0077f70 msgr2=0x7faec007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faec0077f70 0x7faec007a430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faed00096c0 tx=0x7faed0004730 comp rx=0 tx=0).stop 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee015ae80 msgr2=0x7faee0156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee015ae80 0x7faee0156f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faed800c730 tx=0x7faed800cb30 comp rx=0 tx=0).stop 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 shutdown_connections 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faec0077f70 0x7faec007a430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faee015ae80 0x7faee0156f40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.505+0000 7faee7c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faee0154cf0 0x7faee0145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.506+0000 7faee7c00640 1 --2- 172.21.15.81:0/4127380713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faee0073560 0x7faee00cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.506+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 >> 172.21.15.81:0/4127380713 conn(0x7faee006cb50 msgr2=0x7faee015b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.506+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 shutdown_connections 2024-09-10T20:40:04.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.506+0000 7faee7c00640 1 -- 172.21.15.81:0/4127380713 wait complete. 2024-09-10T20:40:04.525 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:04.525 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:04.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 -- 172.21.15.81:0/535981073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 msgr2=0x7f4fbc0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/535981073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc0cf780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc070770 tx=0x7f4fb402a4a0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 -- 172.21.15.81:0/535981073 shutdown_connections 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/535981073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc0cf780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/535981073 >> v2:172.21.15.143:3300/0 conn(0x7f4fbc15b680 0x7f4fbc15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 -- 172.21.15.81:0/535981073 >> 172.21.15.81:0/535981073 conn(0x7f4fbc06cb50 msgr2=0x7f4fbc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 -- 172.21.15.81:0/535981073 shutdown_connections 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.754+0000 7f4fc0e00640 1 -- 172.21.15.81:0/535981073 wait complete. 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.756+0000 7f4fc0e00640 1 Processor -- start 2024-09-10T20:40:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.756+0000 7f4fc0e00640 1 -- start start 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fc0e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fbc0741e0 0x7f4fbc1f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fc0e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fbc15b680 0x7f4fbc1f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fc0e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc1f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fc0e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc0b2860 con 0x7f4fbc15c750 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fc0e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc0b29e0 con 0x7f4fbc15b680 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fc0e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4fbc0b2b60 con 0x7f4fbc0741e0 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fba800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc1f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fba800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc1f65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52776/0 (socket says 172.21.15.81:52776) 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fba800640 1 -- 172.21.15.81:0/2662338190 learned_addr learned my addr 172.21.15.81:0/2662338190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fb9e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fbc0741e0 0x7f4fbc1f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fb9400640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fbc15b680 0x7f4fbc1f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fba800640 1 -- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fbc0741e0 msgr2=0x7f4fbc1f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.757+0000 7f4fba800640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fbc0741e0 0x7f4fbc1f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fba800640 1 -- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fbc15b680 msgr2=0x7f4fbc1f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fba800640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fbc15b680 0x7f4fbc1f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fba800640 1 -- 172.21.15.81:0/2662338190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc0aee50 con 0x7f4fbc15c750 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fba800640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc1f65f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40098f0 tx=0x7f4fb4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fb2000640 1 -- 172.21.15.81:0/2662338190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4005c90 con 0x7f4fbc15c750 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fb2000640 1 -- 172.21.15.81:0/2662338190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fb4031e50 con 0x7f4fbc15c750 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fb2000640 1 -- 172.21.15.81:0/2662338190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4005240 con 0x7f4fbc15c750 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fbc0af130 con 0x7f4fbc15c750 2024-09-10T20:40:04.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.758+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fbc0b0930 con 0x7f4fbc15c750 2024-09-10T20:40:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.759+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fbc0b3840 con 0x7f4fbc15c750 2024-09-10T20:40:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.760+0000 7f4fb2000640 1 -- 172.21.15.81:0/2662338190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4fb40053e0 con 0x7f4fbc15c750 2024-09-10T20:40:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.761+0000 7f4fb2000640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4f9c077f70 0x7f4f9c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.761+0000 7f4fb2000640 1 -- 172.21.15.81:0/2662338190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4fb40baf70 con 0x7f4fbc15c750 2024-09-10T20:40:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.762+0000 7f4fb9e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4f9c077f70 0x7f4f9c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:04.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.762+0000 7f4fb9e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4f9c077f70 0x7f4f9c07a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fac005fd0 tx=0x7f4fac009680 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.765+0000 7f4fb2000640 1 -- 172.21.15.81:0/2662338190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4fb403f030 con 0x7f4fbc15c750 2024-09-10T20:40:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.964+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4fbc0cc490 con 0x7f4fbc15c750 2024-09-10T20:40:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.964+0000 7f4fb2000640 1 -- 172.21.15.81:0/2662338190 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f4fb40830d0 con 0x7f4fbc15c750 2024-09-10T20:40:04.968 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4f9c077f70 msgr2=0x7f4f9c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4f9c077f70 0x7f4f9c07a430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fac005fd0 tx=0x7f4fac009680 comp rx=0 tx=0).stop 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 msgr2=0x7f4fbc1f65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc1f65f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40098f0 tx=0x7f4fb4033c20 comp rx=0 tx=0).stop 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 shutdown_connections 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4f9c077f70 0x7f4f9c07a430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fbc15c750 0x7f4fbc1f65f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4fbc15b680 0x7f4fbc1f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 --2- 172.21.15.81:0/2662338190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4fbc0741e0 0x7f4fbc1f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 >> 172.21.15.81:0/2662338190 conn(0x7f4fbc06cb50 msgr2=0x7f4fbc15dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 shutdown_connections 2024-09-10T20:40:04.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:04.967+0000 7f4fc0e00640 1 -- 172.21.15.81:0/2662338190 wait complete. 2024-09-10T20:40:04.986 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-10T20:40:04.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:04.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T20:40:05.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[43018]: fuse finished with error 0 and tester_r 0 2024-09-10T20:40:05.043 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:11.145 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:40:11.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:11.145 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T20:40:11.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 -- 172.21.15.81:0/2102519196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c415b4d0 msgr2=0x7ff3c415ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 --2- 172.21.15.81:0/2102519196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c415b4d0 0x7ff3c415ea60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009830 tx=0x7ff3b402a5a0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 -- 172.21.15.81:0/2102519196 shutdown_connections 2024-09-10T20:40:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 --2- 172.21.15.81:0/2102519196 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c40cf810 0x7ff3c4161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 --2- 172.21.15.81:0/2102519196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c415b4d0 0x7ff3c415ea60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 -- 172.21.15.81:0/2102519196 >> 172.21.15.81:0/2102519196 conn(0x7ff3c406cb50 msgr2=0x7ff3c406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 -- 172.21.15.81:0/2102519196 shutdown_connections 2024-09-10T20:40:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.357+0000 7ff3ca200640 1 -- 172.21.15.81:0/2102519196 wait complete. 2024-09-10T20:40:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.358+0000 7ff3ca200640 1 Processor -- start 2024-09-10T20:40:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.359+0000 7ff3ca200640 1 -- start start 2024-09-10T20:40:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.359+0000 7ff3ca200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c406eb60 0x7ff3c40afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3ca200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c40cf810 0x7ff3c4152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3ca200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c415b4d0 0x7ff3c41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3ca200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c406f380 con 0x7ff3c406eb60 2024-09-10T20:40:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3ca200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c406f200 con 0x7ff3c415b4d0 2024-09-10T20:40:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3ca200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c4153bf0 con 0x7ff3c40cf810 2024-09-10T20:40:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c406eb60 0x7ff3c40afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c406eb60 0x7ff3c40afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36318/0 (socket says 172.21.15.81:36318) 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 -- 172.21.15.81:0/4206424399 learned_addr learned my addr 172.21.15.81:0/4206424399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3bbe00640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c40cf810 0x7ff3c4152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3e00640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c415b4d0 0x7ff3c41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 -- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c40cf810 msgr2=0x7ff3c4152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c40cf810 0x7ff3c4152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 -- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c415b4d0 msgr2=0x7ff3c41536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c415b4d0 0x7ff3c41536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.360+0000 7ff3c3400640 1 -- 172.21.15.81:0/4206424399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40af450 con 0x7ff3c406eb60 2024-09-10T20:40:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.361+0000 7ff3c3400640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c406eb60 0x7ff3c40afed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009950 tx=0x7ff3b4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.361+0000 7ff3bb400640 1 -- 172.21.15.81:0/4206424399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4031d60 con 0x7ff3c406eb60 2024-09-10T20:40:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.361+0000 7ff3bb400640 1 -- 172.21.15.81:0/4206424399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3b4033e10 con 0x7ff3c406eb60 2024-09-10T20:40:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.361+0000 7ff3bb400640 1 -- 172.21.15.81:0/4206424399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4033310 con 0x7ff3c406eb60 2024-09-10T20:40:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.361+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c4153e20 con 0x7ff3c406eb60 2024-09-10T20:40:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.361+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c4154100 con 0x7ff3c406eb60 2024-09-10T20:40:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.362+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c40b34c0 con 0x7ff3c406eb60 2024-09-10T20:40:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.363+0000 7ff3bb400640 1 -- 172.21.15.81:0/4206424399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff3b404b030 con 0x7ff3c406eb60 2024-09-10T20:40:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.364+0000 7ff3bb400640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3a0077f70 0x7ff3a007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.364+0000 7ff3bb400640 1 -- 172.21.15.81:0/4206424399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff3b40bb050 con 0x7ff3c406eb60 2024-09-10T20:40:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.364+0000 7ff3bbe00640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3a0077f70 0x7ff3a007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.365+0000 7ff3bbe00640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3a0077f70 0x7ff3a007a430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009b60 tx=0x7ff3ac005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.369+0000 7ff3bb400640 1 -- 172.21.15.81:0/4206424399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff3b403f030 con 0x7ff3c406eb60 2024-09-10T20:40:11.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.555+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3c40af7a0 con 0x7ff3c406eb60 2024-09-10T20:40:11.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.556+0000 7ff3bb400640 1 -- 172.21.15.81:0/4206424399 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7ff3b40838a0 con 0x7ff3c406eb60 2024-09-10T20:40:11.561 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:11.561 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3a0077f70 msgr2=0x7ff3a007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3a0077f70 0x7ff3a007a430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009b60 tx=0x7ff3ac005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c406eb60 msgr2=0x7ff3c40afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c406eb60 0x7ff3c40afed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009950 tx=0x7ff3b4033c20 comp rx=0 tx=0).stop 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 shutdown_connections 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3a0077f70 0x7ff3a007a430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c415b4d0 0x7ff3c41536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c40cf810 0x7ff3c4152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 --2- 172.21.15.81:0/4206424399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c406eb60 0x7ff3c40afed0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 >> 172.21.15.81:0/4206424399 conn(0x7ff3c406cb50 msgr2=0x7ff3c415d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:11.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 shutdown_connections 2024-09-10T20:40:11.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.559+0000 7ff3ca200640 1 -- 172.21.15.81:0/4206424399 wait complete. 2024-09-10T20:40:11.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.732+0000 7f3c43c00640 1 -- 172.21.15.81:0/522157719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 msgr2=0x7f3c3c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.732+0000 7f3c43c00640 1 --2- 172.21.15.81:0/522157719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 0x7f3c3c15ba60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c005fd0 tx=0x7f3c2c02aa90 comp rx=0 tx=0).stop 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.733+0000 7f3c43c00640 1 -- 172.21.15.81:0/522157719 shutdown_connections 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.733+0000 7f3c43c00640 1 --2- 172.21.15.81:0/522157719 >> v2:172.21.15.143:3300/0 conn(0x7f3c3c15c750 0x7f3c3c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.733+0000 7f3c43c00640 1 --2- 172.21.15.81:0/522157719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 0x7f3c3c15ba60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.733+0000 7f3c43c00640 1 -- 172.21.15.81:0/522157719 >> 172.21.15.81:0/522157719 conn(0x7f3c3c06cb50 msgr2=0x7f3c3c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.733+0000 7f3c43c00640 1 -- 172.21.15.81:0/522157719 shutdown_connections 2024-09-10T20:40:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.733+0000 7f3c43c00640 1 -- 172.21.15.81:0/522157719 wait complete. 2024-09-10T20:40:11.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.734+0000 7f3c43c00640 1 Processor -- start 2024-09-10T20:40:11.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.734+0000 7f3c43c00640 1 -- start start 2024-09-10T20:40:11.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.735+0000 7f3c43c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c0741e0 0x7f3c3c06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.735+0000 7f3c43c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 0x7f3c3c0ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.735+0000 7f3c43c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c3c15c750 0x7f3c3c1f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.735+0000 7f3c43c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c0b29e0 con 0x7f3c3c0741e0 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.735+0000 7f3c43c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c0b2860 con 0x7f3c3c15c750 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.735+0000 7f3c43c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3c3c0b2b60 con 0x7f3c3c15b680 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c0741e0 0x7f3c3c06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c0741e0 0x7f3c3c06fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36334/0 (socket says 172.21.15.81:36334) 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 -- 172.21.15.81:0/1505752664 learned_addr learned my addr 172.21.15.81:0/1505752664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c3be00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 0x7f3c3c0ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c3c15c750 0x7f3c3c1f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 -- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 msgr2=0x7f3c3c0ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 0x7f3c3c0ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 -- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c3c15c750 msgr2=0x7f3c3c1f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c3c15c750 0x7f3c3c1f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 -- 172.21.15.81:0/1505752664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c159b30 con 0x7f3c3c0741e0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c41200640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c0741e0 0x7f3c3c06fde0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000f80 tx=0x7f3c2c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.736+0000 7f3c38c00640 1 -- 172.21.15.81:0/1505752664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c046070 con 0x7f3c3c0741e0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.737+0000 7f3c38c00640 1 -- 172.21.15.81:0/1505752664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c2c004250 con 0x7f3c3c0741e0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.737+0000 7f3c38c00640 1 -- 172.21.15.81:0/1505752664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c004660 con 0x7f3c3c0741e0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.737+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c159e10 con 0x7f3c3c0741e0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.737+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c15a3d0 con 0x7f3c3c0741e0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.738+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3c0b3010 con 0x7f3c3c0741e0 2024-09-10T20:40:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.739+0000 7f3c38c00640 1 -- 172.21.15.81:0/1505752664 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3c2c036400 con 0x7f3c3c0741e0 2024-09-10T20:40:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.740+0000 7f3c38c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3c1c077f70 0x7f3c1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:11.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.740+0000 7f3c38c00640 1 -- 172.21.15.81:0/1505752664 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3c2c0bb330 con 0x7f3c3c0741e0 2024-09-10T20:40:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.740+0000 7f3c3be00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3c1c077f70 0x7f3c1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.741+0000 7f3c3be00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3c1c077f70 0x7f3c1c07a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c15e2e0 tx=0x7f3c28009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:11.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.744+0000 7f3c38c00640 1 -- 172.21.15.81:0/1505752664 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3c2c032030 con 0x7f3c3c0741e0 2024-09-10T20:40:11.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.931+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c3c15dd50 con 0x7f3c3c0741e0 2024-09-10T20:40:11.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.932+0000 7f3c38c00640 1 -- 172.21.15.81:0/1505752664 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7f3c2c083a60 con 0x7f3c3c0741e0 2024-09-10T20:40:11.936 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:11.936 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3c1c077f70 msgr2=0x7f3c1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3c1c077f70 0x7f3c1c07a430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c15e2e0 tx=0x7f3c28009040 comp rx=0 tx=0).stop 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c0741e0 msgr2=0x7f3c3c06fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c0741e0 0x7f3c3c06fde0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c000f80 tx=0x7f3c2c003ce0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 shutdown_connections 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3c1c077f70 0x7f3c1c07a430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3c3c15c750 0x7f3c3c1f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3c3c15b680 0x7f3c3c0ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 --2- 172.21.15.81:0/1505752664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c3c0741e0 0x7f3c3c06fde0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.934+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 >> 172.21.15.81:0/1505752664 conn(0x7f3c3c06cb50 msgr2=0x7f3c3c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.935+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 shutdown_connections 2024-09-10T20:40:11.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:11.935+0000 7f3c43c00640 1 -- 172.21.15.81:0/1505752664 wait complete. 2024-09-10T20:40:11.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T20:40:12.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.109+0000 7f9ff3200640 1 -- 172.21.15.81:0/1267247941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff415db30 msgr2=0x7f9ff40cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:12.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.109+0000 7f9ff3200640 1 --2- 172.21.15.81:0/1267247941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff415db30 0x7f9ff40cf4f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40cf1e0 tx=0x7f9fe402a510 comp rx=0 tx=0).stop 2024-09-10T20:40:12.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.109+0000 7f9ff3200640 1 -- 172.21.15.81:0/1267247941 shutdown_connections 2024-09-10T20:40:12.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.109+0000 7f9ff3200640 1 --2- 172.21.15.81:0/1267247941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff415db30 0x7f9ff40cf4f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:12.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.109+0000 7f9ff3200640 1 -- 172.21.15.81:0/1267247941 >> 172.21.15.81:0/1267247941 conn(0x7f9ff40d3a40 msgr2=0x7f9ff40d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:12.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.110+0000 7f9ff3200640 1 -- 172.21.15.81:0/1267247941 shutdown_connections 2024-09-10T20:40:12.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.110+0000 7f9ff3200640 1 -- 172.21.15.81:0/1267247941 wait complete. 2024-09-10T20:40:12.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.111+0000 7f9ff3200640 1 Processor -- start 2024-09-10T20:40:12.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.111+0000 7f9ff3200640 1 -- start start 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.112+0000 7f9ff3200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff40d0900 0x7f9ff40b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.112+0000 7f9ff3200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff415db30 0x7f9ff4156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.112+0000 7f9ff3200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff40cd5d0 0x7f9ff4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.112+0000 7f9ff3200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff40d46e0 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.112+0000 7f9ff3200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff40d4560 con 0x7f9ff415db30 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.112+0000 7f9ff3200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff40d4860 con 0x7f9ff40d0900 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.112+0000 7f9ff2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff40cd5d0 0x7f9ff4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff40cd5d0 0x7f9ff4160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36356/0 (socket says 172.21.15.81:36356) 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 -- 172.21.15.81:0/2537945463 learned_addr learned my addr 172.21.15.81:0/2537945463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff1400640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff415db30 0x7f9ff4156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff1e00640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff40d0900 0x7f9ff40b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 -- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff40d0900 msgr2=0x7f9ff40b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff40d0900 0x7f9ff40b93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 -- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff415db30 msgr2=0x7f9ff4156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff415db30 0x7f9ff4156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 -- 172.21.15.81:0/2537945463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff415e8a0 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.113+0000 7f9ff2800640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff40cd5d0 0x7f9ff4160d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00cb10 tx=0x7f9fec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.114+0000 7f9fea000640 1 -- 172.21.15.81:0/2537945463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec016020 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.114+0000 7f9fea000640 1 -- 172.21.15.81:0/2537945463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fec00ad60 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.114+0000 7f9fea000640 1 -- 172.21.15.81:0/2537945463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec012680 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.114+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff40cda80 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.114+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff415eb40 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.115+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff40b4660 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.116+0000 7f9fea000640 1 -- 172.21.15.81:0/2537945463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9fec01b400 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.117+0000 7f9fea000640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9fd4077f70 0x7f9fd407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:12.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.117+0000 7f9fea000640 1 -- 172.21.15.81:0/2537945463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9fec09a8f0 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.117+0000 7f9ff1e00640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9fd4077f70 0x7f9fd407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:12.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.118+0000 7f9ff1e00640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9fd4077f70 0x7f9fd407a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4034000 tx=0x7f9fe4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:12.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.121+0000 7f9fea000640 1 -- 172.21.15.81:0/2537945463 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9fec020020 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.339+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9ff40b99c0 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.914+0000 7f9fea000640 1 -- 172.21.15.81:0/2537945463 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f9fec062a60 con 0x7f9ff40cd5d0 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.916+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9fd4077f70 msgr2=0x7f9fd407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.916+0000 7f9ff3200640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9fd4077f70 0x7f9fd407a430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4034000 tx=0x7f9fe4004730 comp rx=0 tx=0).stop 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.916+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff40cd5d0 msgr2=0x7f9ff4160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.916+0000 7f9ff3200640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff40cd5d0 0x7f9ff4160d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00cb10 tx=0x7f9fec00a060 comp rx=0 tx=0).stop 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 shutdown_connections 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9fd4077f70 0x7f9fd407a430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ff40cd5d0 0x7f9ff4160d20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ff415db30 0x7f9ff4156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 --2- 172.21.15.81:0/2537945463 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ff40d0900 0x7f9ff40b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:12.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 >> 172.21.15.81:0/2537945463 conn(0x7f9ff40d3a40 msgr2=0x7f9ff40b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 shutdown_connections 2024-09-10T20:40:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:12.917+0000 7f9ff3200640 1 -- 172.21.15.81:0/2537945463 wait complete. 2024-09-10T20:40:12.937 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-10T20:40:12.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T20:40:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 -- 172.21.15.81:0/2500865065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815b680 msgr2=0x7f2f7815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/2500865065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815b680 0x7f2f7815ba60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009830 tx=0x7f2f6802a480 comp rx=0 tx=0).stop 2024-09-10T20:40:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 -- 172.21.15.81:0/2500865065 shutdown_connections 2024-09-10T20:40:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/2500865065 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f780741e0 0x7f2f7815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/2500865065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815b680 0x7f2f7815ba60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 -- 172.21.15.81:0/2500865065 >> 172.21.15.81:0/2500865065 conn(0x7f2f7806cb50 msgr2=0x7f2f7806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 -- 172.21.15.81:0/2500865065 shutdown_connections 2024-09-10T20:40:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.094+0000 7f2f7fa00640 1 -- 172.21.15.81:0/2500865065 wait complete. 2024-09-10T20:40:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.096+0000 7f2f7fa00640 1 Processor -- start 2024-09-10T20:40:13.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.096+0000 7f2f7fa00640 1 -- start start 2024-09-10T20:40:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7fa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f780741e0 0x7f2f781544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7fa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7815b680 0x7f2f781f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7fa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815c750 0x7f2f7815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7fa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f780b29e0 con 0x7f2f7815c750 2024-09-10T20:40:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7fa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2f780b2860 con 0x7f2f7815b680 2024-09-10T20:40:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7fa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2f780b2b60 con 0x7f2f780741e0 2024-09-10T20:40:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815c750 0x7f2f7815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7da00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815c750 0x7f2f7815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36382/0 (socket says 172.21.15.81:36382) 2024-09-10T20:40:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7da00640 1 -- 172.21.15.81:0/1967933540 learned_addr learned my addr 172.21.15.81:0/1967933540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f7d000640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f780741e0 0x7f2f781544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.097+0000 7f2f77e00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7815b680 0x7f2f781f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7da00640 1 -- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f780741e0 msgr2=0x7f2f781544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7da00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f780741e0 0x7f2f781544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7da00640 1 -- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7815b680 msgr2=0x7f2f781f1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7da00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7815b680 0x7f2f781f1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7da00640 1 -- 172.21.15.81:0/1967933540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f78153a10 con 0x7f2f7815c750 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7da00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815c750 0x7f2f7815a870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c6c0 tx=0x7f2f7000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f74c00640 1 -- 172.21.15.81:0/1967933540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70017070 con 0x7f2f7815c750 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f74c00640 1 -- 172.21.15.81:0/1967933540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f70005070 con 0x7f2f7815c750 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f74c00640 1 -- 172.21.15.81:0/1967933540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700054a0 con 0x7f2f7815c750 2024-09-10T20:40:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f78158260 con 0x7f2f7815c750 2024-09-10T20:40:13.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.098+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f78153f90 con 0x7f2f7815c750 2024-09-10T20:40:13.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.099+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f780b37d0 con 0x7f2f7815c750 2024-09-10T20:40:13.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.100+0000 7f2f74c00640 1 -- 172.21.15.81:0/1967933540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2f70005640 con 0x7f2f7815c750 2024-09-10T20:40:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.101+0000 7f2f74c00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2f58077fa0 0x7f2f5807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.101+0000 7f2f74c00640 1 -- 172.21.15.81:0/1967933540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2f70099880 con 0x7f2f7815c750 2024-09-10T20:40:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.102+0000 7f2f7d000640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2f58077fa0 0x7f2f5807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.103+0000 7f2f7d000640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2f58077fa0 0x7f2f5807a460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f68034000 tx=0x7f2f68004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.105+0000 7f2f74c00640 1 -- 172.21.15.81:0/1967933540 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2f70061950 con 0x7f2f7815c750 2024-09-10T20:40:13.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.331+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2f780cc490 con 0x7f2f7815c750 2024-09-10T20:40:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.920+0000 7f2f74c00640 1 -- 172.21.15.81:0/1967933540 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f2f70066380 con 0x7f2f7815c750 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2f58077fa0 msgr2=0x7f2f5807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2f58077fa0 0x7f2f5807a460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f68034000 tx=0x7f2f68004730 comp rx=0 tx=0).stop 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815c750 msgr2=0x7f2f7815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815c750 0x7f2f7815a870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c6c0 tx=0x7f2f7000cac0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 shutdown_connections 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2f58077fa0 0x7f2f5807a460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f7815c750 0x7f2f7815a870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7815b680 0x7f2f781f1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 --2- 172.21.15.81:0/1967933540 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2f780741e0 0x7f2f781544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 >> 172.21.15.81:0/1967933540 conn(0x7f2f7806cb50 msgr2=0x7f2f780af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 shutdown_connections 2024-09-10T20:40:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:13.923+0000 7f2f7fa00640 1 -- 172.21.15.81:0/1967933540 wait complete. 2024-09-10T20:40:13.945 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T20:40:13.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.101+0000 7f16b1a00640 1 -- 172.21.15.81:0/2452570520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 msgr2=0x7f16ac15bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.101+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2452570520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac15bcd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1698009830 tx=0x7f169802a5c0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.102+0000 7f16b1a00640 1 -- 172.21.15.81:0/2452570520 shutdown_connections 2024-09-10T20:40:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.102+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2452570520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac15bcd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.102+0000 7f16b1a00640 1 -- 172.21.15.81:0/2452570520 >> 172.21.15.81:0/2452570520 conn(0x7f16ac06d500 msgr2=0x7f16ac0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.102+0000 7f16b1a00640 1 -- 172.21.15.81:0/2452570520 shutdown_connections 2024-09-10T20:40:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.102+0000 7f16b1a00640 1 -- 172.21.15.81:0/2452570520 wait complete. 2024-09-10T20:40:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.103+0000 7f16b1a00640 1 Processor -- start 2024-09-10T20:40:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.103+0000 7f16b1a00640 1 -- start start 2024-09-10T20:40:14.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.104+0000 7f16b1a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.104+0000 7f16b1a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0aea30 0x7f16ac0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.104+0000 7f16b1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac15c210 0x7f16ac15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.104+0000 7f16b1a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac0cc110 con 0x7f16ac073610 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.104+0000 7f16b1a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac0af060 con 0x7f16ac15c210 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.104+0000 7f16b1a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16ac0cc290 con 0x7f16ac0aea30 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.104+0000 7f16abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac0b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36406/0 (socket says 172.21.15.81:36406) 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 -- 172.21.15.81:0/2989653032 learned_addr learned my addr 172.21.15.81:0/2989653032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16ab400640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0aea30 0x7f16ac0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16b1000640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac15c210 0x7f16ac15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 -- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0aea30 msgr2=0x7f16ac0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0aea30 0x7f16ac0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 -- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac15c210 msgr2=0x7f16ac15ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac15c210 0x7f16ac15ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 -- 172.21.15.81:0/2989653032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac1f5220 con 0x7f16ac073610 2024-09-10T20:40:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16b1000640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac15c210 0x7f16ac15ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16ab400640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0aea30 0x7f16ac0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16abe00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac0b0600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f169c00cbc0 tx=0x7f169c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16a3e00640 1 -- 172.21.15.81:0/2989653032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c016020 con 0x7f16ac073610 2024-09-10T20:40:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16a3e00640 1 -- 172.21.15.81:0/2989653032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f169c00ae30 con 0x7f16ac073610 2024-09-10T20:40:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16a3e00640 1 -- 172.21.15.81:0/2989653032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c012680 con 0x7f16ac073610 2024-09-10T20:40:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.105+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ac1f4700 con 0x7f16ac073610 2024-09-10T20:40:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.106+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ac1f4f40 con 0x7f16ac073610 2024-09-10T20:40:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.107+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ac0cc780 con 0x7f16ac073610 2024-09-10T20:40:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.108+0000 7f16a3e00640 1 -- 172.21.15.81:0/2989653032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f169c01a3b0 con 0x7f16ac073610 2024-09-10T20:40:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.109+0000 7f16a3e00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f168c077f70 0x7f168c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.109+0000 7f16a3e00640 1 -- 172.21.15.81:0/2989653032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f169c09a720 con 0x7f16ac073610 2024-09-10T20:40:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.109+0000 7f16ab400640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f168c077f70 0x7f168c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.110+0000 7f16ab400640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f168c077f70 0x7f168c07a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1698034000 tx=0x7f1698004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.113+0000 7f16a3e00640 1 -- 172.21.15.81:0/2989653032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f169c020030 con 0x7f16ac073610 2024-09-10T20:40:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.330+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16ac152c40 con 0x7f16ac073610 2024-09-10T20:40:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.331+0000 7f16a3e00640 1 -- 172.21.15.81:0/2989653032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f16ac1f4700 con 0x7f16ac073610 2024-09-10T20:40:14.335 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:14.335 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f168c077f70 msgr2=0x7f168c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f168c077f70 0x7f168c07a430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1698034000 tx=0x7f1698004730 comp rx=0 tx=0).stop 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 msgr2=0x7f16ac0b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac0b0600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f169c00cbc0 tx=0x7f169c00a430 comp rx=0 tx=0).stop 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 shutdown_connections 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f168c077f70 0x7f168c07a430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac15c210 0x7f16ac15ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0aea30 0x7f16ac0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 --2- 172.21.15.81:0/2989653032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16ac073610 0x7f16ac0b0600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 >> 172.21.15.81:0/2989653032 conn(0x7f16ac06d500 msgr2=0x7f16ac0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 shutdown_connections 2024-09-10T20:40:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.334+0000 7f16b1a00640 1 -- 172.21.15.81:0/2989653032 wait complete. 2024-09-10T20:40:14.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 -- 172.21.15.81:0/1542918343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81415b680 msgr2=0x7fc81415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 --2- 172.21.15.81:0/1542918343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81415b680 0x7fc81415ba60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc8140cd2b0 tx=0x7fc80402a560 comp rx=0 tx=0).stop 2024-09-10T20:40:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 -- 172.21.15.81:0/1542918343 shutdown_connections 2024-09-10T20:40:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 --2- 172.21.15.81:0/1542918343 >> v2:172.21.15.143:3300/0 conn(0x7fc81415c750 0x7fc8140cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 --2- 172.21.15.81:0/1542918343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81415b680 0x7fc81415ba60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 -- 172.21.15.81:0/1542918343 >> 172.21.15.81:0/1542918343 conn(0x7fc81406cb50 msgr2=0x7fc81406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 -- 172.21.15.81:0/1542918343 shutdown_connections 2024-09-10T20:40:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.506+0000 7fc819000640 1 -- 172.21.15.81:0/1542918343 wait complete. 2024-09-10T20:40:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.508+0000 7fc819000640 1 Processor -- start 2024-09-10T20:40:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.508+0000 7fc819000640 1 -- start start 2024-09-10T20:40:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc819000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140741e0 0x7fc814145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc819000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81415b680 0x7fc8140cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc819000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415c750 0x7fc8140ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc819000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140b2860 con 0x7fc8140741e0 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc819000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140b29e0 con 0x7fc81415c750 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc819000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc8140b2b60 con 0x7fc81415b680 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc811e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140741e0 0x7fc814145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc811e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140741e0 0x7fc814145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36432/0 (socket says 172.21.15.81:36432) 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc811e00640 1 -- 172.21.15.81:0/321069981 learned_addr learned my addr 172.21.15.81:0/321069981 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc812800640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415c750 0x7fc8140ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc811400640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81415b680 0x7fc8140cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc811e00640 1 -- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81415b680 msgr2=0x7fc8140cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.509+0000 7fc811e00640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81415b680 0x7fc8140cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc811e00640 1 -- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415c750 msgr2=0x7fc8140ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc811e00640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415c750 0x7fc8140ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc811e00640 1 -- 172.21.15.81:0/321069981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8141f8080 con 0x7fc8140741e0 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc812800640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415c750 0x7fc8140ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc811400640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81415b680 0x7fc8140cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc811e00640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140741e0 0x7fc814145700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc804009850 tx=0x7fc804003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc80a000640 1 -- 172.21.15.81:0/321069981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80403f070 con 0x7fc8140741e0 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc80a000640 1 -- 172.21.15.81:0/321069981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8040047a0 con 0x7fc8140741e0 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8141f8360 con 0x7fc8140741e0 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc80a000640 1 -- 172.21.15.81:0/321069981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804035030 con 0x7fc8140741e0 2024-09-10T20:40:14.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.510+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141f44f0 con 0x7fc8140741e0 2024-09-10T20:40:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.511+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8140b3080 con 0x7fc8140741e0 2024-09-10T20:40:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.512+0000 7fc80a000640 1 -- 172.21.15.81:0/321069981 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc804004bb0 con 0x7fc8140741e0 2024-09-10T20:40:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.513+0000 7fc80a000640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc7f4077f70 0x7fc7f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.513+0000 7fc80a000640 1 -- 172.21.15.81:0/321069981 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc8040bb290 con 0x7fc8140741e0 2024-09-10T20:40:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.514+0000 7fc811400640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc7f4077f70 0x7fc7f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.514+0000 7fc811400640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc7f4077f70 0x7fc7f407a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc8141f20e0 tx=0x7fc800009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.517+0000 7fc80a000640 1 -- 172.21.15.81:0/321069981 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc804083a40 con 0x7fc8140741e0 2024-09-10T20:40:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.703+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8140cc490 con 0x7fc8140741e0 2024-09-10T20:40:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.704+0000 7fc80a000640 1 -- 172.21.15.81:0/321069981 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7fc804083340 con 0x7fc8140741e0 2024-09-10T20:40:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:14.708 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc7f4077f70 msgr2=0x7fc7f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc7f4077f70 0x7fc7f407a430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc8141f20e0 tx=0x7fc800009040 comp rx=0 tx=0).stop 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140741e0 msgr2=0x7fc814145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140741e0 0x7fc814145700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc804009850 tx=0x7fc804003910 comp rx=0 tx=0).stop 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 shutdown_connections 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc7f4077f70 0x7fc7f407a430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc81415c750 0x7fc8140ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc81415b680 0x7fc8140cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 --2- 172.21.15.81:0/321069981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8140741e0 0x7fc814145700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 >> 172.21.15.81:0/321069981 conn(0x7fc81406cb50 msgr2=0x7fc81406efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:14.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 shutdown_connections 2024-09-10T20:40:14.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.707+0000 7fc819000640 1 -- 172.21.15.81:0/321069981 wait complete. 2024-09-10T20:40:14.726 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:40:14.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:40:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.880+0000 7f8f17200640 1 -- 172.21.15.81:0/4077994507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8efc004800 msgr2=0x7f8efc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.880+0000 7f8f17200640 1 --2- 172.21.15.81:0/4077994507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8efc004800 0x7f8efc004c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8f040016c0 tx=0x7f8efc005830 comp rx=0 tx=0).stop 2024-09-10T20:40:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.881+0000 7f8f16800640 1 -- 172.21.15.81:0/4077994507 reap_dead start 2024-09-10T20:40:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.881+0000 7f8f17200640 1 -- 172.21.15.81:0/4077994507 shutdown_connections 2024-09-10T20:40:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.881+0000 7f8f17200640 1 -- 172.21.15.81:0/4077994507 >> 172.21.15.81:0/4077994507 conn(0x7f8f180d3ab0 msgr2=0x7f8f180d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.881+0000 7f8f17200640 1 -- 172.21.15.81:0/4077994507 shutdown_connections 2024-09-10T20:40:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.881+0000 7f8f17200640 1 -- 172.21.15.81:0/4077994507 wait complete. 2024-09-10T20:40:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.882+0000 7f8f17200640 1 Processor -- start 2024-09-10T20:40:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.882+0000 7f8f17200640 1 -- start start 2024-09-10T20:40:14.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.883+0000 7f8f17200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8efc004800 0x7f8f18152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.883+0000 7f8f17200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f18156080 0x7f8f180cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.883+0000 7f8f17200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f180cfc50 0x7f8f180c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.883+0000 7f8f17200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1806f180 con 0x7f8f18156080 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.883+0000 7f8f17200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8f18161730 con 0x7f8efc004800 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.883+0000 7f8f17200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1806e770 con 0x7f8f180cfc50 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f18156080 0x7f8f180cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f18156080 0x7f8f180cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52270/0 (socket says 172.21.15.81:52270) 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8efc004800 0x7f8f18152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 -- 172.21.15.81:0/2227436292 learned_addr learned my addr 172.21.15.81:0/2227436292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f16800640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f180cfc50 0x7f8f180c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 -- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f180cfc50 msgr2=0x7f8f180c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f180cfc50 0x7f8f180c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 -- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8efc004800 msgr2=0x7f8f18152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8efc004800 0x7f8f18152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 -- 172.21.15.81:0/2227436292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f180b5350 con 0x7f8f18156080 2024-09-10T20:40:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.884+0000 7f8f15400640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f18156080 0x7f8f180cf710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8f0402a930 tx=0x7f8f04006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.885+0000 7f8f0e000640 1 -- 172.21.15.81:0/2227436292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04041070 con 0x7f8f18156080 2024-09-10T20:40:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.885+0000 7f8f0e000640 1 -- 172.21.15.81:0/2227436292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f04003af0 con 0x7f8f18156080 2024-09-10T20:40:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.885+0000 7f8f0e000640 1 -- 172.21.15.81:0/2227436292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04038070 con 0x7f8f18156080 2024-09-10T20:40:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.885+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f180b5630 con 0x7f8f18156080 2024-09-10T20:40:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.885+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f180b5bf0 con 0x7f8f18156080 2024-09-10T20:40:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.886+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f180b21c0 con 0x7f8f18156080 2024-09-10T20:40:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.887+0000 7f8f0e000640 1 -- 172.21.15.81:0/2227436292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8f04033420 con 0x7f8f18156080 2024-09-10T20:40:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.888+0000 7f8f0e000640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8ef8077f70 0x7f8ef807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.889+0000 7f8f0e000640 1 -- 172.21.15.81:0/2227436292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8f040b98b0 con 0x7f8f18156080 2024-09-10T20:40:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.889+0000 7f8f15e00640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8ef8077f70 0x7f8ef807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.889+0000 7f8f15e00640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8ef8077f70 0x7f8ef807a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f1808ddb0 tx=0x7f8f080067a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:14.893+0000 7f8f0e000640 1 -- 172.21.15.81:0/2227436292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8f04006500 con 0x7f8f18156080 2024-09-10T20:40:15.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.073+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f180b89b0 con 0x7f8ef8077f70 2024-09-10T20:40:15.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.081+0000 7f8f0e000640 1 -- 172.21.15.81:0/2227436292 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f8f180b89b0 con 0x7f8ef8077f70 2024-09-10T20:40:15.089 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:40:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8ef8077f70 msgr2=0x7f8ef807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8ef8077f70 0x7f8ef807a430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f1808ddb0 tx=0x7f8f080067a0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f18156080 msgr2=0x7f8f180cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f18156080 0x7f8f180cf710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8f0402a930 tx=0x7f8f04006310 comp rx=0 tx=0).stop 2024-09-10T20:40:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 shutdown_connections 2024-09-10T20:40:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8ef8077f70 0x7f8ef807a430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f180cfc50 0x7f8f180c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f18156080 0x7f8f180cf710 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 --2- 172.21.15.81:0/2227436292 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8efc004800 0x7f8f18152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 >> 172.21.15.81:0/2227436292 conn(0x7f8f180d3ab0 msgr2=0x7f8f180d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 shutdown_connections 2024-09-10T20:40:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.086+0000 7f8f17200640 1 -- 172.21.15.81:0/2227436292 wait complete. 2024-09-10T20:40:15.106 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-10T20:40:13.849308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003561"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578249+0000","last_change":"2024-09-10T20:39:51.832835+0000","last_active":"2024-09-10T20:39:58.578249+0000","last_peered":"2024-09-10T20:39:58.578249+0000","last_clean":"2024-09-10T20:39:58.578249+0000","last_became_active":"2024-09-10T20:39:51.832002+0000","last_became_peered":"2024-09-10T20:39:51.832002+0000","last_unstale":"2024-09-10T20:39:58.578249+0000","last_undegraded":"2024-09-10T20:39:58.578249+0000","last_fullsized":"2024-09-10T20:39:58.578249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871856+0000","last_change":"2024-09-10T20:39:52.861599+0000","last_active":"2024-09-10T20:39:57.871856+0000","last_peered":"2024-09-10T20:39:57.871856+0000","last_clean":"2024-09-10T20:39:57.871856+0000","last_became_active":"2024-09-10T20:39:52.861276+0000","last_became_peered":"2024-09-10T20:39:52.861276+0000","last_unstale":"2024-09-10T20:39:57.871856+0000","last_undegraded":"2024-09-10T20:39:57.871856+0000","last_fullsized":"2024-09-10T20:39:57.871856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:26.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577180+0000","last_change":"2024-09-10T20:39:56.877062+0000","last_active":"2024-09-10T20:39:58.577180+0000","last_peered":"2024-09-10T20:39:58.577180+0000","last_clean":"2024-09-10T20:39:58.577180+0000","last_became_active":"2024-09-10T20:39:56.876685+0000","last_became_peered":"2024-09-10T20:39:56.876685+0000","last_unstale":"2024-09-10T20:39:58.577180+0000","last_undegraded":"2024-09-10T20:39:58.577180+0000","last_fullsized":"2024-09-10T20:39:58.577180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:57.795507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871926+0000","last_change":"2024-09-10T20:39:51.834265+0000","last_active":"2024-09-10T20:39:57.871926+0000","last_peered":"2024-09-10T20:39:57.871926+0000","last_clean":"2024-09-10T20:39:57.871926+0000","last_became_active":"2024-09-10T20:39:51.833454+0000","last_became_peered":"2024-09-10T20:39:51.833454+0000","last_unstale":"2024-09-10T20:39:57.871926+0000","last_undegraded":"2024-09-10T20:39:57.871926+0000","last_fullsized":"2024-09-10T20:39:57.871926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:16.293652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871601+0000","last_change":"2024-09-10T20:39:52.844795+0000","last_active":"2024-09-10T20:39:57.871601+0000","last_peered":"2024-09-10T20:39:57.871601+0000","last_clean":"2024-09-10T20:39:57.871601+0000","last_became_active":"2024-09-10T20:39:52.844523+0000","last_became_peered":"2024-09-10T20:39:52.844523+0000","last_unstale":"2024-09-10T20:39:57.871601+0000","last_undegraded":"2024-09-10T20:39:57.871601+0000","last_fullsized":"2024-09-10T20:39:57.871601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:29.651685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576325+0000","last_change":"2024-09-10T20:39:56.889126+0000","last_active":"2024-09-10T20:39:58.576325+0000","last_peered":"2024-09-10T20:39:58.576325+0000","last_clean":"2024-09-10T20:39:58.576325+0000","last_became_active":"2024-09-10T20:39:56.884086+0000","last_became_peered":"2024-09-10T20:39:56.884086+0000","last_unstale":"2024-09-10T20:39:58.576325+0000","last_undegraded":"2024-09-10T20:39:58.576325+0000","last_fullsized":"2024-09-10T20:39:58.576325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.634765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456681+0000","last_change":"2024-09-10T20:39:51.837410+0000","last_active":"2024-09-10T20:39:58.456681+0000","last_peered":"2024-09-10T20:39:58.456681+0000","last_clean":"2024-09-10T20:39:58.456681+0000","last_became_active":"2024-09-10T20:39:51.828041+0000","last_became_peered":"2024-09-10T20:39:51.828041+0000","last_unstale":"2024-09-10T20:39:58.456681+0000","last_undegraded":"2024-09-10T20:39:58.456681+0000","last_fullsized":"2024-09-10T20:39:58.456681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075788+0000","last_change":"2024-09-10T20:39:52.841937+0000","last_active":"2024-09-10T20:39:58.075788+0000","last_peered":"2024-09-10T20:39:58.075788+0000","last_clean":"2024-09-10T20:39:58.075788+0000","last_became_active":"2024-09-10T20:39:52.841667+0000","last_became_peered":"2024-09-10T20:39:52.841667+0000","last_unstale":"2024-09-10T20:39:58.075788+0000","last_undegraded":"2024-09-10T20:39:58.075788+0000","last_fullsized":"2024-09-10T20:39:58.075788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:38.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576484+0000","last_change":"2024-09-10T20:39:56.878639+0000","last_active":"2024-09-10T20:39:58.576484+0000","last_peered":"2024-09-10T20:39:58.576484+0000","last_clean":"2024-09-10T20:39:58.576484+0000","last_became_active":"2024-09-10T20:39:56.878151+0000","last_became_peered":"2024-09-10T20:39:56.878151+0000","last_unstale":"2024-09-10T20:39:58.576484+0000","last_undegraded":"2024-09-10T20:39:58.576484+0000","last_fullsized":"2024-09-10T20:39:58.576484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456590+0000","last_change":"2024-09-10T20:39:51.824906+0000","last_active":"2024-09-10T20:39:58.456590+0000","last_peered":"2024-09-10T20:39:58.456590+0000","last_clean":"2024-09-10T20:39:58.456590+0000","last_became_active":"2024-09-10T20:39:51.824622+0000","last_became_peered":"2024-09-10T20:39:51.824622+0000","last_unstale":"2024-09-10T20:39:58.456590+0000","last_undegraded":"2024-09-10T20:39:58.456590+0000","last_fullsized":"2024-09-10T20:39:58.456590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873160+0000","last_change":"2024-09-10T20:39:52.842836+0000","last_active":"2024-09-10T20:39:57.873160+0000","last_peered":"2024-09-10T20:39:57.873160+0000","last_clean":"2024-09-10T20:39:57.873160+0000","last_became_active":"2024-09-10T20:39:52.842556+0000","last_became_peered":"2024-09-10T20:39:52.842556+0000","last_unstale":"2024-09-10T20:39:57.873160+0000","last_undegraded":"2024-09-10T20:39:57.873160+0000","last_fullsized":"2024-09-10T20:39:57.873160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.528995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576402+0000","last_change":"2024-09-10T20:39:56.878895+0000","last_active":"2024-09-10T20:39:58.576402+0000","last_peered":"2024-09-10T20:39:58.576402+0000","last_clean":"2024-09-10T20:39:58.576402+0000","last_became_active":"2024-09-10T20:39:56.878478+0000","last_became_peered":"2024-09-10T20:39:56.878478+0000","last_unstale":"2024-09-10T20:39:58.576402+0000","last_undegraded":"2024-09-10T20:39:58.576402+0000","last_fullsized":"2024-09-10T20:39:58.576402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.002662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872865+0000","last_change":"2024-09-10T20:39:52.840391+0000","last_active":"2024-09-10T20:39:57.872865+0000","last_peered":"2024-09-10T20:39:57.872865+0000","last_clean":"2024-09-10T20:39:57.872865+0000","last_became_active":"2024-09-10T20:39:52.840140+0000","last_became_peered":"2024-09-10T20:39:52.840140+0000","last_unstale":"2024-09-10T20:39:57.872865+0000","last_undegraded":"2024-09-10T20:39:57.872865+0000","last_fullsized":"2024-09-10T20:39:57.872865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872887+0000","last_change":"2024-09-10T20:39:51.831131+0000","last_active":"2024-09-10T20:39:57.872887+0000","last_peered":"2024-09-10T20:39:57.872887+0000","last_clean":"2024-09-10T20:39:57.872887+0000","last_became_active":"2024-09-10T20:39:51.830920+0000","last_became_peered":"2024-09-10T20:39:51.830920+0000","last_unstale":"2024-09-10T20:39:57.872887+0000","last_undegraded":"2024-09-10T20:39:57.872887+0000","last_fullsized":"2024-09-10T20:39:57.872887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872932+0000","last_change":"2024-09-10T20:39:56.885978+0000","last_active":"2024-09-10T20:39:57.872932+0000","last_peered":"2024-09-10T20:39:57.872932+0000","last_clean":"2024-09-10T20:39:57.872932+0000","last_became_active":"2024-09-10T20:39:56.882428+0000","last_became_peered":"2024-09-10T20:39:56.882428+0000","last_unstale":"2024-09-10T20:39:57.872932+0000","last_undegraded":"2024-09-10T20:39:57.872932+0000","last_fullsized":"2024-09-10T20:39:57.872932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:17.375025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578529+0000","last_change":"2024-09-10T20:39:52.851120+0000","last_active":"2024-09-10T20:39:58.578529+0000","last_peered":"2024-09-10T20:39:58.578529+0000","last_clean":"2024-09-10T20:39:58.578529+0000","last_became_active":"2024-09-10T20:39:52.850838+0000","last_became_peered":"2024-09-10T20:39:52.850838+0000","last_unstale":"2024-09-10T20:39:58.578529+0000","last_undegraded":"2024-09-10T20:39:58.578529+0000","last_fullsized":"2024-09-10T20:39:58.578529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870734+0000","last_change":"2024-09-10T20:39:51.828895+0000","last_active":"2024-09-10T20:39:57.870734+0000","last_peered":"2024-09-10T20:39:57.870734+0000","last_clean":"2024-09-10T20:39:57.870734+0000","last_became_active":"2024-09-10T20:39:51.828619+0000","last_became_peered":"2024-09-10T20:39:51.828619+0000","last_unstale":"2024-09-10T20:39:57.870734+0000","last_undegraded":"2024-09-10T20:39:57.870734+0000","last_fullsized":"2024-09-10T20:39:57.870734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456333+0000","last_change":"2024-09-10T20:39:56.872443+0000","last_active":"2024-09-10T20:39:58.456333+0000","last_peered":"2024-09-10T20:39:58.456333+0000","last_clean":"2024-09-10T20:39:58.456333+0000","last_became_active":"2024-09-10T20:39:56.871357+0000","last_became_peered":"2024-09-10T20:39:56.871357+0000","last_unstale":"2024-09-10T20:39:58.456333+0000","last_undegraded":"2024-09-10T20:39:58.456333+0000","last_fullsized":"2024-09-10T20:39:58.456333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:26.208173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576821+0000","last_change":"2024-09-10T20:39:52.840929+0000","last_active":"2024-09-10T20:39:58.576821+0000","last_peered":"2024-09-10T20:39:58.576821+0000","last_clean":"2024-09-10T20:39:58.576821+0000","last_became_active":"2024-09-10T20:39:52.840635+0000","last_became_peered":"2024-09-10T20:39:52.840635+0000","last_unstale":"2024-09-10T20:39:58.576821+0000","last_undegraded":"2024-09-10T20:39:58.576821+0000","last_fullsized":"2024-09-10T20:39:58.576821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:19.765338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577744+0000","last_change":"2024-09-10T20:39:51.834045+0000","last_active":"2024-09-10T20:39:58.577744+0000","last_peered":"2024-09-10T20:39:58.577744+0000","last_clean":"2024-09-10T20:39:58.577744+0000","last_became_active":"2024-09-10T20:39:51.833137+0000","last_became_peered":"2024-09-10T20:39:51.833137+0000","last_unstale":"2024-09-10T20:39:58.577744+0000","last_undegraded":"2024-09-10T20:39:58.577744+0000","last_fullsized":"2024-09-10T20:39:58.577744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578854+0000","last_change":"2024-09-10T20:39:56.878162+0000","last_active":"2024-09-10T20:39:58.578854+0000","last_peered":"2024-09-10T20:39:58.578854+0000","last_clean":"2024-09-10T20:39:58.578854+0000","last_became_active":"2024-09-10T20:39:56.875227+0000","last_became_peered":"2024-09-10T20:39:56.875227+0000","last_unstale":"2024-09-10T20:39:58.578854+0000","last_undegraded":"2024-09-10T20:39:58.578854+0000","last_fullsized":"2024-09-10T20:39:58.578854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:47.514540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872355+0000","last_change":"2024-09-10T20:39:52.850499+0000","last_active":"2024-09-10T20:39:57.872355+0000","last_peered":"2024-09-10T20:39:57.872355+0000","last_clean":"2024-09-10T20:39:57.872355+0000","last_became_active":"2024-09-10T20:39:52.846216+0000","last_became_peered":"2024-09-10T20:39:52.846216+0000","last_unstale":"2024-09-10T20:39:57.872355+0000","last_undegraded":"2024-09-10T20:39:57.872355+0000","last_fullsized":"2024-09-10T20:39:57.872355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:42.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.455967+0000","last_change":"2024-09-10T20:39:51.828243+0000","last_active":"2024-09-10T20:39:58.455967+0000","last_peered":"2024-09-10T20:39:58.455967+0000","last_clean":"2024-09-10T20:39:58.455967+0000","last_became_active":"2024-09-10T20:39:51.827821+0000","last_became_peered":"2024-09-10T20:39:51.827821+0000","last_unstale":"2024-09-10T20:39:58.455967+0000","last_undegraded":"2024-09-10T20:39:58.455967+0000","last_fullsized":"2024-09-10T20:39:58.455967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577056+0000","last_change":"2024-09-10T20:39:56.884287+0000","last_active":"2024-09-10T20:39:58.577056+0000","last_peered":"2024-09-10T20:39:58.577056+0000","last_clean":"2024-09-10T20:39:58.577056+0000","last_became_active":"2024-09-10T20:39:56.882564+0000","last_became_peered":"2024-09-10T20:39:56.882564+0000","last_unstale":"2024-09-10T20:39:58.577056+0000","last_undegraded":"2024-09-10T20:39:58.577056+0000","last_fullsized":"2024-09-10T20:39:58.577056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577841+0000","last_change":"2024-09-10T20:39:52.838040+0000","last_active":"2024-09-10T20:39:58.577841+0000","last_peered":"2024-09-10T20:39:58.577841+0000","last_clean":"2024-09-10T20:39:58.577841+0000","last_became_active":"2024-09-10T20:39:52.837734+0000","last_became_peered":"2024-09-10T20:39:52.837734+0000","last_unstale":"2024-09-10T20:39:58.577841+0000","last_undegraded":"2024-09-10T20:39:58.577841+0000","last_fullsized":"2024-09-10T20:39:58.577841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:10.528107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873618+0000","last_change":"2024-09-10T20:39:51.844086+0000","last_active":"2024-09-10T20:39:57.873618+0000","last_peered":"2024-09-10T20:39:57.873618+0000","last_clean":"2024-09-10T20:39:57.873618+0000","last_became_active":"2024-09-10T20:39:51.843824+0000","last_became_peered":"2024-09-10T20:39:51.843824+0000","last_unstale":"2024-09-10T20:39:57.873618+0000","last_undegraded":"2024-09-10T20:39:57.873618+0000","last_fullsized":"2024-09-10T20:39:57.873618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:12.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576560+0000","last_change":"2024-09-10T20:39:56.884552+0000","last_active":"2024-09-10T20:39:58.576560+0000","last_peered":"2024-09-10T20:39:58.576560+0000","last_clean":"2024-09-10T20:39:58.576560+0000","last_became_active":"2024-09-10T20:39:56.884088+0000","last_became_peered":"2024-09-10T20:39:56.884088+0000","last_unstale":"2024-09-10T20:39:58.576560+0000","last_undegraded":"2024-09-10T20:39:58.576560+0000","last_fullsized":"2024-09-10T20:39:58.576560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578171+0000","last_change":"2024-09-10T20:39:52.850808+0000","last_active":"2024-09-10T20:39:58.578171+0000","last_peered":"2024-09-10T20:39:58.578171+0000","last_clean":"2024-09-10T20:39:58.578171+0000","last_became_active":"2024-09-10T20:39:52.850148+0000","last_became_peered":"2024-09-10T20:39:52.850148+0000","last_unstale":"2024-09-10T20:39:58.578171+0000","last_undegraded":"2024-09-10T20:39:58.578171+0000","last_fullsized":"2024-09-10T20:39:58.578171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:27.749969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578141+0000","last_change":"2024-09-10T20:39:51.835027+0000","last_active":"2024-09-10T20:39:58.578141+0000","last_peered":"2024-09-10T20:39:58.578141+0000","last_clean":"2024-09-10T20:39:58.578141+0000","last_became_active":"2024-09-10T20:39:51.833252+0000","last_became_peered":"2024-09-10T20:39:51.833252+0000","last_unstale":"2024-09-10T20:39:58.578141+0000","last_undegraded":"2024-09-10T20:39:58.578141+0000","last_fullsized":"2024-09-10T20:39:58.578141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576875+0000","last_change":"2024-09-10T20:39:56.878033+0000","last_active":"2024-09-10T20:39:58.576875+0000","last_peered":"2024-09-10T20:39:58.576875+0000","last_clean":"2024-09-10T20:39:58.576875+0000","last_became_active":"2024-09-10T20:39:56.877576+0000","last_became_peered":"2024-09-10T20:39:56.877576+0000","last_unstale":"2024-09-10T20:39:58.576875+0000","last_undegraded":"2024-09-10T20:39:58.576875+0000","last_fullsized":"2024-09-10T20:39:58.576875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870354+0000","last_change":"2024-09-10T20:39:52.859765+0000","last_active":"2024-09-10T20:39:57.870354+0000","last_peered":"2024-09-10T20:39:57.870354+0000","last_clean":"2024-09-10T20:39:57.870354+0000","last_became_active":"2024-09-10T20:39:52.858175+0000","last_became_peered":"2024-09-10T20:39:52.858175+0000","last_unstale":"2024-09-10T20:39:57.870354+0000","last_undegraded":"2024-09-10T20:39:57.870354+0000","last_fullsized":"2024-09-10T20:39:57.870354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:43.478637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873400+0000","last_change":"2024-09-10T20:39:51.836469+0000","last_active":"2024-09-10T20:39:57.873400+0000","last_peered":"2024-09-10T20:39:57.873400+0000","last_clean":"2024-09-10T20:39:57.873400+0000","last_became_active":"2024-09-10T20:39:51.835832+0000","last_became_peered":"2024-09-10T20:39:51.835832+0000","last_unstale":"2024-09-10T20:39:57.873400+0000","last_undegraded":"2024-09-10T20:39:57.873400+0000","last_fullsized":"2024-09-10T20:39:57.873400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.987131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870998+0000","last_change":"2024-09-10T20:39:56.875872+0000","last_active":"2024-09-10T20:39:57.870998+0000","last_peered":"2024-09-10T20:39:57.870998+0000","last_clean":"2024-09-10T20:39:57.870998+0000","last_became_active":"2024-09-10T20:39:56.875431+0000","last_became_peered":"2024-09-10T20:39:56.875431+0000","last_unstale":"2024-09-10T20:39:57.870998+0000","last_undegraded":"2024-09-10T20:39:57.870998+0000","last_fullsized":"2024-09-10T20:39:57.870998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576757+0000","last_change":"2024-09-10T20:39:52.865010+0000","last_active":"2024-09-10T20:39:58.576757+0000","last_peered":"2024-09-10T20:39:58.576757+0000","last_clean":"2024-09-10T20:39:58.576757+0000","last_became_active":"2024-09-10T20:39:52.859434+0000","last_became_peered":"2024-09-10T20:39:52.859434+0000","last_unstale":"2024-09-10T20:39:58.576757+0000","last_undegraded":"2024-09-10T20:39:58.576757+0000","last_fullsized":"2024-09-10T20:39:58.576757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871107+0000","last_change":"2024-09-10T20:39:51.827144+0000","last_active":"2024-09-10T20:39:57.871107+0000","last_peered":"2024-09-10T20:39:57.871107+0000","last_clean":"2024-09-10T20:39:57.871107+0000","last_became_active":"2024-09-10T20:39:51.826880+0000","last_became_peered":"2024-09-10T20:39:51.826880+0000","last_unstale":"2024-09-10T20:39:57.871107+0000","last_undegraded":"2024-09-10T20:39:57.871107+0000","last_fullsized":"2024-09-10T20:39:57.871107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:45.750240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870236+0000","last_change":"2024-09-10T20:39:56.882585+0000","last_active":"2024-09-10T20:39:57.870236+0000","last_peered":"2024-09-10T20:39:57.870236+0000","last_clean":"2024-09-10T20:39:57.870236+0000","last_became_active":"2024-09-10T20:39:56.882093+0000","last_became_peered":"2024-09-10T20:39:56.882093+0000","last_unstale":"2024-09-10T20:39:57.870236+0000","last_undegraded":"2024-09-10T20:39:57.870236+0000","last_fullsized":"2024-09-10T20:39:57.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456325+0000","last_change":"2024-09-10T20:39:52.861639+0000","last_active":"2024-09-10T20:39:58.456325+0000","last_peered":"2024-09-10T20:39:58.456325+0000","last_clean":"2024-09-10T20:39:58.456325+0000","last_became_active":"2024-09-10T20:39:52.861383+0000","last_became_peered":"2024-09-10T20:39:52.861383+0000","last_unstale":"2024-09-10T20:39:58.456325+0000","last_undegraded":"2024-09-10T20:39:58.456325+0000","last_fullsized":"2024-09-10T20:39:58.456325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:47.156926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872896+0000","last_change":"2024-09-10T20:39:51.835770+0000","last_active":"2024-09-10T20:39:57.872896+0000","last_peered":"2024-09-10T20:39:57.872896+0000","last_clean":"2024-09-10T20:39:57.872896+0000","last_became_active":"2024-09-10T20:39:51.835470+0000","last_became_peered":"2024-09-10T20:39:51.835470+0000","last_unstale":"2024-09-10T20:39:57.872896+0000","last_undegraded":"2024-09-10T20:39:57.872896+0000","last_fullsized":"2024-09-10T20:39:57.872896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:38.530675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870076+0000","last_change":"2024-09-10T20:39:56.882138+0000","last_active":"2024-09-10T20:39:57.870076+0000","last_peered":"2024-09-10T20:39:57.870076+0000","last_clean":"2024-09-10T20:39:57.870076+0000","last_became_active":"2024-09-10T20:39:56.875117+0000","last_became_peered":"2024-09-10T20:39:56.875117+0000","last_unstale":"2024-09-10T20:39:57.870076+0000","last_undegraded":"2024-09-10T20:39:57.870076+0000","last_fullsized":"2024-09-10T20:39:57.870076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869855+0000","last_change":"2024-09-10T20:39:52.842774+0000","last_active":"2024-09-10T20:39:57.869855+0000","last_peered":"2024-09-10T20:39:57.869855+0000","last_clean":"2024-09-10T20:39:57.869855+0000","last_became_active":"2024-09-10T20:39:52.842446+0000","last_became_peered":"2024-09-10T20:39:52.842446+0000","last_unstale":"2024-09-10T20:39:57.869855+0000","last_undegraded":"2024-09-10T20:39:57.869855+0000","last_fullsized":"2024-09-10T20:39:57.869855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:29.034488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577469+0000","last_change":"2024-09-10T20:39:51.834088+0000","last_active":"2024-09-10T20:39:58.577469+0000","last_peered":"2024-09-10T20:39:58.577469+0000","last_clean":"2024-09-10T20:39:58.577469+0000","last_became_active":"2024-09-10T20:39:51.830213+0000","last_became_peered":"2024-09-10T20:39:51.830213+0000","last_unstale":"2024-09-10T20:39:58.577469+0000","last_undegraded":"2024-09-10T20:39:58.577469+0000","last_fullsized":"2024-09-10T20:39:58.577469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:08.073166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871242+0000","last_change":"2024-09-10T20:39:56.876963+0000","last_active":"2024-09-10T20:39:57.871242+0000","last_peered":"2024-09-10T20:39:57.871242+0000","last_clean":"2024-09-10T20:39:57.871242+0000","last_became_active":"2024-09-10T20:39:56.876565+0000","last_became_peered":"2024-09-10T20:39:56.876565+0000","last_unstale":"2024-09-10T20:39:57.871242+0000","last_undegraded":"2024-09-10T20:39:57.871242+0000","last_fullsized":"2024-09-10T20:39:57.871242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869844+0000","last_change":"2024-09-10T20:39:52.860096+0000","last_active":"2024-09-10T20:39:57.869844+0000","last_peered":"2024-09-10T20:39:57.869844+0000","last_clean":"2024-09-10T20:39:57.869844+0000","last_became_active":"2024-09-10T20:39:52.859815+0000","last_became_peered":"2024-09-10T20:39:52.859815+0000","last_unstale":"2024-09-10T20:39:57.869844+0000","last_undegraded":"2024-09-10T20:39:57.869844+0000","last_fullsized":"2024-09-10T20:39:57.869844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:02.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872428+0000","last_change":"2024-09-10T20:39:51.837166+0000","last_active":"2024-09-10T20:39:57.872428+0000","last_peered":"2024-09-10T20:39:57.872428+0000","last_clean":"2024-09-10T20:39:57.872428+0000","last_became_active":"2024-09-10T20:39:51.836893+0000","last_became_peered":"2024-09-10T20:39:51.836893+0000","last_unstale":"2024-09-10T20:39:57.872428+0000","last_undegraded":"2024-09-10T20:39:57.872428+0000","last_fullsized":"2024-09-10T20:39:57.872428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:18.758447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871780+0000","last_change":"2024-09-10T20:39:56.874406+0000","last_active":"2024-09-10T20:39:57.871780+0000","last_peered":"2024-09-10T20:39:57.871780+0000","last_clean":"2024-09-10T20:39:57.871780+0000","last_became_active":"2024-09-10T20:39:56.874005+0000","last_became_peered":"2024-09-10T20:39:56.874005+0000","last_unstale":"2024-09-10T20:39:57.871780+0000","last_undegraded":"2024-09-10T20:39:57.871780+0000","last_fullsized":"2024-09-10T20:39:57.871780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:19.234557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577223+0000","last_change":"2024-09-10T20:39:52.860106+0000","last_active":"2024-09-10T20:39:58.577223+0000","last_peered":"2024-09-10T20:39:58.577223+0000","last_clean":"2024-09-10T20:39:58.577223+0000","last_became_active":"2024-09-10T20:39:52.859856+0000","last_became_peered":"2024-09-10T20:39:52.859856+0000","last_unstale":"2024-09-10T20:39:58.577223+0000","last_undegraded":"2024-09-10T20:39:58.577223+0000","last_fullsized":"2024-09-10T20:39:58.577223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872964+0000","last_change":"2024-09-10T20:39:51.830052+0000","last_active":"2024-09-10T20:39:57.872964+0000","last_peered":"2024-09-10T20:39:57.872964+0000","last_clean":"2024-09-10T20:39:57.872964+0000","last_became_active":"2024-09-10T20:39:51.829826+0000","last_became_peered":"2024-09-10T20:39:51.829826+0000","last_unstale":"2024-09-10T20:39:57.872964+0000","last_undegraded":"2024-09-10T20:39:57.872964+0000","last_fullsized":"2024-09-10T20:39:57.872964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075483+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:39:58.075483+0000","last_peered":"2024-09-10T20:39:58.075483+0000","last_clean":"2024-09-10T20:39:58.075483+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:39:58.075483+0000","last_undegraded":"2024-09-10T20:39:58.075483+0000","last_fullsized":"2024-09-10T20:39:58.075483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873275+0000","last_change":"2024-09-10T20:39:56.886319+0000","last_active":"2024-09-10T20:39:57.873275+0000","last_peered":"2024-09-10T20:39:57.873275+0000","last_clean":"2024-09-10T20:39:57.873275+0000","last_became_active":"2024-09-10T20:39:56.884644+0000","last_became_peered":"2024-09-10T20:39:56.884644+0000","last_unstale":"2024-09-10T20:39:57.873275+0000","last_undegraded":"2024-09-10T20:39:57.873275+0000","last_fullsized":"2024-09-10T20:39:57.873275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.635249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873205+0000","last_change":"2024-09-10T20:39:52.841498+0000","last_active":"2024-09-10T20:39:57.873205+0000","last_peered":"2024-09-10T20:39:57.873205+0000","last_clean":"2024-09-10T20:39:57.873205+0000","last_became_active":"2024-09-10T20:39:52.841257+0000","last_became_peered":"2024-09-10T20:39:52.841257+0000","last_unstale":"2024-09-10T20:39:57.873205+0000","last_undegraded":"2024-09-10T20:39:57.873205+0000","last_fullsized":"2024-09-10T20:39:57.873205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:56.841902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870555+0000","last_change":"2024-09-10T20:39:51.831320+0000","last_active":"2024-09-10T20:39:57.870555+0000","last_peered":"2024-09-10T20:39:57.870555+0000","last_clean":"2024-09-10T20:39:57.870555+0000","last_became_active":"2024-09-10T20:39:51.831030+0000","last_became_peered":"2024-09-10T20:39:51.831030+0000","last_unstale":"2024-09-10T20:39:57.870555+0000","last_undegraded":"2024-09-10T20:39:57.870555+0000","last_fullsized":"2024-09-10T20:39:57.870555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576384+0000","last_change":"2024-09-10T20:39:56.876055+0000","last_active":"2024-09-10T20:39:58.576384+0000","last_peered":"2024-09-10T20:39:58.576384+0000","last_clean":"2024-09-10T20:39:58.576384+0000","last_became_active":"2024-09-10T20:39:56.875602+0000","last_became_peered":"2024-09-10T20:39:56.875602+0000","last_unstale":"2024-09-10T20:39:58.576384+0000","last_undegraded":"2024-09-10T20:39:58.576384+0000","last_fullsized":"2024-09-10T20:39:58.576384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:01.886686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456584+0000","last_change":"2024-09-10T20:39:52.856423+0000","last_active":"2024-09-10T20:39:58.456584+0000","last_peered":"2024-09-10T20:39:58.456584+0000","last_clean":"2024-09-10T20:39:58.456584+0000","last_became_active":"2024-09-10T20:39:52.855409+0000","last_became_peered":"2024-09-10T20:39:52.855409+0000","last_unstale":"2024-09-10T20:39:58.456584+0000","last_undegraded":"2024-09-10T20:39:58.456584+0000","last_fullsized":"2024-09-10T20:39:58.456584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:35.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871541+0000","last_change":"2024-09-10T20:39:51.833978+0000","last_active":"2024-09-10T20:39:57.871541+0000","last_peered":"2024-09-10T20:39:57.871541+0000","last_clean":"2024-09-10T20:39:57.871541+0000","last_became_active":"2024-09-10T20:39:51.833436+0000","last_became_peered":"2024-09-10T20:39:51.833436+0000","last_unstale":"2024-09-10T20:39:57.871541+0000","last_undegraded":"2024-09-10T20:39:57.871541+0000","last_fullsized":"2024-09-10T20:39:57.871541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:00.812828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870986+0000","last_change":"2024-09-10T20:39:56.879933+0000","last_active":"2024-09-10T20:39:57.870986+0000","last_peered":"2024-09-10T20:39:57.870986+0000","last_clean":"2024-09-10T20:39:57.870986+0000","last_became_active":"2024-09-10T20:39:56.879254+0000","last_became_peered":"2024-09-10T20:39:56.879254+0000","last_unstale":"2024-09-10T20:39:57.870986+0000","last_undegraded":"2024-09-10T20:39:57.870986+0000","last_fullsized":"2024-09-10T20:39:57.870986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:10.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456878+0000","last_change":"2024-09-10T20:39:52.852816+0000","last_active":"2024-09-10T20:39:58.456878+0000","last_peered":"2024-09-10T20:39:58.456878+0000","last_clean":"2024-09-10T20:39:58.456878+0000","last_became_active":"2024-09-10T20:39:52.851310+0000","last_became_peered":"2024-09-10T20:39:52.851310+0000","last_unstale":"2024-09-10T20:39:58.456878+0000","last_undegraded":"2024-09-10T20:39:58.456878+0000","last_fullsized":"2024-09-10T20:39:58.456878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577993+0000","last_change":"2024-09-10T20:39:51.831688+0000","last_active":"2024-09-10T20:39:58.577993+0000","last_peered":"2024-09-10T20:39:58.577993+0000","last_clean":"2024-09-10T20:39:58.577993+0000","last_became_active":"2024-09-10T20:39:51.827155+0000","last_became_peered":"2024-09-10T20:39:51.827155+0000","last_unstale":"2024-09-10T20:39:58.577993+0000","last_undegraded":"2024-09-10T20:39:58.577993+0000","last_fullsized":"2024-09-10T20:39:58.577993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872194+0000","last_change":"2024-09-10T20:39:56.882581+0000","last_active":"2024-09-10T20:39:57.872194+0000","last_peered":"2024-09-10T20:39:57.872194+0000","last_clean":"2024-09-10T20:39:57.872194+0000","last_became_active":"2024-09-10T20:39:56.882242+0000","last_became_peered":"2024-09-10T20:39:56.882242+0000","last_unstale":"2024-09-10T20:39:57.872194+0000","last_undegraded":"2024-09-10T20:39:57.872194+0000","last_fullsized":"2024-09-10T20:39:57.872194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:18.763655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577376+0000","last_change":"2024-09-10T20:39:52.858795+0000","last_active":"2024-09-10T20:39:58.577376+0000","last_peered":"2024-09-10T20:39:58.577376+0000","last_clean":"2024-09-10T20:39:58.577376+0000","last_became_active":"2024-09-10T20:39:52.858501+0000","last_became_peered":"2024-09-10T20:39:52.858501+0000","last_unstale":"2024-09-10T20:39:58.577376+0000","last_undegraded":"2024-09-10T20:39:58.577376+0000","last_fullsized":"2024-09-10T20:39:58.577376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:13.273835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456897+0000","last_change":"2024-09-10T20:39:51.838792+0000","last_active":"2024-09-10T20:39:58.456897+0000","last_peered":"2024-09-10T20:39:58.456897+0000","last_clean":"2024-09-10T20:39:58.456897+0000","last_became_active":"2024-09-10T20:39:51.838547+0000","last_became_peered":"2024-09-10T20:39:51.838547+0000","last_unstale":"2024-09-10T20:39:58.456897+0000","last_undegraded":"2024-09-10T20:39:58.456897+0000","last_fullsized":"2024-09-10T20:39:58.456897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075650+0000","last_change":"2024-09-10T20:39:56.872369+0000","last_active":"2024-09-10T20:39:58.075650+0000","last_peered":"2024-09-10T20:39:58.075650+0000","last_clean":"2024-09-10T20:39:58.075650+0000","last_became_active":"2024-09-10T20:39:56.871964+0000","last_became_peered":"2024-09-10T20:39:56.871964+0000","last_unstale":"2024-09-10T20:39:58.075650+0000","last_undegraded":"2024-09-10T20:39:58.075650+0000","last_fullsized":"2024-09-10T20:39:58.075650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:17.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872297+0000","last_change":"2024-09-10T20:39:52.848064+0000","last_active":"2024-09-10T20:39:57.872297+0000","last_peered":"2024-09-10T20:39:57.872297+0000","last_clean":"2024-09-10T20:39:57.872297+0000","last_became_active":"2024-09-10T20:39:52.847836+0000","last_became_peered":"2024-09-10T20:39:52.847836+0000","last_unstale":"2024-09-10T20:39:57.872297+0000","last_undegraded":"2024-09-10T20:39:57.872297+0000","last_fullsized":"2024-09-10T20:39:57.872297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:17.051921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577568+0000","last_change":"2024-09-10T20:39:51.827434+0000","last_active":"2024-09-10T20:39:58.577568+0000","last_peered":"2024-09-10T20:39:58.577568+0000","last_clean":"2024-09-10T20:39:58.577568+0000","last_became_active":"2024-09-10T20:39:51.826046+0000","last_became_peered":"2024-09-10T20:39:51.826046+0000","last_unstale":"2024-09-10T20:39:58.577568+0000","last_undegraded":"2024-09-10T20:39:58.577568+0000","last_fullsized":"2024-09-10T20:39:58.577568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871947+0000","last_change":"2024-09-10T20:39:56.879394+0000","last_active":"2024-09-10T20:39:57.871947+0000","last_peered":"2024-09-10T20:39:57.871947+0000","last_clean":"2024-09-10T20:39:57.871947+0000","last_became_active":"2024-09-10T20:39:56.879041+0000","last_became_peered":"2024-09-10T20:39:56.879041+0000","last_unstale":"2024-09-10T20:39:57.871947+0000","last_undegraded":"2024-09-10T20:39:57.871947+0000","last_fullsized":"2024-09-10T20:39:57.871947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:42.040215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075444+0000","last_change":"2024-09-10T20:39:52.836545+0000","last_active":"2024-09-10T20:39:58.075444+0000","last_peered":"2024-09-10T20:39:58.075444+0000","last_clean":"2024-09-10T20:39:58.075444+0000","last_became_active":"2024-09-10T20:39:52.836266+0000","last_became_peered":"2024-09-10T20:39:52.836266+0000","last_unstale":"2024-09-10T20:39:58.075444+0000","last_undegraded":"2024-09-10T20:39:58.075444+0000","last_fullsized":"2024-09-10T20:39:58.075444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:39.345060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456157+0000","last_change":"2024-09-10T20:39:51.833755+0000","last_active":"2024-09-10T20:39:58.456157+0000","last_peered":"2024-09-10T20:39:58.456157+0000","last_clean":"2024-09-10T20:39:58.456157+0000","last_became_active":"2024-09-10T20:39:51.833384+0000","last_became_peered":"2024-09-10T20:39:51.833384+0000","last_unstale":"2024-09-10T20:39:58.456157+0000","last_undegraded":"2024-09-10T20:39:58.456157+0000","last_fullsized":"2024-09-10T20:39:58.456157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871522+0000","last_change":"2024-09-10T20:39:56.876669+0000","last_active":"2024-09-10T20:39:57.871522+0000","last_peered":"2024-09-10T20:39:57.871522+0000","last_clean":"2024-09-10T20:39:57.871522+0000","last_became_active":"2024-09-10T20:39:56.876230+0000","last_became_peered":"2024-09-10T20:39:56.876230+0000","last_unstale":"2024-09-10T20:39:57.871522+0000","last_undegraded":"2024-09-10T20:39:57.871522+0000","last_fullsized":"2024-09-10T20:39:57.871522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:04.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872716+0000","last_change":"2024-09-10T20:39:52.840978+0000","last_active":"2024-09-10T20:39:57.872716+0000","last_peered":"2024-09-10T20:39:57.872716+0000","last_clean":"2024-09-10T20:39:57.872716+0000","last_became_active":"2024-09-10T20:39:52.840710+0000","last_became_peered":"2024-09-10T20:39:52.840710+0000","last_unstale":"2024-09-10T20:39:57.872716+0000","last_undegraded":"2024-09-10T20:39:57.872716+0000","last_fullsized":"2024-09-10T20:39:57.872716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:17.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872789+0000","last_change":"2024-09-10T20:39:51.837821+0000","last_active":"2024-09-10T20:39:57.872789+0000","last_peered":"2024-09-10T20:39:57.872789+0000","last_clean":"2024-09-10T20:39:57.872789+0000","last_became_active":"2024-09-10T20:39:51.836390+0000","last_became_peered":"2024-09-10T20:39:51.836390+0000","last_unstale":"2024-09-10T20:39:57.872789+0000","last_undegraded":"2024-09-10T20:39:57.872789+0000","last_fullsized":"2024-09-10T20:39:57.872789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:47.684343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869817+0000","last_change":"2024-09-10T20:39:56.875780+0000","last_active":"2024-09-10T20:39:57.869817+0000","last_peered":"2024-09-10T20:39:57.869817+0000","last_clean":"2024-09-10T20:39:57.869817+0000","last_became_active":"2024-09-10T20:39:56.875088+0000","last_became_peered":"2024-09-10T20:39:56.875088+0000","last_unstale":"2024-09-10T20:39:57.869817+0000","last_undegraded":"2024-09-10T20:39:57.869817+0000","last_fullsized":"2024-09-10T20:39:57.869817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:21.298196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870634+0000","last_change":"2024-09-10T20:39:52.856029+0000","last_active":"2024-09-10T20:39:57.870634+0000","last_peered":"2024-09-10T20:39:57.870634+0000","last_clean":"2024-09-10T20:39:57.870634+0000","last_became_active":"2024-09-10T20:39:52.855776+0000","last_became_peered":"2024-09-10T20:39:52.855776+0000","last_unstale":"2024-09-10T20:39:57.870634+0000","last_undegraded":"2024-09-10T20:39:57.870634+0000","last_fullsized":"2024-09-10T20:39:57.870634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:31.338948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578682+0000","last_change":"2024-09-10T20:39:51.828785+0000","last_active":"2024-09-10T20:39:58.578682+0000","last_peered":"2024-09-10T20:39:58.578682+0000","last_clean":"2024-09-10T20:39:58.578682+0000","last_became_active":"2024-09-10T20:39:51.828496+0000","last_became_peered":"2024-09-10T20:39:51.828496+0000","last_unstale":"2024-09-10T20:39:58.578682+0000","last_undegraded":"2024-09-10T20:39:58.578682+0000","last_fullsized":"2024-09-10T20:39:58.578682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:36.547419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873081+0000","last_change":"2024-09-10T20:39:56.885656+0000","last_active":"2024-09-10T20:39:57.873081+0000","last_peered":"2024-09-10T20:39:57.873081+0000","last_clean":"2024-09-10T20:39:57.873081+0000","last_became_active":"2024-09-10T20:39:56.881762+0000","last_became_peered":"2024-09-10T20:39:56.881762+0000","last_unstale":"2024-09-10T20:39:57.873081+0000","last_undegraded":"2024-09-10T20:39:57.873081+0000","last_fullsized":"2024-09-10T20:39:57.873081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:42.541386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456583+0000","last_change":"2024-09-10T20:39:52.851647+0000","last_active":"2024-09-10T20:39:58.456583+0000","last_peered":"2024-09-10T20:39:58.456583+0000","last_clean":"2024-09-10T20:39:58.456583+0000","last_became_active":"2024-09-10T20:39:52.851358+0000","last_became_peered":"2024-09-10T20:39:52.851358+0000","last_unstale":"2024-09-10T20:39:58.456583+0000","last_undegraded":"2024-09-10T20:39:58.456583+0000","last_fullsized":"2024-09-10T20:39:58.456583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:43.399295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:40:04.050528+0000","last_change":"2024-09-10T20:39:51.836741+0000","last_active":"2024-09-10T20:40:04.050528+0000","last_peered":"2024-09-10T20:40:04.050528+0000","last_clean":"2024-09-10T20:40:04.050528+0000","last_became_active":"2024-09-10T20:39:51.836492+0000","last_became_peered":"2024-09-10T20:39:51.836492+0000","last_unstale":"2024-09-10T20:40:04.050528+0000","last_undegraded":"2024-09-10T20:40:04.050528+0000","last_fullsized":"2024-09-10T20:40:04.050528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.827648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577118+0000","last_change":"2024-09-10T20:39:56.870600+0000","last_active":"2024-09-10T20:39:58.577118+0000","last_peered":"2024-09-10T20:39:58.577118+0000","last_clean":"2024-09-10T20:39:58.577118+0000","last_became_active":"2024-09-10T20:39:56.870128+0000","last_became_peered":"2024-09-10T20:39:56.870128+0000","last_unstale":"2024-09-10T20:39:58.577118+0000","last_undegraded":"2024-09-10T20:39:58.577118+0000","last_fullsized":"2024-09-10T20:39:58.577118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872529+0000","last_change":"2024-09-10T20:39:52.867767+0000","last_active":"2024-09-10T20:39:57.872529+0000","last_peered":"2024-09-10T20:39:57.872529+0000","last_clean":"2024-09-10T20:39:57.872529+0000","last_became_active":"2024-09-10T20:39:52.867458+0000","last_became_peered":"2024-09-10T20:39:52.867458+0000","last_unstale":"2024-09-10T20:39:57.872529+0000","last_undegraded":"2024-09-10T20:39:57.872529+0000","last_fullsized":"2024-09-10T20:39:57.872529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.084789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578769+0000","last_change":"2024-09-10T20:39:51.836668+0000","last_active":"2024-09-10T20:39:58.578769+0000","last_peered":"2024-09-10T20:39:58.578769+0000","last_clean":"2024-09-10T20:39:58.578769+0000","last_became_active":"2024-09-10T20:39:51.835742+0000","last_became_peered":"2024-09-10T20:39:51.835742+0000","last_unstale":"2024-09-10T20:39:58.578769+0000","last_undegraded":"2024-09-10T20:39:58.578769+0000","last_fullsized":"2024-09-10T20:39:58.578769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576664+0000","last_change":"2024-09-10T20:39:56.882037+0000","last_active":"2024-09-10T20:39:58.576664+0000","last_peered":"2024-09-10T20:39:58.576664+0000","last_clean":"2024-09-10T20:39:58.576664+0000","last_became_active":"2024-09-10T20:39:56.881084+0000","last_became_peered":"2024-09-10T20:39:56.881084+0000","last_unstale":"2024-09-10T20:39:58.576664+0000","last_undegraded":"2024-09-10T20:39:58.576664+0000","last_fullsized":"2024-09-10T20:39:58.576664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871674+0000","last_change":"2024-09-10T20:39:52.849174+0000","last_active":"2024-09-10T20:39:57.871674+0000","last_peered":"2024-09-10T20:39:57.871674+0000","last_clean":"2024-09-10T20:39:57.871674+0000","last_became_active":"2024-09-10T20:39:52.848762+0000","last_became_peered":"2024-09-10T20:39:52.848762+0000","last_unstale":"2024-09-10T20:39:57.871674+0000","last_undegraded":"2024-09-10T20:39:57.871674+0000","last_fullsized":"2024-09-10T20:39:57.871674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:16.849067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456678+0000","last_change":"2024-09-10T20:39:51.827946+0000","last_active":"2024-09-10T20:39:58.456678+0000","last_peered":"2024-09-10T20:39:58.456678+0000","last_clean":"2024-09-10T20:39:58.456678+0000","last_became_active":"2024-09-10T20:39:51.827668+0000","last_became_peered":"2024-09-10T20:39:51.827668+0000","last_unstale":"2024-09-10T20:39:58.456678+0000","last_undegraded":"2024-09-10T20:39:58.456678+0000","last_fullsized":"2024-09-10T20:39:58.456678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576917+0000","last_change":"2024-09-10T20:39:56.890560+0000","last_active":"2024-09-10T20:39:58.576917+0000","last_peered":"2024-09-10T20:39:58.576917+0000","last_clean":"2024-09-10T20:39:58.576917+0000","last_became_active":"2024-09-10T20:39:56.890207+0000","last_became_peered":"2024-09-10T20:39:56.890207+0000","last_unstale":"2024-09-10T20:39:58.576917+0000","last_undegraded":"2024-09-10T20:39:58.576917+0000","last_fullsized":"2024-09-10T20:39:58.576917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:35.374852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577293+0000","last_change":"2024-09-10T20:39:52.865954+0000","last_active":"2024-09-10T20:39:58.577293+0000","last_peered":"2024-09-10T20:39:58.577293+0000","last_clean":"2024-09-10T20:39:58.577293+0000","last_became_active":"2024-09-10T20:39:52.865077+0000","last_became_peered":"2024-09-10T20:39:52.865077+0000","last_unstale":"2024-09-10T20:39:58.577293+0000","last_undegraded":"2024-09-10T20:39:58.577293+0000","last_fullsized":"2024-09-10T20:39:58.577293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:20.726727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076179+0000","last_change":"2024-09-10T20:39:51.822729+0000","last_active":"2024-09-10T20:39:58.076179+0000","last_peered":"2024-09-10T20:39:58.076179+0000","last_clean":"2024-09-10T20:39:58.076179+0000","last_became_active":"2024-09-10T20:39:51.822465+0000","last_became_peered":"2024-09-10T20:39:51.822465+0000","last_unstale":"2024-09-10T20:39:58.076179+0000","last_undegraded":"2024-09-10T20:39:58.076179+0000","last_fullsized":"2024-09-10T20:39:58.076179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577450+0000","last_change":"2024-09-10T20:39:56.871160+0000","last_active":"2024-09-10T20:39:58.577450+0000","last_peered":"2024-09-10T20:39:58.577450+0000","last_clean":"2024-09-10T20:39:58.577450+0000","last_became_active":"2024-09-10T20:39:56.870762+0000","last_became_peered":"2024-09-10T20:39:56.870762+0000","last_unstale":"2024-09-10T20:39:58.577450+0000","last_undegraded":"2024-09-10T20:39:58.577450+0000","last_fullsized":"2024-09-10T20:39:58.577450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:40.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577908+0000","last_change":"2024-09-10T20:39:56.875335+0000","last_active":"2024-09-10T20:39:58.577908+0000","last_peered":"2024-09-10T20:39:58.577908+0000","last_clean":"2024-09-10T20:39:58.577908+0000","last_became_active":"2024-09-10T20:39:56.874929+0000","last_became_peered":"2024-09-10T20:39:56.874929+0000","last_unstale":"2024-09-10T20:39:58.577908+0000","last_undegraded":"2024-09-10T20:39:58.577908+0000","last_fullsized":"2024-09-10T20:39:58.577908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:00.877805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577652+0000","last_change":"2024-09-10T20:39:52.841133+0000","last_active":"2024-09-10T20:39:58.577652+0000","last_peered":"2024-09-10T20:39:58.577652+0000","last_clean":"2024-09-10T20:39:58.577652+0000","last_became_active":"2024-09-10T20:39:52.840806+0000","last_became_peered":"2024-09-10T20:39:52.840806+0000","last_unstale":"2024-09-10T20:39:58.577652+0000","last_undegraded":"2024-09-10T20:39:58.577652+0000","last_fullsized":"2024-09-10T20:39:58.577652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:22.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872394+0000","last_change":"2024-09-10T20:39:51.834171+0000","last_active":"2024-09-10T20:39:57.872394+0000","last_peered":"2024-09-10T20:39:57.872394+0000","last_clean":"2024-09-10T20:39:57.872394+0000","last_became_active":"2024-09-10T20:39:51.833897+0000","last_became_peered":"2024-09-10T20:39:51.833897+0000","last_unstale":"2024-09-10T20:39:57.872394+0000","last_undegraded":"2024-09-10T20:39:57.872394+0000","last_fullsized":"2024-09-10T20:39:57.872394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:19.719836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872638+0000","last_change":"2024-09-10T20:39:56.872254+0000","last_active":"2024-09-10T20:39:57.872638+0000","last_peered":"2024-09-10T20:39:57.872638+0000","last_clean":"2024-09-10T20:39:57.872638+0000","last_became_active":"2024-09-10T20:39:56.871890+0000","last_became_peered":"2024-09-10T20:39:56.871890+0000","last_unstale":"2024-09-10T20:39:57.872638+0000","last_undegraded":"2024-09-10T20:39:57.872638+0000","last_fullsized":"2024-09-10T20:39:57.872638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:13.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869957+0000","last_change":"2024-09-10T20:39:52.851621+0000","last_active":"2024-09-10T20:39:57.869957+0000","last_peered":"2024-09-10T20:39:57.869957+0000","last_clean":"2024-09-10T20:39:57.869957+0000","last_became_active":"2024-09-10T20:39:52.851307+0000","last_became_peered":"2024-09-10T20:39:52.851307+0000","last_unstale":"2024-09-10T20:39:57.869957+0000","last_undegraded":"2024-09-10T20:39:57.869957+0000","last_fullsized":"2024-09-10T20:39:57.869957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:02.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869951+0000","last_change":"2024-09-10T20:39:51.832088+0000","last_active":"2024-09-10T20:39:57.869951+0000","last_peered":"2024-09-10T20:39:57.869951+0000","last_clean":"2024-09-10T20:39:57.869951+0000","last_became_active":"2024-09-10T20:39:51.831590+0000","last_became_peered":"2024-09-10T20:39:51.831590+0000","last_unstale":"2024-09-10T20:39:57.869951+0000","last_undegraded":"2024-09-10T20:39:57.869951+0000","last_fullsized":"2024-09-10T20:39:57.869951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:11.450509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872645+0000","last_change":"2024-09-10T20:39:51.841531+0000","last_active":"2024-09-10T20:39:57.872645+0000","last_peered":"2024-09-10T20:39:57.872645+0000","last_clean":"2024-09-10T20:39:57.872645+0000","last_became_active":"2024-09-10T20:39:51.841294+0000","last_became_peered":"2024-09-10T20:39:51.841294+0000","last_unstale":"2024-09-10T20:39:57.872645+0000","last_undegraded":"2024-09-10T20:39:57.872645+0000","last_fullsized":"2024-09-10T20:39:57.872645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.838524+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.838252+0000","last_became_peered":"2024-09-10T20:39:52.838252+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:32.234408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577531+0000","last_change":"2024-09-10T20:39:56.874073+0000","last_active":"2024-09-10T20:39:58.577531+0000","last_peered":"2024-09-10T20:39:58.577531+0000","last_clean":"2024-09-10T20:39:58.577531+0000","last_became_active":"2024-09-10T20:39:56.873456+0000","last_became_peered":"2024-09-10T20:39:56.873456+0000","last_unstale":"2024-09-10T20:39:58.577531+0000","last_undegraded":"2024-09-10T20:39:58.577531+0000","last_fullsized":"2024-09-10T20:39:58.577531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:51.097723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870967+0000","last_change":"2024-09-10T20:39:51.823981+0000","last_active":"2024-09-10T20:39:57.870967+0000","last_peered":"2024-09-10T20:39:57.870967+0000","last_clean":"2024-09-10T20:39:57.870967+0000","last_became_active":"2024-09-10T20:39:51.823667+0000","last_became_peered":"2024-09-10T20:39:51.823667+0000","last_unstale":"2024-09-10T20:39:57.870967+0000","last_undegraded":"2024-09-10T20:39:57.870967+0000","last_fullsized":"2024-09-10T20:39:57.870967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:53.926735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075527+0000","last_change":"2024-09-10T20:39:52.842250+0000","last_active":"2024-09-10T20:39:58.075527+0000","last_peered":"2024-09-10T20:39:58.075527+0000","last_clean":"2024-09-10T20:39:58.075527+0000","last_became_active":"2024-09-10T20:39:52.842013+0000","last_became_peered":"2024-09-10T20:39:52.842013+0000","last_unstale":"2024-09-10T20:39:58.075527+0000","last_undegraded":"2024-09-10T20:39:58.075527+0000","last_fullsized":"2024-09-10T20:39:58.075527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:19.358235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578569+0000","last_change":"2024-09-10T20:39:56.873781+0000","last_active":"2024-09-10T20:39:58.578569+0000","last_peered":"2024-09-10T20:39:58.578569+0000","last_clean":"2024-09-10T20:39:58.578569+0000","last_became_active":"2024-09-10T20:39:56.871150+0000","last_became_peered":"2024-09-10T20:39:56.871150+0000","last_unstale":"2024-09-10T20:39:58.578569+0000","last_undegraded":"2024-09-10T20:39:58.578569+0000","last_fullsized":"2024-09-10T20:39:58.578569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:03.889499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576369+0000","last_change":"2024-09-10T20:39:52.858032+0000","last_active":"2024-09-10T20:39:58.576369+0000","last_peered":"2024-09-10T20:39:58.576369+0000","last_clean":"2024-09-10T20:39:58.576369+0000","last_became_active":"2024-09-10T20:39:52.851049+0000","last_became_peered":"2024-09-10T20:39:52.851049+0000","last_unstale":"2024-09-10T20:39:58.576369+0000","last_undegraded":"2024-09-10T20:39:58.576369+0000","last_fullsized":"2024-09-10T20:39:58.576369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.850149+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.849435+0000","last_became_peered":"2024-09-10T20:39:52.849435+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:13.186313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872460+0000","last_change":"2024-09-10T20:39:52.849458+0000","last_active":"2024-09-10T20:39:57.872460+0000","last_peered":"2024-09-10T20:39:57.872460+0000","last_clean":"2024-09-10T20:39:57.872460+0000","last_became_active":"2024-09-10T20:39:52.844995+0000","last_became_peered":"2024-09-10T20:39:52.844995+0000","last_unstale":"2024-09-10T20:39:57.872460+0000","last_undegraded":"2024-09-10T20:39:57.872460+0000","last_fullsized":"2024-09-10T20:39:57.872460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870856+0000","last_change":"2024-09-10T20:39:52.840179+0000","last_active":"2024-09-10T20:39:57.870856+0000","last_peered":"2024-09-10T20:39:57.870856+0000","last_clean":"2024-09-10T20:39:57.870856+0000","last_became_active":"2024-09-10T20:39:52.839890+0000","last_became_peered":"2024-09-10T20:39:52.839890+0000","last_unstale":"2024-09-10T20:39:57.870856+0000","last_undegraded":"2024-09-10T20:39:57.870856+0000","last_fullsized":"2024-09-10T20:39:57.870856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:47.732259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870243+0000","last_change":"2024-09-10T20:39:52.853516+0000","last_active":"2024-09-10T20:39:57.870243+0000","last_peered":"2024-09-10T20:39:57.870243+0000","last_clean":"2024-09-10T20:39:57.870243+0000","last_became_active":"2024-09-10T20:39:52.853256+0000","last_became_peered":"2024-09-10T20:39:52.853256+0000","last_unstale":"2024-09-10T20:39:57.870243+0000","last_undegraded":"2024-09-10T20:39:57.870243+0000","last_fullsized":"2024-09-10T20:39:57.870243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:59.853596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870433+0000","last_change":"2024-09-10T20:39:52.859738+0000","last_active":"2024-09-10T20:39:57.870433+0000","last_peered":"2024-09-10T20:39:57.870433+0000","last_clean":"2024-09-10T20:39:57.870433+0000","last_became_active":"2024-09-10T20:39:52.859463+0000","last_became_peered":"2024-09-10T20:39:52.859463+0000","last_unstale":"2024-09-10T20:39:57.870433+0000","last_undegraded":"2024-09-10T20:39:57.870433+0000","last_fullsized":"2024-09-10T20:39:57.870433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:55.113983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577211+0000","last_change":"2024-09-10T20:39:52.867039+0000","last_active":"2024-09-10T20:39:58.577211+0000","last_peered":"2024-09-10T20:39:58.577211+0000","last_clean":"2024-09-10T20:39:58.577211+0000","last_became_active":"2024-09-10T20:39:52.865884+0000","last_became_peered":"2024-09-10T20:39:52.865884+0000","last_unstale":"2024-09-10T20:39:58.577211+0000","last_undegraded":"2024-09-10T20:39:58.577211+0000","last_fullsized":"2024-09-10T20:39:58.577211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:39.994022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871253+0000","last_change":"2024-09-10T20:39:52.844959+0000","last_active":"2024-09-10T20:39:57.871253+0000","last_peered":"2024-09-10T20:39:57.871253+0000","last_clean":"2024-09-10T20:39:57.871253+0000","last_became_active":"2024-09-10T20:39:52.844642+0000","last_became_peered":"2024-09-10T20:39:52.844642+0000","last_unstale":"2024-09-10T20:39:57.871253+0000","last_undegraded":"2024-09-10T20:39:57.871253+0000","last_fullsized":"2024-09-10T20:39:57.871253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:52:36.606145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872318+0000","last_change":"2024-09-10T20:39:52.844163+0000","last_active":"2024-09-10T20:39:57.872318+0000","last_peered":"2024-09-10T20:39:57.872318+0000","last_clean":"2024-09-10T20:39:57.872318+0000","last_became_active":"2024-09-10T20:39:52.843914+0000","last_became_peered":"2024-09-10T20:39:52.843914+0000","last_unstale":"2024-09-10T20:39:57.872318+0000","last_undegraded":"2024-09-10T20:39:57.872318+0000","last_fullsized":"2024-09-10T20:39:57.872318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:57.293478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869918+0000","last_change":"2024-09-10T20:39:52.858267+0000","last_active":"2024-09-10T20:39:57.869918+0000","last_peered":"2024-09-10T20:39:57.869918+0000","last_clean":"2024-09-10T20:39:57.869918+0000","last_became_active":"2024-09-10T20:39:52.857994+0000","last_became_peered":"2024-09-10T20:39:52.857994+0000","last_unstale":"2024-09-10T20:39:57.869918+0000","last_undegraded":"2024-09-10T20:39:57.869918+0000","last_fullsized":"2024-09-10T20:39:57.869918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:54.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075525+0000","last_change":"2024-09-10T20:39:52.839856+0000","last_active":"2024-09-10T20:39:58.075525+0000","last_peered":"2024-09-10T20:39:58.075525+0000","last_clean":"2024-09-10T20:39:58.075525+0000","last_became_active":"2024-09-10T20:39:52.839371+0000","last_became_peered":"2024-09-10T20:39:52.839371+0000","last_unstale":"2024-09-10T20:39:58.075525+0000","last_undegraded":"2024-09-10T20:39:58.075525+0000","last_fullsized":"2024-09-10T20:39:58.075525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:26.611475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577919+0000","last_change":"2024-09-10T20:39:52.847903+0000","last_active":"2024-09-10T20:39:58.577919+0000","last_peered":"2024-09-10T20:39:58.577919+0000","last_clean":"2024-09-10T20:39:58.577919+0000","last_became_active":"2024-09-10T20:39:52.845560+0000","last_became_peered":"2024-09-10T20:39:52.845560+0000","last_unstale":"2024-09-10T20:39:58.577919+0000","last_undegraded":"2024-09-10T20:39:58.577919+0000","last_fullsized":"2024-09-10T20:39:58.577919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:17.131990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456492+0000","last_change":"2024-09-10T20:39:52.848817+0000","last_active":"2024-09-10T20:39:58.456492+0000","last_peered":"2024-09-10T20:39:58.456492+0000","last_clean":"2024-09-10T20:39:58.456492+0000","last_became_active":"2024-09-10T20:39:52.848189+0000","last_became_peered":"2024-09-10T20:39:52.848189+0000","last_unstale":"2024-09-10T20:39:58.456492+0000","last_undegraded":"2024-09-10T20:39:58.456492+0000","last_fullsized":"2024-09-10T20:39:58.456492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:21.966758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873355+0000","last_change":"2024-09-10T20:39:52.846495+0000","last_active":"2024-09-10T20:39:57.873355+0000","last_peered":"2024-09-10T20:39:57.873355+0000","last_clean":"2024-09-10T20:39:57.873355+0000","last_became_active":"2024-09-10T20:39:52.846187+0000","last_became_peered":"2024-09-10T20:39:52.846187+0000","last_unstale":"2024-09-10T20:39:57.873355+0000","last_undegraded":"2024-09-10T20:39:57.873355+0000","last_fullsized":"2024-09-10T20:39:57.873355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:15.910087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578849+0000","last_change":"2024-09-10T20:39:52.862017+0000","last_active":"2024-09-10T20:39:58.578849+0000","last_peered":"2024-09-10T20:39:58.578849+0000","last_clean":"2024-09-10T20:39:58.578849+0000","last_became_active":"2024-09-10T20:39:52.861762+0000","last_became_peered":"2024-09-10T20:39:52.861762+0000","last_unstale":"2024-09-10T20:39:58.578849+0000","last_undegraded":"2024-09-10T20:39:58.578849+0000","last_fullsized":"2024-09-10T20:39:58.578849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873597+0000","last_change":"2024-09-10T20:39:52.849628+0000","last_active":"2024-09-10T20:39:57.873597+0000","last_peered":"2024-09-10T20:39:57.873597+0000","last_clean":"2024-09-10T20:39:57.873597+0000","last_became_active":"2024-09-10T20:39:52.849327+0000","last_became_peered":"2024-09-10T20:39:52.849327+0000","last_unstale":"2024-09-10T20:39:57.873597+0000","last_undegraded":"2024-09-10T20:39:57.873597+0000","last_fullsized":"2024-09-10T20:39:57.873597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:13.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872215+0000","last_change":"2024-09-10T20:39:52.859978+0000","last_active":"2024-09-10T20:39:57.872215+0000","last_peered":"2024-09-10T20:39:57.872215+0000","last_clean":"2024-09-10T20:39:57.872215+0000","last_became_active":"2024-09-10T20:39:52.859786+0000","last_became_peered":"2024-09-10T20:39:52.859786+0000","last_unstale":"2024-09-10T20:39:57.872215+0000","last_undegraded":"2024-09-10T20:39:57.872215+0000","last_fullsized":"2024-09-10T20:39:57.872215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869715+0000","last_change":"2024-09-10T20:39:52.839446+0000","last_active":"2024-09-10T20:39:57.869715+0000","last_peered":"2024-09-10T20:39:57.869715+0000","last_clean":"2024-09-10T20:39:57.869715+0000","last_became_active":"2024-09-10T20:39:52.839065+0000","last_became_peered":"2024-09-10T20:39:52.839065+0000","last_unstale":"2024-09-10T20:39:57.869715+0000","last_undegraded":"2024-09-10T20:39:57.869715+0000","last_fullsized":"2024-09-10T20:39:57.869715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:18:21.362301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870520+0000","last_change":"2024-09-10T20:39:52.850996+0000","last_active":"2024-09-10T20:39:57.870520+0000","last_peered":"2024-09-10T20:39:57.870520+0000","last_clean":"2024-09-10T20:39:57.870520+0000","last_became_active":"2024-09-10T20:39:52.850689+0000","last_became_peered":"2024-09-10T20:39:52.850689+0000","last_unstale":"2024-09-10T20:39:57.870520+0000","last_undegraded":"2024-09-10T20:39:57.870520+0000","last_fullsized":"2024-09-10T20:39:57.870520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:41.036260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871243+0000","last_change":"2024-09-10T20:39:52.852058+0000","last_active":"2024-09-10T20:39:57.871243+0000","last_peered":"2024-09-10T20:39:57.871243+0000","last_clean":"2024-09-10T20:39:57.871243+0000","last_became_active":"2024-09-10T20:39:52.851810+0000","last_became_peered":"2024-09-10T20:39:52.851810+0000","last_unstale":"2024-09-10T20:39:57.871243+0000","last_undegraded":"2024-09-10T20:39:57.871243+0000","last_fullsized":"2024-09-10T20:39:57.871243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:53.759604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456464+0000","last_change":"2024-09-10T20:39:52.848422+0000","last_active":"2024-09-10T20:39:58.456464+0000","last_peered":"2024-09-10T20:39:58.456464+0000","last_clean":"2024-09-10T20:39:58.456464+0000","last_became_active":"2024-09-10T20:39:52.847754+0000","last_became_peered":"2024-09-10T20:39:52.847754+0000","last_unstale":"2024-09-10T20:39:58.456464+0000","last_undegraded":"2024-09-10T20:39:58.456464+0000","last_fullsized":"2024-09-10T20:39:58.456464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:20.826273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456507+0000","last_change":"2024-09-10T20:39:52.848711+0000","last_active":"2024-09-10T20:39:58.456507+0000","last_peered":"2024-09-10T20:39:58.456507+0000","last_clean":"2024-09-10T20:39:58.456507+0000","last_became_active":"2024-09-10T20:39:52.848350+0000","last_became_peered":"2024-09-10T20:39:52.848350+0000","last_unstale":"2024-09-10T20:39:58.456507+0000","last_undegraded":"2024-09-10T20:39:58.456507+0000","last_fullsized":"2024-09-10T20:39:58.456507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:57.850783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456664+0000","last_change":"2024-09-10T20:39:52.858551+0000","last_active":"2024-09-10T20:39:58.456664+0000","last_peered":"2024-09-10T20:39:58.456664+0000","last_clean":"2024-09-10T20:39:58.456664+0000","last_became_active":"2024-09-10T20:39:52.858293+0000","last_became_peered":"2024-09-10T20:39:52.858293+0000","last_unstale":"2024-09-10T20:39:58.456664+0000","last_undegraded":"2024-09-10T20:39:58.456664+0000","last_fullsized":"2024-09-10T20:39:58.456664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076168+0000","last_change":"2024-09-10T20:39:52.846940+0000","last_active":"2024-09-10T20:39:58.076168+0000","last_peered":"2024-09-10T20:39:58.076168+0000","last_clean":"2024-09-10T20:39:58.076168+0000","last_became_active":"2024-09-10T20:39:52.846684+0000","last_became_peered":"2024-09-10T20:39:52.846684+0000","last_unstale":"2024-09-10T20:39:58.076168+0000","last_undegraded":"2024-09-10T20:39:58.076168+0000","last_fullsized":"2024-09-10T20:39:58.076168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869746+0000","last_change":"2024-09-10T20:39:52.837716+0000","last_active":"2024-09-10T20:39:57.869746+0000","last_peered":"2024-09-10T20:39:57.869746+0000","last_clean":"2024-09-10T20:39:57.869746+0000","last_became_active":"2024-09-10T20:39:52.837340+0000","last_became_peered":"2024-09-10T20:39:52.837340+0000","last_unstale":"2024-09-10T20:39:57.869746+0000","last_undegraded":"2024-09-10T20:39:57.869746+0000","last_fullsized":"2024-09-10T20:39:57.869746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.144804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456132+0000","last_change":"2024-09-10T20:39:52.844070+0000","last_active":"2024-09-10T20:39:58.456132+0000","last_peered":"2024-09-10T20:39:58.456132+0000","last_clean":"2024-09-10T20:39:58.456132+0000","last_became_active":"2024-09-10T20:39:52.843767+0000","last_became_peered":"2024-09-10T20:39:52.843767+0000","last_unstale":"2024-09-10T20:39:58.456132+0000","last_undegraded":"2024-09-10T20:39:58.456132+0000","last_fullsized":"2024-09-10T20:39:58.456132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:25.772255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576576+0000","last_change":"2024-09-10T20:39:52.857416+0000","last_active":"2024-09-10T20:39:58.576576+0000","last_peered":"2024-09-10T20:39:58.576576+0000","last_clean":"2024-09-10T20:39:58.576576+0000","last_became_active":"2024-09-10T20:39:52.857072+0000","last_became_peered":"2024-09-10T20:39:52.857072+0000","last_unstale":"2024-09-10T20:39:58.576576+0000","last_undegraded":"2024-09-10T20:39:58.576576+0000","last_fullsized":"2024-09-10T20:39:58.576576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:48.691234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456292+0000","last_change":"2024-09-10T20:39:52.848949+0000","last_active":"2024-09-10T20:39:58.456292+0000","last_peered":"2024-09-10T20:39:58.456292+0000","last_clean":"2024-09-10T20:39:58.456292+0000","last_became_active":"2024-09-10T20:39:52.848651+0000","last_became_peered":"2024-09-10T20:39:52.848651+0000","last_unstale":"2024-09-10T20:39:58.456292+0000","last_undegraded":"2024-09-10T20:39:58.456292+0000","last_fullsized":"2024-09-10T20:39:58.456292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:15.293386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576714+0000","last_change":"2024-09-10T20:39:52.866936+0000","last_active":"2024-09-10T20:39:58.576714+0000","last_peered":"2024-09-10T20:39:58.576714+0000","last_clean":"2024-09-10T20:39:58.576714+0000","last_became_active":"2024-09-10T20:39:52.857238+0000","last_became_peered":"2024-09-10T20:39:52.857238+0000","last_unstale":"2024-09-10T20:39:58.576714+0000","last_undegraded":"2024-09-10T20:39:58.576714+0000","last_fullsized":"2024-09-10T20:39:58.576714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871449+0000","last_change":"2024-09-10T20:39:52.847418+0000","last_active":"2024-09-10T20:39:57.871449+0000","last_peered":"2024-09-10T20:39:57.871449+0000","last_clean":"2024-09-10T20:39:57.871449+0000","last_became_active":"2024-09-10T20:39:52.847135+0000","last_became_peered":"2024-09-10T20:39:52.847135+0000","last_unstale":"2024-09-10T20:39:57.871449+0000","last_undegraded":"2024-09-10T20:39:57.871449+0000","last_fullsized":"2024-09-10T20:39:57.871449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:41.028633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871755+0000","last_change":"2024-09-10T20:39:52.858784+0000","last_active":"2024-09-10T20:39:57.871755+0000","last_peered":"2024-09-10T20:39:57.871755+0000","last_clean":"2024-09-10T20:39:57.871755+0000","last_became_active":"2024-09-10T20:39:52.858556+0000","last_became_peered":"2024-09-10T20:39:52.858556+0000","last_unstale":"2024-09-10T20:39:57.871755+0000","last_undegraded":"2024-09-10T20:39:57.871755+0000","last_fullsized":"2024-09-10T20:39:57.871755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:04.350523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456833+0000","last_change":"2024-09-10T20:39:52.856985+0000","last_active":"2024-09-10T20:39:58.456833+0000","last_peered":"2024-09-10T20:39:58.456833+0000","last_clean":"2024-09-10T20:39:58.456833+0000","last_became_active":"2024-09-10T20:39:52.853995+0000","last_became_peered":"2024-09-10T20:39:52.853995+0000","last_unstale":"2024-09-10T20:39:58.456833+0000","last_undegraded":"2024-09-10T20:39:58.456833+0000","last_fullsized":"2024-09-10T20:39:58.456833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:40:15.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:40:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.299+0000 7f217d800640 1 -- 172.21.15.81:0/1075929113 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f215c003ac0 msgr2=0x7f215c003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.299+0000 7f217d800640 1 --2- 172.21.15.81:0/1075929113 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f215c003ac0 0x7f215c003ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2168009b50 tx=0x7f215c005830 comp rx=0 tx=0).stop 2024-09-10T20:40:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.299+0000 7f217d800640 1 -- 172.21.15.81:0/1075929113 shutdown_connections 2024-09-10T20:40:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.299+0000 7f217d800640 1 --2- 172.21.15.81:0/1075929113 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f215c003ac0 0x7f215c003ee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.299+0000 7f217d800640 1 -- 172.21.15.81:0/1075929113 >> 172.21.15.81:0/1075929113 conn(0x7f21780d3ab0 msgr2=0x7f21780d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.299+0000 7f217d800640 1 -- 172.21.15.81:0/1075929113 shutdown_connections 2024-09-10T20:40:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.299+0000 7f217d800640 1 -- 172.21.15.81:0/1075929113 wait complete. 2024-09-10T20:40:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.301+0000 7f217d800640 1 Processor -- start 2024-09-10T20:40:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.301+0000 7f217d800640 1 -- start start 2024-09-10T20:40:15.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f217d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215c003ac0 0x7f21781f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f217d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f217815bdf0 0x7f2178156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f217d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f217815b400 0x7f217815e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f217d800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f217806e770 con 0x7f215c003ac0 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f217d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2178161730 con 0x7f217815bdf0 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f217d800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f217806e8f0 con 0x7f217815b400 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215c003ac0 0x7f21781f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215c003ac0 0x7f21781f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52296/0 (socket says 172.21.15.81:52296) 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 -- 172.21.15.81:0/3384800750 learned_addr learned my addr 172.21.15.81:0/3384800750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f216f400640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f217815bdf0 0x7f2178156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f217ce00640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f217815b400 0x7f217815e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 -- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f217815b400 msgr2=0x7f217815e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f217815b400 0x7f217815e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 -- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f217815bdf0 msgr2=0x7f2178156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f217815bdf0 0x7f2178156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 -- 172.21.15.81:0/3384800750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217815c2f0 con 0x7f215c003ac0 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.302+0000 7f2177e00640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215c003ac0 0x7f21781f4d30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2168009a70 tx=0x7f21680336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.303+0000 7f2174c00640 1 -- 172.21.15.81:0/3384800750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168040020 con 0x7f215c003ac0 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.303+0000 7f2174c00640 1 -- 172.21.15.81:0/3384800750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2168004310 con 0x7f215c003ac0 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.303+0000 7f2174c00640 1 -- 172.21.15.81:0/3384800750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2168038040 con 0x7f215c003ac0 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.303+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f217815c5d0 con 0x7f215c003ac0 2024-09-10T20:40:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.303+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21781f4810 con 0x7f215c003ac0 2024-09-10T20:40:15.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.304+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217806d4a0 con 0x7f215c003ac0 2024-09-10T20:40:15.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.305+0000 7f2174c00640 1 -- 172.21.15.81:0/3384800750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f216803b070 con 0x7f215c003ac0 2024-09-10T20:40:15.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.306+0000 7f2174c00640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2154077fa0 0x7f215407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.306+0000 7f2174c00640 1 -- 172.21.15.81:0/3384800750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f21680ba180 con 0x7f215c003ac0 2024-09-10T20:40:15.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.306+0000 7f216f400640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2154077fa0 0x7f215407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.307+0000 7f216f400640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2154077fa0 0x7f215407a460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21780b65c0 tx=0x7f21600067a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:15.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.310+0000 7f2174c00640 1 -- 172.21.15.81:0/3384800750 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f216804a020 con 0x7f215c003ac0 2024-09-10T20:40:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.487+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21781f4320 con 0x7f2154077fa0 2024-09-10T20:40:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.494+0000 7f2174c00640 1 -- 172.21.15.81:0/3384800750 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f21781f4320 con 0x7f2154077fa0 2024-09-10T20:40:15.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.498+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2154077fa0 msgr2=0x7f215407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.498+0000 7f217d800640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2154077fa0 0x7f215407a460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21780b65c0 tx=0x7f21600067a0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215c003ac0 msgr2=0x7f21781f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215c003ac0 0x7f21781f4d30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2168009a70 tx=0x7f21680336f0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 shutdown_connections 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2154077fa0 0x7f215407a460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f217815b400 0x7f217815e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f217815bdf0 0x7f2178156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 --2- 172.21.15.81:0/3384800750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f215c003ac0 0x7f21781f4d30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 >> 172.21.15.81:0/3384800750 conn(0x7f21780d3ab0 msgr2=0x7f21780d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 shutdown_connections 2024-09-10T20:40:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.499+0000 7f217d800640 1 -- 172.21.15.81:0/3384800750 wait complete. 2024-09-10T20:40:15.518 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-10T20:40:13.849308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003561"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578249+0000","last_change":"2024-09-10T20:39:51.832835+0000","last_active":"2024-09-10T20:39:58.578249+0000","last_peered":"2024-09-10T20:39:58.578249+0000","last_clean":"2024-09-10T20:39:58.578249+0000","last_became_active":"2024-09-10T20:39:51.832002+0000","last_became_peered":"2024-09-10T20:39:51.832002+0000","last_unstale":"2024-09-10T20:39:58.578249+0000","last_undegraded":"2024-09-10T20:39:58.578249+0000","last_fullsized":"2024-09-10T20:39:58.578249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871856+0000","last_change":"2024-09-10T20:39:52.861599+0000","last_active":"2024-09-10T20:39:57.871856+0000","last_peered":"2024-09-10T20:39:57.871856+0000","last_clean":"2024-09-10T20:39:57.871856+0000","last_became_active":"2024-09-10T20:39:52.861276+0000","last_became_peered":"2024-09-10T20:39:52.861276+0000","last_unstale":"2024-09-10T20:39:57.871856+0000","last_undegraded":"2024-09-10T20:39:57.871856+0000","last_fullsized":"2024-09-10T20:39:57.871856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:26.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577180+0000","last_change":"2024-09-10T20:39:56.877062+0000","last_active":"2024-09-10T20:39:58.577180+0000","last_peered":"2024-09-10T20:39:58.577180+0000","last_clean":"2024-09-10T20:39:58.577180+0000","last_became_active":"2024-09-10T20:39:56.876685+0000","last_became_peered":"2024-09-10T20:39:56.876685+0000","last_unstale":"2024-09-10T20:39:58.577180+0000","last_undegraded":"2024-09-10T20:39:58.577180+0000","last_fullsized":"2024-09-10T20:39:58.577180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:57.795507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871926+0000","last_change":"2024-09-10T20:39:51.834265+0000","last_active":"2024-09-10T20:39:57.871926+0000","last_peered":"2024-09-10T20:39:57.871926+0000","last_clean":"2024-09-10T20:39:57.871926+0000","last_became_active":"2024-09-10T20:39:51.833454+0000","last_became_peered":"2024-09-10T20:39:51.833454+0000","last_unstale":"2024-09-10T20:39:57.871926+0000","last_undegraded":"2024-09-10T20:39:57.871926+0000","last_fullsized":"2024-09-10T20:39:57.871926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:16.293652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871601+0000","last_change":"2024-09-10T20:39:52.844795+0000","last_active":"2024-09-10T20:39:57.871601+0000","last_peered":"2024-09-10T20:39:57.871601+0000","last_clean":"2024-09-10T20:39:57.871601+0000","last_became_active":"2024-09-10T20:39:52.844523+0000","last_became_peered":"2024-09-10T20:39:52.844523+0000","last_unstale":"2024-09-10T20:39:57.871601+0000","last_undegraded":"2024-09-10T20:39:57.871601+0000","last_fullsized":"2024-09-10T20:39:57.871601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:29.651685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576325+0000","last_change":"2024-09-10T20:39:56.889126+0000","last_active":"2024-09-10T20:39:58.576325+0000","last_peered":"2024-09-10T20:39:58.576325+0000","last_clean":"2024-09-10T20:39:58.576325+0000","last_became_active":"2024-09-10T20:39:56.884086+0000","last_became_peered":"2024-09-10T20:39:56.884086+0000","last_unstale":"2024-09-10T20:39:58.576325+0000","last_undegraded":"2024-09-10T20:39:58.576325+0000","last_fullsized":"2024-09-10T20:39:58.576325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.634765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456681+0000","last_change":"2024-09-10T20:39:51.837410+0000","last_active":"2024-09-10T20:39:58.456681+0000","last_peered":"2024-09-10T20:39:58.456681+0000","last_clean":"2024-09-10T20:39:58.456681+0000","last_became_active":"2024-09-10T20:39:51.828041+0000","last_became_peered":"2024-09-10T20:39:51.828041+0000","last_unstale":"2024-09-10T20:39:58.456681+0000","last_undegraded":"2024-09-10T20:39:58.456681+0000","last_fullsized":"2024-09-10T20:39:58.456681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075788+0000","last_change":"2024-09-10T20:39:52.841937+0000","last_active":"2024-09-10T20:39:58.075788+0000","last_peered":"2024-09-10T20:39:58.075788+0000","last_clean":"2024-09-10T20:39:58.075788+0000","last_became_active":"2024-09-10T20:39:52.841667+0000","last_became_peered":"2024-09-10T20:39:52.841667+0000","last_unstale":"2024-09-10T20:39:58.075788+0000","last_undegraded":"2024-09-10T20:39:58.075788+0000","last_fullsized":"2024-09-10T20:39:58.075788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:38.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576484+0000","last_change":"2024-09-10T20:39:56.878639+0000","last_active":"2024-09-10T20:39:58.576484+0000","last_peered":"2024-09-10T20:39:58.576484+0000","last_clean":"2024-09-10T20:39:58.576484+0000","last_became_active":"2024-09-10T20:39:56.878151+0000","last_became_peered":"2024-09-10T20:39:56.878151+0000","last_unstale":"2024-09-10T20:39:58.576484+0000","last_undegraded":"2024-09-10T20:39:58.576484+0000","last_fullsized":"2024-09-10T20:39:58.576484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456590+0000","last_change":"2024-09-10T20:39:51.824906+0000","last_active":"2024-09-10T20:39:58.456590+0000","last_peered":"2024-09-10T20:39:58.456590+0000","last_clean":"2024-09-10T20:39:58.456590+0000","last_became_active":"2024-09-10T20:39:51.824622+0000","last_became_peered":"2024-09-10T20:39:51.824622+0000","last_unstale":"2024-09-10T20:39:58.456590+0000","last_undegraded":"2024-09-10T20:39:58.456590+0000","last_fullsized":"2024-09-10T20:39:58.456590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873160+0000","last_change":"2024-09-10T20:39:52.842836+0000","last_active":"2024-09-10T20:39:57.873160+0000","last_peered":"2024-09-10T20:39:57.873160+0000","last_clean":"2024-09-10T20:39:57.873160+0000","last_became_active":"2024-09-10T20:39:52.842556+0000","last_became_peered":"2024-09-10T20:39:52.842556+0000","last_unstale":"2024-09-10T20:39:57.873160+0000","last_undegraded":"2024-09-10T20:39:57.873160+0000","last_fullsized":"2024-09-10T20:39:57.873160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.528995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576402+0000","last_change":"2024-09-10T20:39:56.878895+0000","last_active":"2024-09-10T20:39:58.576402+0000","last_peered":"2024-09-10T20:39:58.576402+0000","last_clean":"2024-09-10T20:39:58.576402+0000","last_became_active":"2024-09-10T20:39:56.878478+0000","last_became_peered":"2024-09-10T20:39:56.878478+0000","last_unstale":"2024-09-10T20:39:58.576402+0000","last_undegraded":"2024-09-10T20:39:58.576402+0000","last_fullsized":"2024-09-10T20:39:58.576402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.002662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872865+0000","last_change":"2024-09-10T20:39:52.840391+0000","last_active":"2024-09-10T20:39:57.872865+0000","last_peered":"2024-09-10T20:39:57.872865+0000","last_clean":"2024-09-10T20:39:57.872865+0000","last_became_active":"2024-09-10T20:39:52.840140+0000","last_became_peered":"2024-09-10T20:39:52.840140+0000","last_unstale":"2024-09-10T20:39:57.872865+0000","last_undegraded":"2024-09-10T20:39:57.872865+0000","last_fullsized":"2024-09-10T20:39:57.872865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872887+0000","last_change":"2024-09-10T20:39:51.831131+0000","last_active":"2024-09-10T20:39:57.872887+0000","last_peered":"2024-09-10T20:39:57.872887+0000","last_clean":"2024-09-10T20:39:57.872887+0000","last_became_active":"2024-09-10T20:39:51.830920+0000","last_became_peered":"2024-09-10T20:39:51.830920+0000","last_unstale":"2024-09-10T20:39:57.872887+0000","last_undegraded":"2024-09-10T20:39:57.872887+0000","last_fullsized":"2024-09-10T20:39:57.872887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872932+0000","last_change":"2024-09-10T20:39:56.885978+0000","last_active":"2024-09-10T20:39:57.872932+0000","last_peered":"2024-09-10T20:39:57.872932+0000","last_clean":"2024-09-10T20:39:57.872932+0000","last_became_active":"2024-09-10T20:39:56.882428+0000","last_became_peered":"2024-09-10T20:39:56.882428+0000","last_unstale":"2024-09-10T20:39:57.872932+0000","last_undegraded":"2024-09-10T20:39:57.872932+0000","last_fullsized":"2024-09-10T20:39:57.872932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:17.375025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578529+0000","last_change":"2024-09-10T20:39:52.851120+0000","last_active":"2024-09-10T20:39:58.578529+0000","last_peered":"2024-09-10T20:39:58.578529+0000","last_clean":"2024-09-10T20:39:58.578529+0000","last_became_active":"2024-09-10T20:39:52.850838+0000","last_became_peered":"2024-09-10T20:39:52.850838+0000","last_unstale":"2024-09-10T20:39:58.578529+0000","last_undegraded":"2024-09-10T20:39:58.578529+0000","last_fullsized":"2024-09-10T20:39:58.578529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870734+0000","last_change":"2024-09-10T20:39:51.828895+0000","last_active":"2024-09-10T20:39:57.870734+0000","last_peered":"2024-09-10T20:39:57.870734+0000","last_clean":"2024-09-10T20:39:57.870734+0000","last_became_active":"2024-09-10T20:39:51.828619+0000","last_became_peered":"2024-09-10T20:39:51.828619+0000","last_unstale":"2024-09-10T20:39:57.870734+0000","last_undegraded":"2024-09-10T20:39:57.870734+0000","last_fullsized":"2024-09-10T20:39:57.870734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456333+0000","last_change":"2024-09-10T20:39:56.872443+0000","last_active":"2024-09-10T20:39:58.456333+0000","last_peered":"2024-09-10T20:39:58.456333+0000","last_clean":"2024-09-10T20:39:58.456333+0000","last_became_active":"2024-09-10T20:39:56.871357+0000","last_became_peered":"2024-09-10T20:39:56.871357+0000","last_unstale":"2024-09-10T20:39:58.456333+0000","last_undegraded":"2024-09-10T20:39:58.456333+0000","last_fullsized":"2024-09-10T20:39:58.456333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:26.208173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576821+0000","last_change":"2024-09-10T20:39:52.840929+0000","last_active":"2024-09-10T20:39:58.576821+0000","last_peered":"2024-09-10T20:39:58.576821+0000","last_clean":"2024-09-10T20:39:58.576821+0000","last_became_active":"2024-09-10T20:39:52.840635+0000","last_became_peered":"2024-09-10T20:39:52.840635+0000","last_unstale":"2024-09-10T20:39:58.576821+0000","last_undegraded":"2024-09-10T20:39:58.576821+0000","last_fullsized":"2024-09-10T20:39:58.576821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:19.765338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577744+0000","last_change":"2024-09-10T20:39:51.834045+0000","last_active":"2024-09-10T20:39:58.577744+0000","last_peered":"2024-09-10T20:39:58.577744+0000","last_clean":"2024-09-10T20:39:58.577744+0000","last_became_active":"2024-09-10T20:39:51.833137+0000","last_became_peered":"2024-09-10T20:39:51.833137+0000","last_unstale":"2024-09-10T20:39:58.577744+0000","last_undegraded":"2024-09-10T20:39:58.577744+0000","last_fullsized":"2024-09-10T20:39:58.577744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578854+0000","last_change":"2024-09-10T20:39:56.878162+0000","last_active":"2024-09-10T20:39:58.578854+0000","last_peered":"2024-09-10T20:39:58.578854+0000","last_clean":"2024-09-10T20:39:58.578854+0000","last_became_active":"2024-09-10T20:39:56.875227+0000","last_became_peered":"2024-09-10T20:39:56.875227+0000","last_unstale":"2024-09-10T20:39:58.578854+0000","last_undegraded":"2024-09-10T20:39:58.578854+0000","last_fullsized":"2024-09-10T20:39:58.578854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:47.514540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872355+0000","last_change":"2024-09-10T20:39:52.850499+0000","last_active":"2024-09-10T20:39:57.872355+0000","last_peered":"2024-09-10T20:39:57.872355+0000","last_clean":"2024-09-10T20:39:57.872355+0000","last_became_active":"2024-09-10T20:39:52.846216+0000","last_became_peered":"2024-09-10T20:39:52.846216+0000","last_unstale":"2024-09-10T20:39:57.872355+0000","last_undegraded":"2024-09-10T20:39:57.872355+0000","last_fullsized":"2024-09-10T20:39:57.872355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:42.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.455967+0000","last_change":"2024-09-10T20:39:51.828243+0000","last_active":"2024-09-10T20:39:58.455967+0000","last_peered":"2024-09-10T20:39:58.455967+0000","last_clean":"2024-09-10T20:39:58.455967+0000","last_became_active":"2024-09-10T20:39:51.827821+0000","last_became_peered":"2024-09-10T20:39:51.827821+0000","last_unstale":"2024-09-10T20:39:58.455967+0000","last_undegraded":"2024-09-10T20:39:58.455967+0000","last_fullsized":"2024-09-10T20:39:58.455967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577056+0000","last_change":"2024-09-10T20:39:56.884287+0000","last_active":"2024-09-10T20:39:58.577056+0000","last_peered":"2024-09-10T20:39:58.577056+0000","last_clean":"2024-09-10T20:39:58.577056+0000","last_became_active":"2024-09-10T20:39:56.882564+0000","last_became_peered":"2024-09-10T20:39:56.882564+0000","last_unstale":"2024-09-10T20:39:58.577056+0000","last_undegraded":"2024-09-10T20:39:58.577056+0000","last_fullsized":"2024-09-10T20:39:58.577056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577841+0000","last_change":"2024-09-10T20:39:52.838040+0000","last_active":"2024-09-10T20:39:58.577841+0000","last_peered":"2024-09-10T20:39:58.577841+0000","last_clean":"2024-09-10T20:39:58.577841+0000","last_became_active":"2024-09-10T20:39:52.837734+0000","last_became_peered":"2024-09-10T20:39:52.837734+0000","last_unstale":"2024-09-10T20:39:58.577841+0000","last_undegraded":"2024-09-10T20:39:58.577841+0000","last_fullsized":"2024-09-10T20:39:58.577841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:10.528107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873618+0000","last_change":"2024-09-10T20:39:51.844086+0000","last_active":"2024-09-10T20:39:57.873618+0000","last_peered":"2024-09-10T20:39:57.873618+0000","last_clean":"2024-09-10T20:39:57.873618+0000","last_became_active":"2024-09-10T20:39:51.843824+0000","last_became_peered":"2024-09-10T20:39:51.843824+0000","last_unstale":"2024-09-10T20:39:57.873618+0000","last_undegraded":"2024-09-10T20:39:57.873618+0000","last_fullsized":"2024-09-10T20:39:57.873618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:12.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576560+0000","last_change":"2024-09-10T20:39:56.884552+0000","last_active":"2024-09-10T20:39:58.576560+0000","last_peered":"2024-09-10T20:39:58.576560+0000","last_clean":"2024-09-10T20:39:58.576560+0000","last_became_active":"2024-09-10T20:39:56.884088+0000","last_became_peered":"2024-09-10T20:39:56.884088+0000","last_unstale":"2024-09-10T20:39:58.576560+0000","last_undegraded":"2024-09-10T20:39:58.576560+0000","last_fullsized":"2024-09-10T20:39:58.576560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578171+0000","last_change":"2024-09-10T20:39:52.850808+0000","last_active":"2024-09-10T20:39:58.578171+0000","last_peered":"2024-09-10T20:39:58.578171+0000","last_clean":"2024-09-10T20:39:58.578171+0000","last_became_active":"2024-09-10T20:39:52.850148+0000","last_became_peered":"2024-09-10T20:39:52.850148+0000","last_unstale":"2024-09-10T20:39:58.578171+0000","last_undegraded":"2024-09-10T20:39:58.578171+0000","last_fullsized":"2024-09-10T20:39:58.578171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:27.749969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578141+0000","last_change":"2024-09-10T20:39:51.835027+0000","last_active":"2024-09-10T20:39:58.578141+0000","last_peered":"2024-09-10T20:39:58.578141+0000","last_clean":"2024-09-10T20:39:58.578141+0000","last_became_active":"2024-09-10T20:39:51.833252+0000","last_became_peered":"2024-09-10T20:39:51.833252+0000","last_unstale":"2024-09-10T20:39:58.578141+0000","last_undegraded":"2024-09-10T20:39:58.578141+0000","last_fullsized":"2024-09-10T20:39:58.578141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576875+0000","last_change":"2024-09-10T20:39:56.878033+0000","last_active":"2024-09-10T20:39:58.576875+0000","last_peered":"2024-09-10T20:39:58.576875+0000","last_clean":"2024-09-10T20:39:58.576875+0000","last_became_active":"2024-09-10T20:39:56.877576+0000","last_became_peered":"2024-09-10T20:39:56.877576+0000","last_unstale":"2024-09-10T20:39:58.576875+0000","last_undegraded":"2024-09-10T20:39:58.576875+0000","last_fullsized":"2024-09-10T20:39:58.576875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870354+0000","last_change":"2024-09-10T20:39:52.859765+0000","last_active":"2024-09-10T20:39:57.870354+0000","last_peered":"2024-09-10T20:39:57.870354+0000","last_clean":"2024-09-10T20:39:57.870354+0000","last_became_active":"2024-09-10T20:39:52.858175+0000","last_became_peered":"2024-09-10T20:39:52.858175+0000","last_unstale":"2024-09-10T20:39:57.870354+0000","last_undegraded":"2024-09-10T20:39:57.870354+0000","last_fullsized":"2024-09-10T20:39:57.870354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:43.478637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873400+0000","last_change":"2024-09-10T20:39:51.836469+0000","last_active":"2024-09-10T20:39:57.873400+0000","last_peered":"2024-09-10T20:39:57.873400+0000","last_clean":"2024-09-10T20:39:57.873400+0000","last_became_active":"2024-09-10T20:39:51.835832+0000","last_became_peered":"2024-09-10T20:39:51.835832+0000","last_unstale":"2024-09-10T20:39:57.873400+0000","last_undegraded":"2024-09-10T20:39:57.873400+0000","last_fullsized":"2024-09-10T20:39:57.873400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.987131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870998+0000","last_change":"2024-09-10T20:39:56.875872+0000","last_active":"2024-09-10T20:39:57.870998+0000","last_peered":"2024-09-10T20:39:57.870998+0000","last_clean":"2024-09-10T20:39:57.870998+0000","last_became_active":"2024-09-10T20:39:56.875431+0000","last_became_peered":"2024-09-10T20:39:56.875431+0000","last_unstale":"2024-09-10T20:39:57.870998+0000","last_undegraded":"2024-09-10T20:39:57.870998+0000","last_fullsized":"2024-09-10T20:39:57.870998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576757+0000","last_change":"2024-09-10T20:39:52.865010+0000","last_active":"2024-09-10T20:39:58.576757+0000","last_peered":"2024-09-10T20:39:58.576757+0000","last_clean":"2024-09-10T20:39:58.576757+0000","last_became_active":"2024-09-10T20:39:52.859434+0000","last_became_peered":"2024-09-10T20:39:52.859434+0000","last_unstale":"2024-09-10T20:39:58.576757+0000","last_undegraded":"2024-09-10T20:39:58.576757+0000","last_fullsized":"2024-09-10T20:39:58.576757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871107+0000","last_change":"2024-09-10T20:39:51.827144+0000","last_active":"2024-09-10T20:39:57.871107+0000","last_peered":"2024-09-10T20:39:57.871107+0000","last_clean":"2024-09-10T20:39:57.871107+0000","last_became_active":"2024-09-10T20:39:51.826880+0000","last_became_peered":"2024-09-10T20:39:51.826880+0000","last_unstale":"2024-09-10T20:39:57.871107+0000","last_undegraded":"2024-09-10T20:39:57.871107+0000","last_fullsized":"2024-09-10T20:39:57.871107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:45.750240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870236+0000","last_change":"2024-09-10T20:39:56.882585+0000","last_active":"2024-09-10T20:39:57.870236+0000","last_peered":"2024-09-10T20:39:57.870236+0000","last_clean":"2024-09-10T20:39:57.870236+0000","last_became_active":"2024-09-10T20:39:56.882093+0000","last_became_peered":"2024-09-10T20:39:56.882093+0000","last_unstale":"2024-09-10T20:39:57.870236+0000","last_undegraded":"2024-09-10T20:39:57.870236+0000","last_fullsized":"2024-09-10T20:39:57.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456325+0000","last_change":"2024-09-10T20:39:52.861639+0000","last_active":"2024-09-10T20:39:58.456325+0000","last_peered":"2024-09-10T20:39:58.456325+0000","last_clean":"2024-09-10T20:39:58.456325+0000","last_became_active":"2024-09-10T20:39:52.861383+0000","last_became_peered":"2024-09-10T20:39:52.861383+0000","last_unstale":"2024-09-10T20:39:58.456325+0000","last_undegraded":"2024-09-10T20:39:58.456325+0000","last_fullsized":"2024-09-10T20:39:58.456325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:47.156926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872896+0000","last_change":"2024-09-10T20:39:51.835770+0000","last_active":"2024-09-10T20:39:57.872896+0000","last_peered":"2024-09-10T20:39:57.872896+0000","last_clean":"2024-09-10T20:39:57.872896+0000","last_became_active":"2024-09-10T20:39:51.835470+0000","last_became_peered":"2024-09-10T20:39:51.835470+0000","last_unstale":"2024-09-10T20:39:57.872896+0000","last_undegraded":"2024-09-10T20:39:57.872896+0000","last_fullsized":"2024-09-10T20:39:57.872896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:38.530675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870076+0000","last_change":"2024-09-10T20:39:56.882138+0000","last_active":"2024-09-10T20:39:57.870076+0000","last_peered":"2024-09-10T20:39:57.870076+0000","last_clean":"2024-09-10T20:39:57.870076+0000","last_became_active":"2024-09-10T20:39:56.875117+0000","last_became_peered":"2024-09-10T20:39:56.875117+0000","last_unstale":"2024-09-10T20:39:57.870076+0000","last_undegraded":"2024-09-10T20:39:57.870076+0000","last_fullsized":"2024-09-10T20:39:57.870076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869855+0000","last_change":"2024-09-10T20:39:52.842774+0000","last_active":"2024-09-10T20:39:57.869855+0000","last_peered":"2024-09-10T20:39:57.869855+0000","last_clean":"2024-09-10T20:39:57.869855+0000","last_became_active":"2024-09-10T20:39:52.842446+0000","last_became_peered":"2024-09-10T20:39:52.842446+0000","last_unstale":"2024-09-10T20:39:57.869855+0000","last_undegraded":"2024-09-10T20:39:57.869855+0000","last_fullsized":"2024-09-10T20:39:57.869855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:29.034488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577469+0000","last_change":"2024-09-10T20:39:51.834088+0000","last_active":"2024-09-10T20:39:58.577469+0000","last_peered":"2024-09-10T20:39:58.577469+0000","last_clean":"2024-09-10T20:39:58.577469+0000","last_became_active":"2024-09-10T20:39:51.830213+0000","last_became_peered":"2024-09-10T20:39:51.830213+0000","last_unstale":"2024-09-10T20:39:58.577469+0000","last_undegraded":"2024-09-10T20:39:58.577469+0000","last_fullsized":"2024-09-10T20:39:58.577469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:08.073166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871242+0000","last_change":"2024-09-10T20:39:56.876963+0000","last_active":"2024-09-10T20:39:57.871242+0000","last_peered":"2024-09-10T20:39:57.871242+0000","last_clean":"2024-09-10T20:39:57.871242+0000","last_became_active":"2024-09-10T20:39:56.876565+0000","last_became_peered":"2024-09-10T20:39:56.876565+0000","last_unstale":"2024-09-10T20:39:57.871242+0000","last_undegraded":"2024-09-10T20:39:57.871242+0000","last_fullsized":"2024-09-10T20:39:57.871242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869844+0000","last_change":"2024-09-10T20:39:52.860096+0000","last_active":"2024-09-10T20:39:57.869844+0000","last_peered":"2024-09-10T20:39:57.869844+0000","last_clean":"2024-09-10T20:39:57.869844+0000","last_became_active":"2024-09-10T20:39:52.859815+0000","last_became_peered":"2024-09-10T20:39:52.859815+0000","last_unstale":"2024-09-10T20:39:57.869844+0000","last_undegraded":"2024-09-10T20:39:57.869844+0000","last_fullsized":"2024-09-10T20:39:57.869844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:02.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872428+0000","last_change":"2024-09-10T20:39:51.837166+0000","last_active":"2024-09-10T20:39:57.872428+0000","last_peered":"2024-09-10T20:39:57.872428+0000","last_clean":"2024-09-10T20:39:57.872428+0000","last_became_active":"2024-09-10T20:39:51.836893+0000","last_became_peered":"2024-09-10T20:39:51.836893+0000","last_unstale":"2024-09-10T20:39:57.872428+0000","last_undegraded":"2024-09-10T20:39:57.872428+0000","last_fullsized":"2024-09-10T20:39:57.872428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:18.758447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871780+0000","last_change":"2024-09-10T20:39:56.874406+0000","last_active":"2024-09-10T20:39:57.871780+0000","last_peered":"2024-09-10T20:39:57.871780+0000","last_clean":"2024-09-10T20:39:57.871780+0000","last_became_active":"2024-09-10T20:39:56.874005+0000","last_became_peered":"2024-09-10T20:39:56.874005+0000","last_unstale":"2024-09-10T20:39:57.871780+0000","last_undegraded":"2024-09-10T20:39:57.871780+0000","last_fullsized":"2024-09-10T20:39:57.871780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:19.234557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577223+0000","last_change":"2024-09-10T20:39:52.860106+0000","last_active":"2024-09-10T20:39:58.577223+0000","last_peered":"2024-09-10T20:39:58.577223+0000","last_clean":"2024-09-10T20:39:58.577223+0000","last_became_active":"2024-09-10T20:39:52.859856+0000","last_became_peered":"2024-09-10T20:39:52.859856+0000","last_unstale":"2024-09-10T20:39:58.577223+0000","last_undegraded":"2024-09-10T20:39:58.577223+0000","last_fullsized":"2024-09-10T20:39:58.577223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872964+0000","last_change":"2024-09-10T20:39:51.830052+0000","last_active":"2024-09-10T20:39:57.872964+0000","last_peered":"2024-09-10T20:39:57.872964+0000","last_clean":"2024-09-10T20:39:57.872964+0000","last_became_active":"2024-09-10T20:39:51.829826+0000","last_became_peered":"2024-09-10T20:39:51.829826+0000","last_unstale":"2024-09-10T20:39:57.872964+0000","last_undegraded":"2024-09-10T20:39:57.872964+0000","last_fullsized":"2024-09-10T20:39:57.872964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075483+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:39:58.075483+0000","last_peered":"2024-09-10T20:39:58.075483+0000","last_clean":"2024-09-10T20:39:58.075483+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:39:58.075483+0000","last_undegraded":"2024-09-10T20:39:58.075483+0000","last_fullsized":"2024-09-10T20:39:58.075483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873275+0000","last_change":"2024-09-10T20:39:56.886319+0000","last_active":"2024-09-10T20:39:57.873275+0000","last_peered":"2024-09-10T20:39:57.873275+0000","last_clean":"2024-09-10T20:39:57.873275+0000","last_became_active":"2024-09-10T20:39:56.884644+0000","last_became_peered":"2024-09-10T20:39:56.884644+0000","last_unstale":"2024-09-10T20:39:57.873275+0000","last_undegraded":"2024-09-10T20:39:57.873275+0000","last_fullsized":"2024-09-10T20:39:57.873275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.635249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873205+0000","last_change":"2024-09-10T20:39:52.841498+0000","last_active":"2024-09-10T20:39:57.873205+0000","last_peered":"2024-09-10T20:39:57.873205+0000","last_clean":"2024-09-10T20:39:57.873205+0000","last_became_active":"2024-09-10T20:39:52.841257+0000","last_became_peered":"2024-09-10T20:39:52.841257+0000","last_unstale":"2024-09-10T20:39:57.873205+0000","last_undegraded":"2024-09-10T20:39:57.873205+0000","last_fullsized":"2024-09-10T20:39:57.873205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:56.841902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870555+0000","last_change":"2024-09-10T20:39:51.831320+0000","last_active":"2024-09-10T20:39:57.870555+0000","last_peered":"2024-09-10T20:39:57.870555+0000","last_clean":"2024-09-10T20:39:57.870555+0000","last_became_active":"2024-09-10T20:39:51.831030+0000","last_became_peered":"2024-09-10T20:39:51.831030+0000","last_unstale":"2024-09-10T20:39:57.870555+0000","last_undegraded":"2024-09-10T20:39:57.870555+0000","last_fullsized":"2024-09-10T20:39:57.870555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576384+0000","last_change":"2024-09-10T20:39:56.876055+0000","last_active":"2024-09-10T20:39:58.576384+0000","last_peered":"2024-09-10T20:39:58.576384+0000","last_clean":"2024-09-10T20:39:58.576384+0000","last_became_active":"2024-09-10T20:39:56.875602+0000","last_became_peered":"2024-09-10T20:39:56.875602+0000","last_unstale":"2024-09-10T20:39:58.576384+0000","last_undegraded":"2024-09-10T20:39:58.576384+0000","last_fullsized":"2024-09-10T20:39:58.576384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:01.886686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456584+0000","last_change":"2024-09-10T20:39:52.856423+0000","last_active":"2024-09-10T20:39:58.456584+0000","last_peered":"2024-09-10T20:39:58.456584+0000","last_clean":"2024-09-10T20:39:58.456584+0000","last_became_active":"2024-09-10T20:39:52.855409+0000","last_became_peered":"2024-09-10T20:39:52.855409+0000","last_unstale":"2024-09-10T20:39:58.456584+0000","last_undegraded":"2024-09-10T20:39:58.456584+0000","last_fullsized":"2024-09-10T20:39:58.456584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:35.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871541+0000","last_change":"2024-09-10T20:39:51.833978+0000","last_active":"2024-09-10T20:39:57.871541+0000","last_peered":"2024-09-10T20:39:57.871541+0000","last_clean":"2024-09-10T20:39:57.871541+0000","last_became_active":"2024-09-10T20:39:51.833436+0000","last_became_peered":"2024-09-10T20:39:51.833436+0000","last_unstale":"2024-09-10T20:39:57.871541+0000","last_undegraded":"2024-09-10T20:39:57.871541+0000","last_fullsized":"2024-09-10T20:39:57.871541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:00.812828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870986+0000","last_change":"2024-09-10T20:39:56.879933+0000","last_active":"2024-09-10T20:39:57.870986+0000","last_peered":"2024-09-10T20:39:57.870986+0000","last_clean":"2024-09-10T20:39:57.870986+0000","last_became_active":"2024-09-10T20:39:56.879254+0000","last_became_peered":"2024-09-10T20:39:56.879254+0000","last_unstale":"2024-09-10T20:39:57.870986+0000","last_undegraded":"2024-09-10T20:39:57.870986+0000","last_fullsized":"2024-09-10T20:39:57.870986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:10.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456878+0000","last_change":"2024-09-10T20:39:52.852816+0000","last_active":"2024-09-10T20:39:58.456878+0000","last_peered":"2024-09-10T20:39:58.456878+0000","last_clean":"2024-09-10T20:39:58.456878+0000","last_became_active":"2024-09-10T20:39:52.851310+0000","last_became_peered":"2024-09-10T20:39:52.851310+0000","last_unstale":"2024-09-10T20:39:58.456878+0000","last_undegraded":"2024-09-10T20:39:58.456878+0000","last_fullsized":"2024-09-10T20:39:58.456878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577993+0000","last_change":"2024-09-10T20:39:51.831688+0000","last_active":"2024-09-10T20:39:58.577993+0000","last_peered":"2024-09-10T20:39:58.577993+0000","last_clean":"2024-09-10T20:39:58.577993+0000","last_became_active":"2024-09-10T20:39:51.827155+0000","last_became_peered":"2024-09-10T20:39:51.827155+0000","last_unstale":"2024-09-10T20:39:58.577993+0000","last_undegraded":"2024-09-10T20:39:58.577993+0000","last_fullsized":"2024-09-10T20:39:58.577993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872194+0000","last_change":"2024-09-10T20:39:56.882581+0000","last_active":"2024-09-10T20:39:57.872194+0000","last_peered":"2024-09-10T20:39:57.872194+0000","last_clean":"2024-09-10T20:39:57.872194+0000","last_became_active":"2024-09-10T20:39:56.882242+0000","last_became_peered":"2024-09-10T20:39:56.882242+0000","last_unstale":"2024-09-10T20:39:57.872194+0000","last_undegraded":"2024-09-10T20:39:57.872194+0000","last_fullsized":"2024-09-10T20:39:57.872194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:18.763655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577376+0000","last_change":"2024-09-10T20:39:52.858795+0000","last_active":"2024-09-10T20:39:58.577376+0000","last_peered":"2024-09-10T20:39:58.577376+0000","last_clean":"2024-09-10T20:39:58.577376+0000","last_became_active":"2024-09-10T20:39:52.858501+0000","last_became_peered":"2024-09-10T20:39:52.858501+0000","last_unstale":"2024-09-10T20:39:58.577376+0000","last_undegraded":"2024-09-10T20:39:58.577376+0000","last_fullsized":"2024-09-10T20:39:58.577376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:13.273835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456897+0000","last_change":"2024-09-10T20:39:51.838792+0000","last_active":"2024-09-10T20:39:58.456897+0000","last_peered":"2024-09-10T20:39:58.456897+0000","last_clean":"2024-09-10T20:39:58.456897+0000","last_became_active":"2024-09-10T20:39:51.838547+0000","last_became_peered":"2024-09-10T20:39:51.838547+0000","last_unstale":"2024-09-10T20:39:58.456897+0000","last_undegraded":"2024-09-10T20:39:58.456897+0000","last_fullsized":"2024-09-10T20:39:58.456897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075650+0000","last_change":"2024-09-10T20:39:56.872369+0000","last_active":"2024-09-10T20:39:58.075650+0000","last_peered":"2024-09-10T20:39:58.075650+0000","last_clean":"2024-09-10T20:39:58.075650+0000","last_became_active":"2024-09-10T20:39:56.871964+0000","last_became_peered":"2024-09-10T20:39:56.871964+0000","last_unstale":"2024-09-10T20:39:58.075650+0000","last_undegraded":"2024-09-10T20:39:58.075650+0000","last_fullsized":"2024-09-10T20:39:58.075650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:17.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872297+0000","last_change":"2024-09-10T20:39:52.848064+0000","last_active":"2024-09-10T20:39:57.872297+0000","last_peered":"2024-09-10T20:39:57.872297+0000","last_clean":"2024-09-10T20:39:57.872297+0000","last_became_active":"2024-09-10T20:39:52.847836+0000","last_became_peered":"2024-09-10T20:39:52.847836+0000","last_unstale":"2024-09-10T20:39:57.872297+0000","last_undegraded":"2024-09-10T20:39:57.872297+0000","last_fullsized":"2024-09-10T20:39:57.872297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:17.051921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577568+0000","last_change":"2024-09-10T20:39:51.827434+0000","last_active":"2024-09-10T20:39:58.577568+0000","last_peered":"2024-09-10T20:39:58.577568+0000","last_clean":"2024-09-10T20:39:58.577568+0000","last_became_active":"2024-09-10T20:39:51.826046+0000","last_became_peered":"2024-09-10T20:39:51.826046+0000","last_unstale":"2024-09-10T20:39:58.577568+0000","last_undegraded":"2024-09-10T20:39:58.577568+0000","last_fullsized":"2024-09-10T20:39:58.577568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871947+0000","last_change":"2024-09-10T20:39:56.879394+0000","last_active":"2024-09-10T20:39:57.871947+0000","last_peered":"2024-09-10T20:39:57.871947+0000","last_clean":"2024-09-10T20:39:57.871947+0000","last_became_active":"2024-09-10T20:39:56.879041+0000","last_became_peered":"2024-09-10T20:39:56.879041+0000","last_unstale":"2024-09-10T20:39:57.871947+0000","last_undegraded":"2024-09-10T20:39:57.871947+0000","last_fullsized":"2024-09-10T20:39:57.871947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:42.040215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075444+0000","last_change":"2024-09-10T20:39:52.836545+0000","last_active":"2024-09-10T20:39:58.075444+0000","last_peered":"2024-09-10T20:39:58.075444+0000","last_clean":"2024-09-10T20:39:58.075444+0000","last_became_active":"2024-09-10T20:39:52.836266+0000","last_became_peered":"2024-09-10T20:39:52.836266+0000","last_unstale":"2024-09-10T20:39:58.075444+0000","last_undegraded":"2024-09-10T20:39:58.075444+0000","last_fullsized":"2024-09-10T20:39:58.075444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:39.345060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456157+0000","last_change":"2024-09-10T20:39:51.833755+0000","last_active":"2024-09-10T20:39:58.456157+0000","last_peered":"2024-09-10T20:39:58.456157+0000","last_clean":"2024-09-10T20:39:58.456157+0000","last_became_active":"2024-09-10T20:39:51.833384+0000","last_became_peered":"2024-09-10T20:39:51.833384+0000","last_unstale":"2024-09-10T20:39:58.456157+0000","last_undegraded":"2024-09-10T20:39:58.456157+0000","last_fullsized":"2024-09-10T20:39:58.456157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871522+0000","last_change":"2024-09-10T20:39:56.876669+0000","last_active":"2024-09-10T20:39:57.871522+0000","last_peered":"2024-09-10T20:39:57.871522+0000","last_clean":"2024-09-10T20:39:57.871522+0000","last_became_active":"2024-09-10T20:39:56.876230+0000","last_became_peered":"2024-09-10T20:39:56.876230+0000","last_unstale":"2024-09-10T20:39:57.871522+0000","last_undegraded":"2024-09-10T20:39:57.871522+0000","last_fullsized":"2024-09-10T20:39:57.871522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:04.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872716+0000","last_change":"2024-09-10T20:39:52.840978+0000","last_active":"2024-09-10T20:39:57.872716+0000","last_peered":"2024-09-10T20:39:57.872716+0000","last_clean":"2024-09-10T20:39:57.872716+0000","last_became_active":"2024-09-10T20:39:52.840710+0000","last_became_peered":"2024-09-10T20:39:52.840710+0000","last_unstale":"2024-09-10T20:39:57.872716+0000","last_undegraded":"2024-09-10T20:39:57.872716+0000","last_fullsized":"2024-09-10T20:39:57.872716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:17.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872789+0000","last_change":"2024-09-10T20:39:51.837821+0000","last_active":"2024-09-10T20:39:57.872789+0000","last_peered":"2024-09-10T20:39:57.872789+0000","last_clean":"2024-09-10T20:39:57.872789+0000","last_became_active":"2024-09-10T20:39:51.836390+0000","last_became_peered":"2024-09-10T20:39:51.836390+0000","last_unstale":"2024-09-10T20:39:57.872789+0000","last_undegraded":"2024-09-10T20:39:57.872789+0000","last_fullsized":"2024-09-10T20:39:57.872789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:47.684343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869817+0000","last_change":"2024-09-10T20:39:56.875780+0000","last_active":"2024-09-10T20:39:57.869817+0000","last_peered":"2024-09-10T20:39:57.869817+0000","last_clean":"2024-09-10T20:39:57.869817+0000","last_became_active":"2024-09-10T20:39:56.875088+0000","last_became_peered":"2024-09-10T20:39:56.875088+0000","last_unstale":"2024-09-10T20:39:57.869817+0000","last_undegraded":"2024-09-10T20:39:57.869817+0000","last_fullsized":"2024-09-10T20:39:57.869817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:21.298196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870634+0000","last_change":"2024-09-10T20:39:52.856029+0000","last_active":"2024-09-10T20:39:57.870634+0000","last_peered":"2024-09-10T20:39:57.870634+0000","last_clean":"2024-09-10T20:39:57.870634+0000","last_became_active":"2024-09-10T20:39:52.855776+0000","last_became_peered":"2024-09-10T20:39:52.855776+0000","last_unstale":"2024-09-10T20:39:57.870634+0000","last_undegraded":"2024-09-10T20:39:57.870634+0000","last_fullsized":"2024-09-10T20:39:57.870634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:31.338948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578682+0000","last_change":"2024-09-10T20:39:51.828785+0000","last_active":"2024-09-10T20:39:58.578682+0000","last_peered":"2024-09-10T20:39:58.578682+0000","last_clean":"2024-09-10T20:39:58.578682+0000","last_became_active":"2024-09-10T20:39:51.828496+0000","last_became_peered":"2024-09-10T20:39:51.828496+0000","last_unstale":"2024-09-10T20:39:58.578682+0000","last_undegraded":"2024-09-10T20:39:58.578682+0000","last_fullsized":"2024-09-10T20:39:58.578682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:36.547419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873081+0000","last_change":"2024-09-10T20:39:56.885656+0000","last_active":"2024-09-10T20:39:57.873081+0000","last_peered":"2024-09-10T20:39:57.873081+0000","last_clean":"2024-09-10T20:39:57.873081+0000","last_became_active":"2024-09-10T20:39:56.881762+0000","last_became_peered":"2024-09-10T20:39:56.881762+0000","last_unstale":"2024-09-10T20:39:57.873081+0000","last_undegraded":"2024-09-10T20:39:57.873081+0000","last_fullsized":"2024-09-10T20:39:57.873081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:42.541386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456583+0000","last_change":"2024-09-10T20:39:52.851647+0000","last_active":"2024-09-10T20:39:58.456583+0000","last_peered":"2024-09-10T20:39:58.456583+0000","last_clean":"2024-09-10T20:39:58.456583+0000","last_became_active":"2024-09-10T20:39:52.851358+0000","last_became_peered":"2024-09-10T20:39:52.851358+0000","last_unstale":"2024-09-10T20:39:58.456583+0000","last_undegraded":"2024-09-10T20:39:58.456583+0000","last_fullsized":"2024-09-10T20:39:58.456583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:43.399295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:40:04.050528+0000","last_change":"2024-09-10T20:39:51.836741+0000","last_active":"2024-09-10T20:40:04.050528+0000","last_peered":"2024-09-10T20:40:04.050528+0000","last_clean":"2024-09-10T20:40:04.050528+0000","last_became_active":"2024-09-10T20:39:51.836492+0000","last_became_peered":"2024-09-10T20:39:51.836492+0000","last_unstale":"2024-09-10T20:40:04.050528+0000","last_undegraded":"2024-09-10T20:40:04.050528+0000","last_fullsized":"2024-09-10T20:40:04.050528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.827648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577118+0000","last_change":"2024-09-10T20:39:56.870600+0000","last_active":"2024-09-10T20:39:58.577118+0000","last_peered":"2024-09-10T20:39:58.577118+0000","last_clean":"2024-09-10T20:39:58.577118+0000","last_became_active":"2024-09-10T20:39:56.870128+0000","last_became_peered":"2024-09-10T20:39:56.870128+0000","last_unstale":"2024-09-10T20:39:58.577118+0000","last_undegraded":"2024-09-10T20:39:58.577118+0000","last_fullsized":"2024-09-10T20:39:58.577118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872529+0000","last_change":"2024-09-10T20:39:52.867767+0000","last_active":"2024-09-10T20:39:57.872529+0000","last_peered":"2024-09-10T20:39:57.872529+0000","last_clean":"2024-09-10T20:39:57.872529+0000","last_became_active":"2024-09-10T20:39:52.867458+0000","last_became_peered":"2024-09-10T20:39:52.867458+0000","last_unstale":"2024-09-10T20:39:57.872529+0000","last_undegraded":"2024-09-10T20:39:57.872529+0000","last_fullsized":"2024-09-10T20:39:57.872529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.084789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578769+0000","last_change":"2024-09-10T20:39:51.836668+0000","last_active":"2024-09-10T20:39:58.578769+0000","last_peered":"2024-09-10T20:39:58.578769+0000","last_clean":"2024-09-10T20:39:58.578769+0000","last_became_active":"2024-09-10T20:39:51.835742+0000","last_became_peered":"2024-09-10T20:39:51.835742+0000","last_unstale":"2024-09-10T20:39:58.578769+0000","last_undegraded":"2024-09-10T20:39:58.578769+0000","last_fullsized":"2024-09-10T20:39:58.578769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576664+0000","last_change":"2024-09-10T20:39:56.882037+0000","last_active":"2024-09-10T20:39:58.576664+0000","last_peered":"2024-09-10T20:39:58.576664+0000","last_clean":"2024-09-10T20:39:58.576664+0000","last_became_active":"2024-09-10T20:39:56.881084+0000","last_became_peered":"2024-09-10T20:39:56.881084+0000","last_unstale":"2024-09-10T20:39:58.576664+0000","last_undegraded":"2024-09-10T20:39:58.576664+0000","last_fullsized":"2024-09-10T20:39:58.576664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871674+0000","last_change":"2024-09-10T20:39:52.849174+0000","last_active":"2024-09-10T20:39:57.871674+0000","last_peered":"2024-09-10T20:39:57.871674+0000","last_clean":"2024-09-10T20:39:57.871674+0000","last_became_active":"2024-09-10T20:39:52.848762+0000","last_became_peered":"2024-09-10T20:39:52.848762+0000","last_unstale":"2024-09-10T20:39:57.871674+0000","last_undegraded":"2024-09-10T20:39:57.871674+0000","last_fullsized":"2024-09-10T20:39:57.871674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:16.849067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456678+0000","last_change":"2024-09-10T20:39:51.827946+0000","last_active":"2024-09-10T20:39:58.456678+0000","last_peered":"2024-09-10T20:39:58.456678+0000","last_clean":"2024-09-10T20:39:58.456678+0000","last_became_active":"2024-09-10T20:39:51.827668+0000","last_became_peered":"2024-09-10T20:39:51.827668+0000","last_unstale":"2024-09-10T20:39:58.456678+0000","last_undegraded":"2024-09-10T20:39:58.456678+0000","last_fullsized":"2024-09-10T20:39:58.456678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576917+0000","last_change":"2024-09-10T20:39:56.890560+0000","last_active":"2024-09-10T20:39:58.576917+0000","last_peered":"2024-09-10T20:39:58.576917+0000","last_clean":"2024-09-10T20:39:58.576917+0000","last_became_active":"2024-09-10T20:39:56.890207+0000","last_became_peered":"2024-09-10T20:39:56.890207+0000","last_unstale":"2024-09-10T20:39:58.576917+0000","last_undegraded":"2024-09-10T20:39:58.576917+0000","last_fullsized":"2024-09-10T20:39:58.576917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:35.374852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577293+0000","last_change":"2024-09-10T20:39:52.865954+0000","last_active":"2024-09-10T20:39:58.577293+0000","last_peered":"2024-09-10T20:39:58.577293+0000","last_clean":"2024-09-10T20:39:58.577293+0000","last_became_active":"2024-09-10T20:39:52.865077+0000","last_became_peered":"2024-09-10T20:39:52.865077+0000","last_unstale":"2024-09-10T20:39:58.577293+0000","last_undegraded":"2024-09-10T20:39:58.577293+0000","last_fullsized":"2024-09-10T20:39:58.577293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:20.726727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076179+0000","last_change":"2024-09-10T20:39:51.822729+0000","last_active":"2024-09-10T20:39:58.076179+0000","last_peered":"2024-09-10T20:39:58.076179+0000","last_clean":"2024-09-10T20:39:58.076179+0000","last_became_active":"2024-09-10T20:39:51.822465+0000","last_became_peered":"2024-09-10T20:39:51.822465+0000","last_unstale":"2024-09-10T20:39:58.076179+0000","last_undegraded":"2024-09-10T20:39:58.076179+0000","last_fullsized":"2024-09-10T20:39:58.076179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577450+0000","last_change":"2024-09-10T20:39:56.871160+0000","last_active":"2024-09-10T20:39:58.577450+0000","last_peered":"2024-09-10T20:39:58.577450+0000","last_clean":"2024-09-10T20:39:58.577450+0000","last_became_active":"2024-09-10T20:39:56.870762+0000","last_became_peered":"2024-09-10T20:39:56.870762+0000","last_unstale":"2024-09-10T20:39:58.577450+0000","last_undegraded":"2024-09-10T20:39:58.577450+0000","last_fullsized":"2024-09-10T20:39:58.577450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:40.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577908+0000","last_change":"2024-09-10T20:39:56.875335+0000","last_active":"2024-09-10T20:39:58.577908+0000","last_peered":"2024-09-10T20:39:58.577908+0000","last_clean":"2024-09-10T20:39:58.577908+0000","last_became_active":"2024-09-10T20:39:56.874929+0000","last_became_peered":"2024-09-10T20:39:56.874929+0000","last_unstale":"2024-09-10T20:39:58.577908+0000","last_undegraded":"2024-09-10T20:39:58.577908+0000","last_fullsized":"2024-09-10T20:39:58.577908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:00.877805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577652+0000","last_change":"2024-09-10T20:39:52.841133+0000","last_active":"2024-09-10T20:39:58.577652+0000","last_peered":"2024-09-10T20:39:58.577652+0000","last_clean":"2024-09-10T20:39:58.577652+0000","last_became_active":"2024-09-10T20:39:52.840806+0000","last_became_peered":"2024-09-10T20:39:52.840806+0000","last_unstale":"2024-09-10T20:39:58.577652+0000","last_undegraded":"2024-09-10T20:39:58.577652+0000","last_fullsized":"2024-09-10T20:39:58.577652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:22.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872394+0000","last_change":"2024-09-10T20:39:51.834171+0000","last_active":"2024-09-10T20:39:57.872394+0000","last_peered":"2024-09-10T20:39:57.872394+0000","last_clean":"2024-09-10T20:39:57.872394+0000","last_became_active":"2024-09-10T20:39:51.833897+0000","last_became_peered":"2024-09-10T20:39:51.833897+0000","last_unstale":"2024-09-10T20:39:57.872394+0000","last_undegraded":"2024-09-10T20:39:57.872394+0000","last_fullsized":"2024-09-10T20:39:57.872394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:19.719836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872638+0000","last_change":"2024-09-10T20:39:56.872254+0000","last_active":"2024-09-10T20:39:57.872638+0000","last_peered":"2024-09-10T20:39:57.872638+0000","last_clean":"2024-09-10T20:39:57.872638+0000","last_became_active":"2024-09-10T20:39:56.871890+0000","last_became_peered":"2024-09-10T20:39:56.871890+0000","last_unstale":"2024-09-10T20:39:57.872638+0000","last_undegraded":"2024-09-10T20:39:57.872638+0000","last_fullsized":"2024-09-10T20:39:57.872638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:13.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869957+0000","last_change":"2024-09-10T20:39:52.851621+0000","last_active":"2024-09-10T20:39:57.869957+0000","last_peered":"2024-09-10T20:39:57.869957+0000","last_clean":"2024-09-10T20:39:57.869957+0000","last_became_active":"2024-09-10T20:39:52.851307+0000","last_became_peered":"2024-09-10T20:39:52.851307+0000","last_unstale":"2024-09-10T20:39:57.869957+0000","last_undegraded":"2024-09-10T20:39:57.869957+0000","last_fullsized":"2024-09-10T20:39:57.869957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:02.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869951+0000","last_change":"2024-09-10T20:39:51.832088+0000","last_active":"2024-09-10T20:39:57.869951+0000","last_peered":"2024-09-10T20:39:57.869951+0000","last_clean":"2024-09-10T20:39:57.869951+0000","last_became_active":"2024-09-10T20:39:51.831590+0000","last_became_peered":"2024-09-10T20:39:51.831590+0000","last_unstale":"2024-09-10T20:39:57.869951+0000","last_undegraded":"2024-09-10T20:39:57.869951+0000","last_fullsized":"2024-09-10T20:39:57.869951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:11.450509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872645+0000","last_change":"2024-09-10T20:39:51.841531+0000","last_active":"2024-09-10T20:39:57.872645+0000","last_peered":"2024-09-10T20:39:57.872645+0000","last_clean":"2024-09-10T20:39:57.872645+0000","last_became_active":"2024-09-10T20:39:51.841294+0000","last_became_peered":"2024-09-10T20:39:51.841294+0000","last_unstale":"2024-09-10T20:39:57.872645+0000","last_undegraded":"2024-09-10T20:39:57.872645+0000","last_fullsized":"2024-09-10T20:39:57.872645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.838524+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.838252+0000","last_became_peered":"2024-09-10T20:39:52.838252+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:32.234408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577531+0000","last_change":"2024-09-10T20:39:56.874073+0000","last_active":"2024-09-10T20:39:58.577531+0000","last_peered":"2024-09-10T20:39:58.577531+0000","last_clean":"2024-09-10T20:39:58.577531+0000","last_became_active":"2024-09-10T20:39:56.873456+0000","last_became_peered":"2024-09-10T20:39:56.873456+0000","last_unstale":"2024-09-10T20:39:58.577531+0000","last_undegraded":"2024-09-10T20:39:58.577531+0000","last_fullsized":"2024-09-10T20:39:58.577531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:51.097723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870967+0000","last_change":"2024-09-10T20:39:51.823981+0000","last_active":"2024-09-10T20:39:57.870967+0000","last_peered":"2024-09-10T20:39:57.870967+0000","last_clean":"2024-09-10T20:39:57.870967+0000","last_became_active":"2024-09-10T20:39:51.823667+0000","last_became_peered":"2024-09-10T20:39:51.823667+0000","last_unstale":"2024-09-10T20:39:57.870967+0000","last_undegraded":"2024-09-10T20:39:57.870967+0000","last_fullsized":"2024-09-10T20:39:57.870967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:53.926735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075527+0000","last_change":"2024-09-10T20:39:52.842250+0000","last_active":"2024-09-10T20:39:58.075527+0000","last_peered":"2024-09-10T20:39:58.075527+0000","last_clean":"2024-09-10T20:39:58.075527+0000","last_became_active":"2024-09-10T20:39:52.842013+0000","last_became_peered":"2024-09-10T20:39:52.842013+0000","last_unstale":"2024-09-10T20:39:58.075527+0000","last_undegraded":"2024-09-10T20:39:58.075527+0000","last_fullsized":"2024-09-10T20:39:58.075527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:19.358235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578569+0000","last_change":"2024-09-10T20:39:56.873781+0000","last_active":"2024-09-10T20:39:58.578569+0000","last_peered":"2024-09-10T20:39:58.578569+0000","last_clean":"2024-09-10T20:39:58.578569+0000","last_became_active":"2024-09-10T20:39:56.871150+0000","last_became_peered":"2024-09-10T20:39:56.871150+0000","last_unstale":"2024-09-10T20:39:58.578569+0000","last_undegraded":"2024-09-10T20:39:58.578569+0000","last_fullsized":"2024-09-10T20:39:58.578569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:03.889499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576369+0000","last_change":"2024-09-10T20:39:52.858032+0000","last_active":"2024-09-10T20:39:58.576369+0000","last_peered":"2024-09-10T20:39:58.576369+0000","last_clean":"2024-09-10T20:39:58.576369+0000","last_became_active":"2024-09-10T20:39:52.851049+0000","last_became_peered":"2024-09-10T20:39:52.851049+0000","last_unstale":"2024-09-10T20:39:58.576369+0000","last_undegraded":"2024-09-10T20:39:58.576369+0000","last_fullsized":"2024-09-10T20:39:58.576369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.850149+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.849435+0000","last_became_peered":"2024-09-10T20:39:52.849435+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:13.186313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872460+0000","last_change":"2024-09-10T20:39:52.849458+0000","last_active":"2024-09-10T20:39:57.872460+0000","last_peered":"2024-09-10T20:39:57.872460+0000","last_clean":"2024-09-10T20:39:57.872460+0000","last_became_active":"2024-09-10T20:39:52.844995+0000","last_became_peered":"2024-09-10T20:39:52.844995+0000","last_unstale":"2024-09-10T20:39:57.872460+0000","last_undegraded":"2024-09-10T20:39:57.872460+0000","last_fullsized":"2024-09-10T20:39:57.872460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870856+0000","last_change":"2024-09-10T20:39:52.840179+0000","last_active":"2024-09-10T20:39:57.870856+0000","last_peered":"2024-09-10T20:39:57.870856+0000","last_clean":"2024-09-10T20:39:57.870856+0000","last_became_active":"2024-09-10T20:39:52.839890+0000","last_became_peered":"2024-09-10T20:39:52.839890+0000","last_unstale":"2024-09-10T20:39:57.870856+0000","last_undegraded":"2024-09-10T20:39:57.870856+0000","last_fullsized":"2024-09-10T20:39:57.870856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:47.732259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870243+0000","last_change":"2024-09-10T20:39:52.853516+0000","last_active":"2024-09-10T20:39:57.870243+0000","last_peered":"2024-09-10T20:39:57.870243+0000","last_clean":"2024-09-10T20:39:57.870243+0000","last_became_active":"2024-09-10T20:39:52.853256+0000","last_became_peered":"2024-09-10T20:39:52.853256+0000","last_unstale":"2024-09-10T20:39:57.870243+0000","last_undegraded":"2024-09-10T20:39:57.870243+0000","last_fullsized":"2024-09-10T20:39:57.870243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:59.853596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870433+0000","last_change":"2024-09-10T20:39:52.859738+0000","last_active":"2024-09-10T20:39:57.870433+0000","last_peered":"2024-09-10T20:39:57.870433+0000","last_clean":"2024-09-10T20:39:57.870433+0000","last_became_active":"2024-09-10T20:39:52.859463+0000","last_became_peered":"2024-09-10T20:39:52.859463+0000","last_unstale":"2024-09-10T20:39:57.870433+0000","last_undegraded":"2024-09-10T20:39:57.870433+0000","last_fullsized":"2024-09-10T20:39:57.870433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:55.113983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577211+0000","last_change":"2024-09-10T20:39:52.867039+0000","last_active":"2024-09-10T20:39:58.577211+0000","last_peered":"2024-09-10T20:39:58.577211+0000","last_clean":"2024-09-10T20:39:58.577211+0000","last_became_active":"2024-09-10T20:39:52.865884+0000","last_became_peered":"2024-09-10T20:39:52.865884+0000","last_unstale":"2024-09-10T20:39:58.577211+0000","last_undegraded":"2024-09-10T20:39:58.577211+0000","last_fullsized":"2024-09-10T20:39:58.577211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:39.994022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871253+0000","last_change":"2024-09-10T20:39:52.844959+0000","last_active":"2024-09-10T20:39:57.871253+0000","last_peered":"2024-09-10T20:39:57.871253+0000","last_clean":"2024-09-10T20:39:57.871253+0000","last_became_active":"2024-09-10T20:39:52.844642+0000","last_became_peered":"2024-09-10T20:39:52.844642+0000","last_unstale":"2024-09-10T20:39:57.871253+0000","last_undegraded":"2024-09-10T20:39:57.871253+0000","last_fullsized":"2024-09-10T20:39:57.871253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:52:36.606145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872318+0000","last_change":"2024-09-10T20:39:52.844163+0000","last_active":"2024-09-10T20:39:57.872318+0000","last_peered":"2024-09-10T20:39:57.872318+0000","last_clean":"2024-09-10T20:39:57.872318+0000","last_became_active":"2024-09-10T20:39:52.843914+0000","last_became_peered":"2024-09-10T20:39:52.843914+0000","last_unstale":"2024-09-10T20:39:57.872318+0000","last_undegraded":"2024-09-10T20:39:57.872318+0000","last_fullsized":"2024-09-10T20:39:57.872318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:57.293478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869918+0000","last_change":"2024-09-10T20:39:52.858267+0000","last_active":"2024-09-10T20:39:57.869918+0000","last_peered":"2024-09-10T20:39:57.869918+0000","last_clean":"2024-09-10T20:39:57.869918+0000","last_became_active":"2024-09-10T20:39:52.857994+0000","last_became_peered":"2024-09-10T20:39:52.857994+0000","last_unstale":"2024-09-10T20:39:57.869918+0000","last_undegraded":"2024-09-10T20:39:57.869918+0000","last_fullsized":"2024-09-10T20:39:57.869918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:54.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075525+0000","last_change":"2024-09-10T20:39:52.839856+0000","last_active":"2024-09-10T20:39:58.075525+0000","last_peered":"2024-09-10T20:39:58.075525+0000","last_clean":"2024-09-10T20:39:58.075525+0000","last_became_active":"2024-09-10T20:39:52.839371+0000","last_became_peered":"2024-09-10T20:39:52.839371+0000","last_unstale":"2024-09-10T20:39:58.075525+0000","last_undegraded":"2024-09-10T20:39:58.075525+0000","last_fullsized":"2024-09-10T20:39:58.075525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:26.611475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577919+0000","last_change":"2024-09-10T20:39:52.847903+0000","last_active":"2024-09-10T20:39:58.577919+0000","last_peered":"2024-09-10T20:39:58.577919+0000","last_clean":"2024-09-10T20:39:58.577919+0000","last_became_active":"2024-09-10T20:39:52.845560+0000","last_became_peered":"2024-09-10T20:39:52.845560+0000","last_unstale":"2024-09-10T20:39:58.577919+0000","last_undegraded":"2024-09-10T20:39:58.577919+0000","last_fullsized":"2024-09-10T20:39:58.577919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:17.131990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456492+0000","last_change":"2024-09-10T20:39:52.848817+0000","last_active":"2024-09-10T20:39:58.456492+0000","last_peered":"2024-09-10T20:39:58.456492+0000","last_clean":"2024-09-10T20:39:58.456492+0000","last_became_active":"2024-09-10T20:39:52.848189+0000","last_became_peered":"2024-09-10T20:39:52.848189+0000","last_unstale":"2024-09-10T20:39:58.456492+0000","last_undegraded":"2024-09-10T20:39:58.456492+0000","last_fullsized":"2024-09-10T20:39:58.456492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:21.966758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873355+0000","last_change":"2024-09-10T20:39:52.846495+0000","last_active":"2024-09-10T20:39:57.873355+0000","last_peered":"2024-09-10T20:39:57.873355+0000","last_clean":"2024-09-10T20:39:57.873355+0000","last_became_active":"2024-09-10T20:39:52.846187+0000","last_became_peered":"2024-09-10T20:39:52.846187+0000","last_unstale":"2024-09-10T20:39:57.873355+0000","last_undegraded":"2024-09-10T20:39:57.873355+0000","last_fullsized":"2024-09-10T20:39:57.873355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:15.910087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578849+0000","last_change":"2024-09-10T20:39:52.862017+0000","last_active":"2024-09-10T20:39:58.578849+0000","last_peered":"2024-09-10T20:39:58.578849+0000","last_clean":"2024-09-10T20:39:58.578849+0000","last_became_active":"2024-09-10T20:39:52.861762+0000","last_became_peered":"2024-09-10T20:39:52.861762+0000","last_unstale":"2024-09-10T20:39:58.578849+0000","last_undegraded":"2024-09-10T20:39:58.578849+0000","last_fullsized":"2024-09-10T20:39:58.578849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873597+0000","last_change":"2024-09-10T20:39:52.849628+0000","last_active":"2024-09-10T20:39:57.873597+0000","last_peered":"2024-09-10T20:39:57.873597+0000","last_clean":"2024-09-10T20:39:57.873597+0000","last_became_active":"2024-09-10T20:39:52.849327+0000","last_became_peered":"2024-09-10T20:39:52.849327+0000","last_unstale":"2024-09-10T20:39:57.873597+0000","last_undegraded":"2024-09-10T20:39:57.873597+0000","last_fullsized":"2024-09-10T20:39:57.873597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:13.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872215+0000","last_change":"2024-09-10T20:39:52.859978+0000","last_active":"2024-09-10T20:39:57.872215+0000","last_peered":"2024-09-10T20:39:57.872215+0000","last_clean":"2024-09-10T20:39:57.872215+0000","last_became_active":"2024-09-10T20:39:52.859786+0000","last_became_peered":"2024-09-10T20:39:52.859786+0000","last_unstale":"2024-09-10T20:39:57.872215+0000","last_undegraded":"2024-09-10T20:39:57.872215+0000","last_fullsized":"2024-09-10T20:39:57.872215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869715+0000","last_change":"2024-09-10T20:39:52.839446+0000","last_active":"2024-09-10T20:39:57.869715+0000","last_peered":"2024-09-10T20:39:57.869715+0000","last_clean":"2024-09-10T20:39:57.869715+0000","last_became_active":"2024-09-10T20:39:52.839065+0000","last_became_peered":"2024-09-10T20:39:52.839065+0000","last_unstale":"2024-09-10T20:39:57.869715+0000","last_undegraded":"2024-09-10T20:39:57.869715+0000","last_fullsized":"2024-09-10T20:39:57.869715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:18:21.362301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870520+0000","last_change":"2024-09-10T20:39:52.850996+0000","last_active":"2024-09-10T20:39:57.870520+0000","last_peered":"2024-09-10T20:39:57.870520+0000","last_clean":"2024-09-10T20:39:57.870520+0000","last_became_active":"2024-09-10T20:39:52.850689+0000","last_became_peered":"2024-09-10T20:39:52.850689+0000","last_unstale":"2024-09-10T20:39:57.870520+0000","last_undegraded":"2024-09-10T20:39:57.870520+0000","last_fullsized":"2024-09-10T20:39:57.870520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:41.036260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871243+0000","last_change":"2024-09-10T20:39:52.852058+0000","last_active":"2024-09-10T20:39:57.871243+0000","last_peered":"2024-09-10T20:39:57.871243+0000","last_clean":"2024-09-10T20:39:57.871243+0000","last_became_active":"2024-09-10T20:39:52.851810+0000","last_became_peered":"2024-09-10T20:39:52.851810+0000","last_unstale":"2024-09-10T20:39:57.871243+0000","last_undegraded":"2024-09-10T20:39:57.871243+0000","last_fullsized":"2024-09-10T20:39:57.871243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:53.759604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456464+0000","last_change":"2024-09-10T20:39:52.848422+0000","last_active":"2024-09-10T20:39:58.456464+0000","last_peered":"2024-09-10T20:39:58.456464+0000","last_clean":"2024-09-10T20:39:58.456464+0000","last_became_active":"2024-09-10T20:39:52.847754+0000","last_became_peered":"2024-09-10T20:39:52.847754+0000","last_unstale":"2024-09-10T20:39:58.456464+0000","last_undegraded":"2024-09-10T20:39:58.456464+0000","last_fullsized":"2024-09-10T20:39:58.456464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:20.826273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456507+0000","last_change":"2024-09-10T20:39:52.848711+0000","last_active":"2024-09-10T20:39:58.456507+0000","last_peered":"2024-09-10T20:39:58.456507+0000","last_clean":"2024-09-10T20:39:58.456507+0000","last_became_active":"2024-09-10T20:39:52.848350+0000","last_became_peered":"2024-09-10T20:39:52.848350+0000","last_unstale":"2024-09-10T20:39:58.456507+0000","last_undegraded":"2024-09-10T20:39:58.456507+0000","last_fullsized":"2024-09-10T20:39:58.456507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:57.850783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456664+0000","last_change":"2024-09-10T20:39:52.858551+0000","last_active":"2024-09-10T20:39:58.456664+0000","last_peered":"2024-09-10T20:39:58.456664+0000","last_clean":"2024-09-10T20:39:58.456664+0000","last_became_active":"2024-09-10T20:39:52.858293+0000","last_became_peered":"2024-09-10T20:39:52.858293+0000","last_unstale":"2024-09-10T20:39:58.456664+0000","last_undegraded":"2024-09-10T20:39:58.456664+0000","last_fullsized":"2024-09-10T20:39:58.456664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076168+0000","last_change":"2024-09-10T20:39:52.846940+0000","last_active":"2024-09-10T20:39:58.076168+0000","last_peered":"2024-09-10T20:39:58.076168+0000","last_clean":"2024-09-10T20:39:58.076168+0000","last_became_active":"2024-09-10T20:39:52.846684+0000","last_became_peered":"2024-09-10T20:39:52.846684+0000","last_unstale":"2024-09-10T20:39:58.076168+0000","last_undegraded":"2024-09-10T20:39:58.076168+0000","last_fullsized":"2024-09-10T20:39:58.076168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869746+0000","last_change":"2024-09-10T20:39:52.837716+0000","last_active":"2024-09-10T20:39:57.869746+0000","last_peered":"2024-09-10T20:39:57.869746+0000","last_clean":"2024-09-10T20:39:57.869746+0000","last_became_active":"2024-09-10T20:39:52.837340+0000","last_became_peered":"2024-09-10T20:39:52.837340+0000","last_unstale":"2024-09-10T20:39:57.869746+0000","last_undegraded":"2024-09-10T20:39:57.869746+0000","last_fullsized":"2024-09-10T20:39:57.869746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.144804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456132+0000","last_change":"2024-09-10T20:39:52.844070+0000","last_active":"2024-09-10T20:39:58.456132+0000","last_peered":"2024-09-10T20:39:58.456132+0000","last_clean":"2024-09-10T20:39:58.456132+0000","last_became_active":"2024-09-10T20:39:52.843767+0000","last_became_peered":"2024-09-10T20:39:52.843767+0000","last_unstale":"2024-09-10T20:39:58.456132+0000","last_undegraded":"2024-09-10T20:39:58.456132+0000","last_fullsized":"2024-09-10T20:39:58.456132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:25.772255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576576+0000","last_change":"2024-09-10T20:39:52.857416+0000","last_active":"2024-09-10T20:39:58.576576+0000","last_peered":"2024-09-10T20:39:58.576576+0000","last_clean":"2024-09-10T20:39:58.576576+0000","last_became_active":"2024-09-10T20:39:52.857072+0000","last_became_peered":"2024-09-10T20:39:52.857072+0000","last_unstale":"2024-09-10T20:39:58.576576+0000","last_undegraded":"2024-09-10T20:39:58.576576+0000","last_fullsized":"2024-09-10T20:39:58.576576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:48.691234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456292+0000","last_change":"2024-09-10T20:39:52.848949+0000","last_active":"2024-09-10T20:39:58.456292+0000","last_peered":"2024-09-10T20:39:58.456292+0000","last_clean":"2024-09-10T20:39:58.456292+0000","last_became_active":"2024-09-10T20:39:52.848651+0000","last_became_peered":"2024-09-10T20:39:52.848651+0000","last_unstale":"2024-09-10T20:39:58.456292+0000","last_undegraded":"2024-09-10T20:39:58.456292+0000","last_fullsized":"2024-09-10T20:39:58.456292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:15.293386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576714+0000","last_change":"2024-09-10T20:39:52.866936+0000","last_active":"2024-09-10T20:39:58.576714+0000","last_peered":"2024-09-10T20:39:58.576714+0000","last_clean":"2024-09-10T20:39:58.576714+0000","last_became_active":"2024-09-10T20:39:52.857238+0000","last_became_peered":"2024-09-10T20:39:52.857238+0000","last_unstale":"2024-09-10T20:39:58.576714+0000","last_undegraded":"2024-09-10T20:39:58.576714+0000","last_fullsized":"2024-09-10T20:39:58.576714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871449+0000","last_change":"2024-09-10T20:39:52.847418+0000","last_active":"2024-09-10T20:39:57.871449+0000","last_peered":"2024-09-10T20:39:57.871449+0000","last_clean":"2024-09-10T20:39:57.871449+0000","last_became_active":"2024-09-10T20:39:52.847135+0000","last_became_peered":"2024-09-10T20:39:52.847135+0000","last_unstale":"2024-09-10T20:39:57.871449+0000","last_undegraded":"2024-09-10T20:39:57.871449+0000","last_fullsized":"2024-09-10T20:39:57.871449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:41.028633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871755+0000","last_change":"2024-09-10T20:39:52.858784+0000","last_active":"2024-09-10T20:39:57.871755+0000","last_peered":"2024-09-10T20:39:57.871755+0000","last_clean":"2024-09-10T20:39:57.871755+0000","last_became_active":"2024-09-10T20:39:52.858556+0000","last_became_peered":"2024-09-10T20:39:52.858556+0000","last_unstale":"2024-09-10T20:39:57.871755+0000","last_undegraded":"2024-09-10T20:39:57.871755+0000","last_fullsized":"2024-09-10T20:39:57.871755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:04.350523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456833+0000","last_change":"2024-09-10T20:39:52.856985+0000","last_active":"2024-09-10T20:39:58.456833+0000","last_peered":"2024-09-10T20:39:58.456833+0000","last_clean":"2024-09-10T20:39:58.456833+0000","last_became_active":"2024-09-10T20:39:52.853995+0000","last_became_peered":"2024-09-10T20:39:52.853995+0000","last_unstale":"2024-09-10T20:39:58.456833+0000","last_undegraded":"2024-09-10T20:39:58.456833+0000","last_fullsized":"2024-09-10T20:39:58.456833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:40:15.523 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:40:15.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T20:40:15.524 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T20:40:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.713+0000 7f6d50400640 1 -- 172.21.15.81:0/2163764503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d30004d40 msgr2=0x7f6d300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.713+0000 7f6d50400640 1 --2- 172.21.15.81:0/2163764503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d30004d40 0x7f6d300051c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c290 tx=0x7f6d30005830 comp rx=0 tx=0).stop 2024-09-10T20:40:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.713+0000 7f6d4e400640 1 -- 172.21.15.81:0/2163764503 reap_dead start 2024-09-10T20:40:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.713+0000 7f6d50400640 1 -- 172.21.15.81:0/2163764503 shutdown_connections 2024-09-10T20:40:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.713+0000 7f6d50400640 1 -- 172.21.15.81:0/2163764503 >> 172.21.15.81:0/2163764503 conn(0x7f6d4806cb50 msgr2=0x7f6d4806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.713+0000 7f6d50400640 1 -- 172.21.15.81:0/2163764503 shutdown_connections 2024-09-10T20:40:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.713+0000 7f6d50400640 1 -- 172.21.15.81:0/2163764503 wait complete. 2024-09-10T20:40:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.715+0000 7f6d50400640 1 Processor -- start 2024-09-10T20:40:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.715+0000 7f6d50400640 1 -- start start 2024-09-10T20:40:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d50400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d30004d40 0x7f6d48153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d50400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4814cd80 0x7f6d48151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d50400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d4814d200 0x7f6d481521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d50400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480b2f90 con 0x7f6d4814cd80 2024-09-10T20:40:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d50400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480b2e10 con 0x7f6d4814d200 2024-09-10T20:40:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d50400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6d480aed50 con 0x7f6d30004d40 2024-09-10T20:40:15.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4814cd80 0x7f6d48151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d4d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4814cd80 0x7f6d48151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52304/0 (socket says 172.21.15.81:52304) 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d4d000640 1 -- 172.21.15.81:0/2430591564 learned_addr learned my addr 172.21.15.81:0/2430591564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d4da00640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d30004d40 0x7f6d48153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d4e400640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d4814d200 0x7f6d481521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d4d000640 1 -- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d30004d40 msgr2=0x7f6d48153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.716+0000 7f6d4d000640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d30004d40 0x7f6d48153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d4d000640 1 -- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d4814d200 msgr2=0x7f6d481521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d4d000640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d4814d200 0x7f6d481521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d4d000640 1 -- 172.21.15.81:0/2430591564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480ae300 con 0x7f6d4814cd80 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d4d000640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4814cd80 0x7f6d48151c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d34011ae0 tx=0x7f6d34009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d45600640 1 -- 172.21.15.81:0/2430591564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3401e070 con 0x7f6d4814cd80 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d45600640 1 -- 172.21.15.81:0/2430591564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d34004460 con 0x7f6d4814cd80 2024-09-10T20:40:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d481e4cc0 con 0x7f6d4814cd80 2024-09-10T20:40:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d45600640 1 -- 172.21.15.81:0/2430591564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3400fc40 con 0x7f6d4814cd80 2024-09-10T20:40:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.717+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d481e5280 con 0x7f6d4814cd80 2024-09-10T20:40:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.718+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d4815b020 con 0x7f6d4814cd80 2024-09-10T20:40:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.719+0000 7f6d45600640 1 -- 172.21.15.81:0/2430591564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6d340035f0 con 0x7f6d4814cd80 2024-09-10T20:40:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.720+0000 7f6d45600640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d28077f70 0x7f6d2807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.720+0000 7f6d45600640 1 -- 172.21.15.81:0/2430591564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6d3409adc0 con 0x7f6d4814cd80 2024-09-10T20:40:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.721+0000 7f6d4da00640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d28077f70 0x7f6d2807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.721+0000 7f6d4da00640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d28077f70 0x7f6d2807a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ac420 tx=0x7f6d3c010040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.724+0000 7f6d45600640 1 -- 172.21.15.81:0/2430591564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6d34062fe0 con 0x7f6d4814cd80 2024-09-10T20:40:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.911+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6d480ae5e0 con 0x7f6d4814cd80 2024-09-10T20:40:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.912+0000 7f6d45600640 1 -- 172.21.15.81:0/2430591564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f6d34067a10 con 0x7f6d4814cd80 2024-09-10T20:40:15.916 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d28077f70 msgr2=0x7f6d2807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d28077f70 0x7f6d2807a430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ac420 tx=0x7f6d3c010040 comp rx=0 tx=0).stop 2024-09-10T20:40:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4814cd80 msgr2=0x7f6d48151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4814cd80 0x7f6d48151c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d34011ae0 tx=0x7f6d34009e90 comp rx=0 tx=0).stop 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 shutdown_connections 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d28077f70 0x7f6d2807a430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d4814d200 0x7f6d481521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4814cd80 0x7f6d48151c70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 --2- 172.21.15.81:0/2430591564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d30004d40 0x7f6d48153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 >> 172.21.15.81:0/2430591564 conn(0x7f6d4806cb50 msgr2=0x7f6d4814fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 shutdown_connections 2024-09-10T20:40:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:15.914+0000 7f6d50400640 1 -- 172.21.15.81:0/2430591564 wait complete. 2024-09-10T20:40:15.936 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":27,"timestamp":"2024-09-10T20:39:40.507932+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"3808.832334"}]}] 2024-09-10T20:40:15.936 INFO:tasks.ceph_manager:config epoch is 27 2024-09-10T20:40:15.936 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T20:40:15.937 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T20:40:15.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T20:40:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.090+0000 7f0552400640 1 -- 172.21.15.81:0/1139952869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0530004800 msgr2=0x7f0530004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.090+0000 7f0552400640 1 --2- 172.21.15.81:0/1139952869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0530004800 0x7f0530004c80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0538009b20 tx=0x7f0530005830 comp rx=0 tx=0).stop 2024-09-10T20:40:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.090+0000 7f0551a00640 1 -- 172.21.15.81:0/1139952869 reap_dead start 2024-09-10T20:40:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.090+0000 7f0552400640 1 -- 172.21.15.81:0/1139952869 shutdown_connections 2024-09-10T20:40:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.090+0000 7f0552400640 1 -- 172.21.15.81:0/1139952869 >> 172.21.15.81:0/1139952869 conn(0x7f054c0d3ab0 msgr2=0x7f054c0d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.091+0000 7f0552400640 1 -- 172.21.15.81:0/1139952869 shutdown_connections 2024-09-10T20:40:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.091+0000 7f0552400640 1 -- 172.21.15.81:0/1139952869 wait complete. 2024-09-10T20:40:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.092+0000 7f0552400640 1 Processor -- start 2024-09-10T20:40:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.092+0000 7f0552400640 1 -- start start 2024-09-10T20:40:16.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0552400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0530004800 0x7f054c1f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0552400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f054c0b6e30 0x7f054c0b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0552400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f054c0b3dd0 0x7f054c0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0552400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1616c0 con 0x7f054c0b6e30 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0552400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f054c06e980 con 0x7f054c0b3dd0 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0552400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f054c0b3030 con 0x7f0530004800 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f054be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f054c0b6e30 0x7f054c0b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f054be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f054c0b6e30 0x7f054c0b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52334/0 (socket says 172.21.15.81:52334) 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f054be00640 1 -- 172.21.15.81:0/717829863 learned_addr learned my addr 172.21.15.81:0/717829863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0551a00640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f054c0b3dd0 0x7f054c0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.093+0000 7f0551000640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0530004800 0x7f054c1f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f054be00640 1 -- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0530004800 msgr2=0x7f054c1f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f054be00640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0530004800 0x7f054c1f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f054be00640 1 -- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f054c0b3dd0 msgr2=0x7f054c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f054be00640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f054c0b3dd0 0x7f054c0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f054be00640 1 -- 172.21.15.81:0/717829863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c1f4580 con 0x7f054c0b6e30 2024-09-10T20:40:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f0551a00640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f054c0b3dd0 0x7f054c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f054be00640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f054c0b6e30 0x7f054c0b72b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0538036040 tx=0x7f0538033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:16.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f0548c00640 1 -- 172.21.15.81:0/717829863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538038040 con 0x7f054c0b6e30 2024-09-10T20:40:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f0548c00640 1 -- 172.21.15.81:0/717829863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0538043070 con 0x7f054c0b6e30 2024-09-10T20:40:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c1f4820 con 0x7f054c0b6e30 2024-09-10T20:40:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f0548c00640 1 -- 172.21.15.81:0/717829863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538033cd0 con 0x7f054c0b6e30 2024-09-10T20:40:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.094+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c1f4de0 con 0x7f054c0b6e30 2024-09-10T20:40:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.095+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054c06d930 con 0x7f054c0b6e30 2024-09-10T20:40:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.096+0000 7f0548c00640 1 -- 172.21.15.81:0/717829863 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f053803b030 con 0x7f054c0b6e30 2024-09-10T20:40:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.097+0000 7f0548c00640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f052c077f70 0x7f052c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.097+0000 7f0548c00640 1 -- 172.21.15.81:0/717829863 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f05380bab50 con 0x7f054c0b6e30 2024-09-10T20:40:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.098+0000 7f0551000640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f052c077f70 0x7f052c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.098+0000 7f0551000640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f052c077f70 0x7f052c07a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f053c0064b0 tx=0x7f053c006c70 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:16.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.101+0000 7f0548c00640 1 -- 172.21.15.81:0/717829863 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0538082cb0 con 0x7f054c0b6e30 2024-09-10T20:40:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.332+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f054c160670 con 0x7f054c0b6e30 2024-09-10T20:40:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.335+0000 7f0548c00640 1 -- 172.21.15.81:0/717829863 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193250 (secure 0 0 0) 0x7f05380876e0 con 0x7f054c0b6e30 2024-09-10T20:40:16.341 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:16.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f052c077f70 msgr2=0x7f052c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f052c077f70 0x7f052c07a430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f053c0064b0 tx=0x7f053c006c70 comp rx=0 tx=0).stop 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f054c0b6e30 msgr2=0x7f054c0b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f054c0b6e30 0x7f054c0b72b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0538036040 tx=0x7f0538033670 comp rx=0 tx=0).stop 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 shutdown_connections 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f052c077f70 0x7f052c07a430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f054c0b3dd0 0x7f054c0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f054c0b6e30 0x7f054c0b72b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 --2- 172.21.15.81:0/717829863 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0530004800 0x7f054c1f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 >> 172.21.15.81:0/717829863 conn(0x7f054c0d3ab0 msgr2=0x7f054c0b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 shutdown_connections 2024-09-10T20:40:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.338+0000 7f0552400640 1 -- 172.21.15.81:0/717829863 wait complete. 2024-09-10T20:40:16.358 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4115,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1719157968},{"type":"v1","addr":"172.21.15.143:6801","nonce":1719157968}]},"active_addr":"172.21.15.143:6801/1719157968","active_change":"2024-09-10T20:39:31.831730+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":2123553972}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":2948480486}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":1791913175}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.143:0","nonce":1570827572}]}]} 2024-09-10T20:40:16.362 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T20:40:16.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T20:40:16.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 -- 172.21.15.81:0/1912794521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb040aea30 msgr2=0x7feb04073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 --2- 172.21.15.81:0/1912794521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb040aea30 0x7feb04073610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feaf4005fd0 tx=0x7feaf402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 -- 172.21.15.81:0/1912794521 shutdown_connections 2024-09-10T20:40:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 --2- 172.21.15.81:0/1912794521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb0415f8f0 0x7feb0415fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 --2- 172.21.15.81:0/1912794521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb040aea30 0x7feb04073610 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 -- 172.21.15.81:0/1912794521 >> 172.21.15.81:0/1912794521 conn(0x7feb0406d500 msgr2=0x7feb040b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 -- 172.21.15.81:0/1912794521 shutdown_connections 2024-09-10T20:40:16.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.516+0000 7feb03e00640 1 -- 172.21.15.81:0/1912794521 wait complete. 2024-09-10T20:40:16.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.517+0000 7feb03e00640 1 Processor -- start 2024-09-10T20:40:16.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.518+0000 7feb03e00640 1 -- start start 2024-09-10T20:40:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.518+0000 7feb03e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb040aea30 0x7feb0415e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.518+0000 7feb03e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb040cec80 0x7feb041541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.518+0000 7feb03e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb0415f8f0 0x7feb0415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.518+0000 7feb03e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb040af020 con 0x7feb0415f8f0 2024-09-10T20:40:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.518+0000 7feb03e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7feb040cc110 con 0x7feb040aea30 2024-09-10T20:40:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.518+0000 7feb03e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7feb0415edb0 con 0x7feb040cec80 2024-09-10T20:40:16.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb0415f8f0 0x7feb0415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb0415f8f0 0x7feb0415d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52354/0 (socket says 172.21.15.81:52354) 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 -- 172.21.15.81:0/3912475991 learned_addr learned my addr 172.21.15.81:0/3912475991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb02000640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb040cec80 0x7feb041541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb02a00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb040aea30 0x7feb0415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 -- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb040cec80 msgr2=0x7feb041541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb040cec80 0x7feb041541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 -- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb040aea30 msgr2=0x7feb0415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb040aea30 0x7feb0415e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.519+0000 7feb03400640 1 -- 172.21.15.81:0/3912475991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb041f76d0 con 0x7feb0415f8f0 2024-09-10T20:40:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.520+0000 7feb03400640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb0415f8f0 0x7feb0415d2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feafc00ea80 tx=0x7feafc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.520+0000 7feafaa00640 1 -- 172.21.15.81:0/3912475991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc004b20 con 0x7feb0415f8f0 2024-09-10T20:40:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.520+0000 7feafaa00640 1 -- 172.21.15.81:0/3912475991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feafc004ce0 con 0x7feb0415f8f0 2024-09-10T20:40:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.520+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb041f79b0 con 0x7feb0415f8f0 2024-09-10T20:40:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.520+0000 7feafaa00640 1 -- 172.21.15.81:0/3912475991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc005280 con 0x7feb0415f8f0 2024-09-10T20:40:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.520+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb041f7f70 con 0x7feb0415f8f0 2024-09-10T20:40:16.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.521+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb041f8170 con 0x7feb0415f8f0 2024-09-10T20:40:16.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.522+0000 7feafaa00640 1 -- 172.21.15.81:0/3912475991 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7feafc005420 con 0x7feb0415f8f0 2024-09-10T20:40:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.523+0000 7feafaa00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7feae4077fa0 0x7feae407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.524+0000 7feafaa00640 1 -- 172.21.15.81:0/3912475991 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feafc09abe0 con 0x7feb0415f8f0 2024-09-10T20:40:16.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.524+0000 7feb02a00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7feae4077fa0 0x7feae407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.525+0000 7feb02a00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7feae4077fa0 0x7feae407a460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feaf4033000 tx=0x7feaf4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.528+0000 7feafaa00640 1 -- 172.21.15.81:0/3912475991 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7feb041f8170 con 0x7feb0415f8f0 2024-09-10T20:40:16.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.711+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb04073610 con 0x7feb0415f8f0 2024-09-10T20:40:16.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.712+0000 7feafaa00640 1 -- 172.21.15.81:0/3912475991 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7feafc062d40 con 0x7feb0415f8f0 2024-09-10T20:40:16.716 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:16.716 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:16.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7feae4077fa0 msgr2=0x7feae407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7feae4077fa0 0x7feae407a460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feaf4033000 tx=0x7feaf4004730 comp rx=0 tx=0).stop 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb0415f8f0 msgr2=0x7feb0415d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb0415f8f0 0x7feb0415d2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feafc00ea80 tx=0x7feafc00ef40 comp rx=0 tx=0).stop 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 shutdown_connections 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7feae4077fa0 0x7feae407a460 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb0415f8f0 0x7feb0415d2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feb040cec80 0x7feb041541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 --2- 172.21.15.81:0/3912475991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feb040aea30 0x7feb0415e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.714+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 >> 172.21.15.81:0/3912475991 conn(0x7feb0406d500 msgr2=0x7feb040b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.715+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 shutdown_connections 2024-09-10T20:40:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.715+0000 7feb03e00640 1 -- 172.21.15.81:0/3912475991 wait complete. 2024-09-10T20:40:16.734 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T20:40:16.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 -- 172.21.15.81:0/2358160379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b00741e0 msgr2=0x7f51b015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 --2- 172.21.15.81:0/2358160379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b00741e0 0x7f51b015f4d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f51b0070770 tx=0x7f519c02a5f0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 -- 172.21.15.81:0/2358160379 shutdown_connections 2024-09-10T20:40:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 --2- 172.21.15.81:0/2358160379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b00741e0 0x7f51b015f4d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 --2- 172.21.15.81:0/2358160379 >> v2:172.21.15.143:3300/0 conn(0x7f51b015b680 0x7f51b015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 -- 172.21.15.81:0/2358160379 >> 172.21.15.81:0/2358160379 conn(0x7f51b006cb50 msgr2=0x7f51b006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 -- 172.21.15.81:0/2358160379 shutdown_connections 2024-09-10T20:40:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.890+0000 7f51b6400640 1 -- 172.21.15.81:0/2358160379 wait complete. 2024-09-10T20:40:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.892+0000 7f51b6400640 1 Processor -- start 2024-09-10T20:40:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.892+0000 7f51b6400640 1 -- start start 2024-09-10T20:40:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51b6400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51b00741e0 0x7f51b00b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51b6400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b015b680 0x7f51b014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51b6400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51b015c750 0x7f51b006f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51b6400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51b00b2860 con 0x7f51b015b680 2024-09-10T20:40:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51b6400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f51b015cf00 con 0x7f51b015c750 2024-09-10T20:40:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51b6400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f51b00b29e0 con 0x7f51b00741e0 2024-09-10T20:40:16.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51aea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b015b680 0x7f51b014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51aea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b015b680 0x7f51b014d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52366/0 (socket says 172.21.15.81:52366) 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51aea00640 1 -- 172.21.15.81:0/3495624143 learned_addr learned my addr 172.21.15.81:0/3495624143 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51af400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51b00741e0 0x7f51b00b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.893+0000 7f51afe00640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51b015c750 0x7f51b006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51aea00640 1 -- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51b00741e0 msgr2=0x7f51b00b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51aea00640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51b00741e0 0x7f51b00b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51aea00640 1 -- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51b015c750 msgr2=0x7f51b006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51aea00640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51b015c750 0x7f51b006f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51aea00640 1 -- 172.21.15.81:0/3495624143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b0154950 con 0x7f51b015b680 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51aea00640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b015b680 0x7f51b014d130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f519c009850 tx=0x7f519c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51a7400640 1 -- 172.21.15.81:0/3495624143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c03f070 con 0x7f51b015b680 2024-09-10T20:40:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51a7400640 1 -- 172.21.15.81:0/3495624143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f519c0047a0 con 0x7f51b015b680 2024-09-10T20:40:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51a7400640 1 -- 172.21.15.81:0/3495624143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c035030 con 0x7f51b015b680 2024-09-10T20:40:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b00b1010 con 0x7f51b015b680 2024-09-10T20:40:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.894+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b00b15d0 con 0x7f51b015b680 2024-09-10T20:40:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.895+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b015f4d0 con 0x7f51b015b680 2024-09-10T20:40:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.896+0000 7f51a7400640 1 -- 172.21.15.81:0/3495624143 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f519c004bb0 con 0x7f51b015b680 2024-09-10T20:40:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.897+0000 7f51a7400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5190077f70 0x7f519007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.897+0000 7f51a7400640 1 -- 172.21.15.81:0/3495624143 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f519c0bb1b0 con 0x7f51b015b680 2024-09-10T20:40:16.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.897+0000 7f51af400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5190077f70 0x7f519007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:16.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.898+0000 7f51af400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5190077f70 0x7f519007a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009b60 tx=0x7f51a0005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:16.901+0000 7f51a7400640 1 -- 172.21.15.81:0/3495624143 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f519c083960 con 0x7f51b015b680 2024-09-10T20:40:17.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.084+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51b015aa40 con 0x7f51b015b680 2024-09-10T20:40:17.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.085+0000 7f51a7400640 1 -- 172.21.15.81:0/3495624143 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7f519c083260 con 0x7f51b015b680 2024-09-10T20:40:17.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:17.090 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5190077f70 msgr2=0x7f519007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5190077f70 0x7f519007a430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009b60 tx=0x7f51a0005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b015b680 msgr2=0x7f51b014d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b015b680 0x7f51b014d130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f519c009850 tx=0x7f519c003820 comp rx=0 tx=0).stop 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 shutdown_connections 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5190077f70 0x7f519007a430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51b015c750 0x7f51b006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b015b680 0x7f51b014d130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 --2- 172.21.15.81:0/3495624143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51b00741e0 0x7f51b00b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 >> 172.21.15.81:0/3495624143 conn(0x7f51b006cb50 msgr2=0x7f51b0157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 shutdown_connections 2024-09-10T20:40:17.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.088+0000 7f51b6400640 1 -- 172.21.15.81:0/3495624143 wait complete. 2024-09-10T20:40:17.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T20:40:17.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T20:40:17.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T20:40:17.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T20:40:17.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T20:40:17.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T20:40:17.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T20:40:17.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T20:40:17.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:40:17.211 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:40:17.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.422+0000 7fbf5f200640 1 -- 172.21.15.81:0/3402234938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf600d24d0 msgr2=0x7fbf600d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.422+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3402234938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf600d24d0 0x7fbf600d01f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009830 tx=0x7fbf4c02a560 comp rx=0 tx=0).stop 2024-09-10T20:40:17.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.422+0000 7fbf5f200640 1 -- 172.21.15.81:0/3402234938 shutdown_connections 2024-09-10T20:40:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.423+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3402234938 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf600d24d0 0x7fbf600d01f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.423+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3402234938 >> v2:172.21.15.81:3300/0 conn(0x7fbf6015db30 0x7fbf600cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.423+0000 7fbf5f200640 1 -- 172.21.15.81:0/3402234938 >> 172.21.15.81:0/3402234938 conn(0x7fbf600d3a40 msgr2=0x7fbf600d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.425+0000 7f2bed200640 1 -- 172.21.15.81:0/422781417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 msgr2=0x7f2be816ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.425+0000 7f2bed200640 1 --2- 172.21.15.81:0/422781417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 0x7f2be816ab20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2be0005fd0 tx=0x7f2be002b9f0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.425+0000 7fbf5f200640 1 -- 172.21.15.81:0/3402234938 shutdown_connections 2024-09-10T20:40:17.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.425+0000 7fbf5f200640 1 -- 172.21.15.81:0/3402234938 wait complete. 2024-09-10T20:40:17.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.428+0000 7f2bed200640 1 -- 172.21.15.81:0/422781417 shutdown_connections 2024-09-10T20:40:17.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.428+0000 7f2bed200640 1 --2- 172.21.15.81:0/422781417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 0x7f2be816ab20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.428+0000 7f2bed200640 1 -- 172.21.15.81:0/422781417 >> 172.21.15.81:0/422781417 conn(0x7f2be806cb50 msgr2=0x7f2be806cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.428+0000 7f2bed200640 1 -- 172.21.15.81:0/422781417 shutdown_connections 2024-09-10T20:40:17.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.429+0000 7fbf5f200640 1 Processor -- start 2024-09-10T20:40:17.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.429+0000 7fbf5f200640 1 -- start start 2024-09-10T20:40:17.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.431+0000 7fbf5f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf600d4560 0x7fbf601503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.429+0000 7f2bed200640 1 -- 172.21.15.81:0/422781417 wait complete. 2024-09-10T20:40:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.432+0000 7f2bed200640 1 Processor -- start 2024-09-10T20:40:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.432+0000 7fbf5de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf600d4560 0x7fbf601503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.432+0000 7fbf5de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf600d4560 0x7fbf601503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52388/0 (socket says 172.21.15.81:52388) 2024-09-10T20:40:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.432+0000 7fbf5de00640 1 -- 172.21.15.81:0/3051582303 learned_addr learned my addr 172.21.15.81:0/3051582303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.432+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf6015db30 0x7fbf601535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.432+0000 7f2bed200640 1 -- start start 2024-09-10T20:40:17.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.432+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf6015e8c0 0x7fbf60160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.433+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf600d08b0 con 0x7fbf600d4560 2024-09-10T20:40:17.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.433+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbf600d0730 con 0x7fbf6015db30 2024-09-10T20:40:17.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.433+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbf600d0a30 con 0x7fbf6015e8c0 2024-09-10T20:40:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.433+0000 7fbf5e800640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf6015e8c0 0x7fbf60160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.434+0000 7fbf5d400640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf6015db30 0x7fbf601535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.434+0000 7fbf5de00640 1 -- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf6015e8c0 msgr2=0x7fbf60160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.434+0000 7fbf5de00640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbf6015e8c0 0x7fbf60160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.434+0000 7fbf5de00640 1 -- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf6015db30 msgr2=0x7fbf601535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.435+0000 7fbf5de00640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf6015db30 0x7fbf601535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.435+0000 7fbf5de00640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6014dba0 con 0x7fbf600d4560 2024-09-10T20:40:17.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.435+0000 7fbf5d400640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbf6015db30 0x7fbf601535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.436+0000 7fbf5de00640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf600d4560 0x7fbf601503c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000e790 tx=0x7fbf5000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.437+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000eea0 con 0x7fbf600d4560 2024-09-10T20:40:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.438+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6014de80 con 0x7fbf600d4560 2024-09-10T20:40:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.438+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6014e440 con 0x7fbf600d4560 2024-09-10T20:40:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.439+0000 7f2bed200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2be806e8e0 0x7f2be8166980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.439+0000 7f2bed200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 0x7f2be820bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.439+0000 7f2bed200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be816b060 0x7f2be81fa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.439+0000 7f2bed200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2be80cfe90 con 0x7f2be816b060 2024-09-10T20:40:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.440+0000 7f2bed200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2be80cfd10 con 0x7f2be80aed80 2024-09-10T20:40:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.440+0000 7f2bed200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2be806ed50 con 0x7f2be806e8e0 2024-09-10T20:40:17.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.440+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf60150900 con 0x7fbf600d4560 2024-09-10T20:40:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.441+0000 7f2be7400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2be806e8e0 0x7f2be8166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.441+0000 7f2be7400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2be806e8e0 0x7f2be8166980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:55724/0 (socket says 172.21.15.81:55724) 2024-09-10T20:40:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.441+0000 7f2be7400640 1 -- 172.21.15.81:0/4268099080 learned_addr learned my addr 172.21.15.81:0/4268099080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.441+0000 7f2be6a00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 0x7f2be820bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.441+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf5000cdb0 con 0x7fbf600d4560 2024-09-10T20:40:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.441+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000eea0 con 0x7fbf600d4560 2024-09-10T20:40:17.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.442+0000 7f2be7e00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be816b060 0x7f2be81fa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.444+0000 7f2be7400640 1 -- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 msgr2=0x7f2be820bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.445+0000 7f2be7400640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 0x7f2be820bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.445+0000 7f2be7400640 1 -- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be816b060 msgr2=0x7f2be81fa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.445+0000 7f2be7400640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be816b060 0x7f2be81fa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.445+0000 7f2be7400640 1 -- 172.21.15.81:0/4268099080 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be8212fd0 con 0x7f2be806e8e0 2024-09-10T20:40:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.445+0000 7f2be6a00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2be80aed80 0x7f2be820bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.445+0000 7f2be7e00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2be816b060 0x7f2be81fa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7f2be7400640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2be806e8e0 0x7f2be8166980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006010 tx=0x7f2be0009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7fda00a00640 1 -- 172.21.15.81:0/565930396 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f00047a0 con 0x7fda040cfcb0 2024-09-10T20:40:17.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbf50010430 con 0x7fbf600d4560 2024-09-10T20:40:17.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0046070 con 0x7f2be806e8e0 2024-09-10T20:40:17.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2be0004050 con 0x7f2be806e8e0 2024-09-10T20:40:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be00044a0 con 0x7f2be806e8e0 2024-09-10T20:40:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be8212cf0 con 0x7f2be806e8e0 2024-09-10T20:40:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.447+0000 7fda03200640 1 -- 172.21.15.81:0/565930396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cfcb0 msgr2=0x7fda04142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.447+0000 7fda03200640 1 --2- 172.21.15.81:0/565930396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cfcb0 0x7fda04142b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0005fd0 tx=0x7fd9f002a4a0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.446+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be8166460 con 0x7f2be806e8e0 2024-09-10T20:40:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.448+0000 7fda03200640 1 -- 172.21.15.81:0/565930396 shutdown_connections 2024-09-10T20:40:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.448+0000 7fda03200640 1 --2- 172.21.15.81:0/565930396 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda0406f530 0x7fda04143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.448+0000 7fda03200640 1 --2- 172.21.15.81:0/565930396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cfcb0 0x7fda04142b50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.448+0000 7fda03200640 1 -- 172.21.15.81:0/565930396 >> 172.21.15.81:0/565930396 conn(0x7fda0406cb50 msgr2=0x7fda0406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.448+0000 7fbf56000640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbf400781a0 0x7fbf4007a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.449+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbf5009b1d0 con 0x7fbf600d4560 2024-09-10T20:40:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.449+0000 7fbf56000640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7fbf40081910 0x7fbf40083d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.449+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf50001d30 con 0x7fbf40081910 2024-09-10T20:40:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.449+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbf5009b5c0 con 0x7fbf600d4560 2024-09-10T20:40:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.449+0000 7f00b9600640 1 -- 172.21.15.81:0/3611399074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0098003c40 msgr2=0x7f0098006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.449+0000 7f00b9600640 1 --2- 172.21.15.81:0/3611399074 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0098003c40 0x7f0098006070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00a4002230 tx=0x7f0098003810 comp rx=0 tx=0).stop 2024-09-10T20:40:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.449+0000 7f00b8c00640 1 -- 172.21.15.81:0/3611399074 reap_dead start 2024-09-10T20:40:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.450+0000 7fbf5d400640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbf400781a0 0x7fbf4007a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.450+0000 7fbf5e800640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7fbf40081910 0x7fbf40083d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.451+0000 7fda03200640 1 -- 172.21.15.81:0/565930396 shutdown_connections 2024-09-10T20:40:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.450+0000 7f00b9600640 1 -- 172.21.15.81:0/3611399074 shutdown_connections 2024-09-10T20:40:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.450+0000 7f00b9600640 1 -- 172.21.15.81:0/3611399074 >> 172.21.15.81:0/3611399074 conn(0x7f00b406cb50 msgr2=0x7f00b406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.450+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bc0001030 con 0x7f2be806e8e0 2024-09-10T20:40:17.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.450+0000 7f00b9600640 1 -- 172.21.15.81:0/3611399074 shutdown_connections 2024-09-10T20:40:17.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.450+0000 7f00b9600640 1 -- 172.21.15.81:0/3611399074 wait complete. 2024-09-10T20:40:17.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.451+0000 7fda03200640 1 -- 172.21.15.81:0/565930396 wait complete. 2024-09-10T20:40:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.453+0000 7fbf5d400640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbf400781a0 0x7fbf4007a660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c034000 tx=0x7fbf4c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.453+0000 7f00b9600640 1 Processor -- start 2024-09-10T20:40:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.453+0000 7fbf5e800640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7fbf40081910 0x7fbf40083d50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.453+0000 7f00b9600640 1 -- start start 2024-09-10T20:40:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.454+0000 7faef3e00640 1 -- 172.21.15.81:0/3508063655 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec02b870 con 0x7faedc003a50 2024-09-10T20:40:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.454+0000 7fda03200640 1 Processor -- start 2024-09-10T20:40:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.454+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2be0040030 con 0x7f2be806e8e0 2024-09-10T20:40:17.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.454+0000 7f7499400640 1 -- 172.21.15.81:0/3303217671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7494161810 msgr2=0x7f7494161bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.454+0000 7f7499400640 1 --2- 172.21.15.81:0/3303217671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7494161810 0x7f7494161bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7484009830 tx=0x7f748402a480 comp rx=0 tx=0).stop 2024-09-10T20:40:17.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.455+0000 7fda03200640 1 -- start start 2024-09-10T20:40:17.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.454+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== osd.4 v2:172.21.15.143:6826/4019230190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf50001d30 con 0x7fbf40081910 2024-09-10T20:40:17.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.455+0000 7f00b9600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0098003c40 0x7f00b413f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.455+0000 7f00b9600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00b41fc930 0x7f00b415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f00b9600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00b415b530 0x7f00b4141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f00b9600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00b406fb80 con 0x7f0098003c40 2024-09-10T20:40:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f00b8c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00b415b530 0x7f00b4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f00b8c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00b415b530 0x7f00b4141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:55774/0 (socket says 172.21.15.81:55774) 2024-09-10T20:40:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f00b8c00640 1 -- 172.21.15.81:0/1182264511 learned_addr learned my addr 172.21.15.81:0/1182264511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f00b406fa00 con 0x7f00b41fc930 2024-09-10T20:40:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f2bdf400640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bc8077fc0 0x7f2bc807a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2be00badc0 con 0x7f2be806e8e0 2024-09-10T20:40:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.456+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f00b406d640 con 0x7f00b415b530 2024-09-10T20:40:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7fda03200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda0406f530 0x7fda04201bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7fda03200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cf8d0 0x7fda040ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7fda03200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda040cfcb0 0x7fda041efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7fda03200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda040729d0 con 0x7fda040cfcb0 2024-09-10T20:40:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7fda03200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fda041439e0 con 0x7fda040cf8d0 2024-09-10T20:40:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7fda03200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fda04072b50 con 0x7fda0406f530 2024-09-10T20:40:17.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f7499400640 1 -- 172.21.15.81:0/3303217671 shutdown_connections 2024-09-10T20:40:17.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f7499400640 1 --2- 172.21.15.81:0/3303217671 >> v2:172.21.15.81:3300/0 conn(0x7f74940d4560 0x7f7494162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f7499400640 1 --2- 172.21.15.81:0/3303217671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7494161810 0x7f7494161bf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f7499400640 1 -- 172.21.15.81:0/3303217671 >> 172.21.15.81:0/3303217671 conn(0x7f74940d3a40 msgr2=0x7f74940d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7fda01e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda0406f530 0x7fda04201bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7fda01e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda0406f530 0x7fda04201bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:55780/0 (socket says 172.21.15.81:55780) 2024-09-10T20:40:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7faefc400640 1 -- 172.21.15.81:0/3508063655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faedc003a50 msgr2=0x7faedc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7faefc400640 1 --2- 172.21.15.81:0/3508063655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faedc003a50 0x7faedc003e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faeec002230 tx=0x7faedc005830 comp rx=0 tx=0).stop 2024-09-10T20:40:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7faefc400640 1 -- 172.21.15.81:0/3508063655 shutdown_connections 2024-09-10T20:40:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7faefc400640 1 --2- 172.21.15.81:0/3508063655 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faedc003a50 0x7faedc003e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7faefc400640 1 -- 172.21.15.81:0/3508063655 >> 172.21.15.81:0/3508063655 conn(0x7faef406cb50 msgr2=0x7faef406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f7499400640 1 -- 172.21.15.81:0/3303217671 shutdown_connections 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b3400640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00b41fc930 0x7f00b415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b3e00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0098003c40 0x7f00b413f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b8c00640 1 -- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00b41fc930 msgr2=0x7f00b415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b8c00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00b41fc930 0x7f00b415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b8c00640 1 -- 172.21.15.81:0/1182264511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0098003c40 msgr2=0x7f00b413f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b8c00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0098003c40 0x7f00b413f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b8c00640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b4142640 con 0x7f00b415b530 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f00b3e00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0098003c40 0x7f00b413f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7f00b3400640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00b41fc930 0x7f00b415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7fda01400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cf8d0 0x7fda040ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7fda01400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cf8d0 0x7fda040ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46628/0 (socket says 172.21.15.81:46628) 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7fda01400640 1 -- 172.21.15.81:0/1499656765 learned_addr learned my addr 172.21.15.81:0/1499656765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7fda02800640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda040cfcb0 0x7fda041efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7fda01400640 1 -- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda0406f530 msgr2=0x7fda04201bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7fda01400640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda0406f530 0x7fda04201bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7fda01400640 1 -- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda040cfcb0 msgr2=0x7fda041efd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7fda01400640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda040cfcb0 0x7fda041efd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7fda01400640 1 -- 172.21.15.81:0/1499656765 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda041f1640 con 0x7fda040cf8d0 2024-09-10T20:40:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7fda01e00640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda0406f530 0x7fda04201bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7fda02800640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda040cfcb0 0x7fda041efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7fda01400640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cf8d0 0x7fda040ad230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0034040 tx=0x7fd9f00038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7faefc400640 1 -- 172.21.15.81:0/3508063655 shutdown_connections 2024-09-10T20:40:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7f2be6a00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bc8077fc0 0x7f2bc807a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7f2bdf400640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f2bc8081740 0x7f2bc8083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2be004de50 con 0x7f2bc8081740 2024-09-10T20:40:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.459+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2be00bd510 con 0x7f2be806e8e0 2024-09-10T20:40:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.457+0000 7f7499400640 1 -- 172.21.15.81:0/3303217671 wait complete. 2024-09-10T20:40:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7f00b8c00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00b415b530 0x7f00b4141980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00e8f0 tx=0x7f00ac00edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.460+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f003e030 con 0x7fda040cf8d0 2024-09-10T20:40:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.458+0000 7faefc400640 1 -- 172.21.15.81:0/3508063655 wait complete. 2024-09-10T20:40:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.460+0000 7f2be7e00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f2bc8081740 0x7f2bc8083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7f2be6a00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bc8077fc0 0x7f2bc807a480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007a50 tx=0x7f2bd8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7f7499400640 1 Processor -- start 2024-09-10T20:40:17.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7faefc400640 1 Processor -- start 2024-09-10T20:40:17.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7faefc400640 1 -- start start 2024-09-10T20:40:17.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac009e20 con 0x7f00b415b530 2024-09-10T20:40:17.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00ac00cb30 con 0x7f00b415b530 2024-09-10T20:40:17.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9f0003dd0 con 0x7fda040cf8d0 2024-09-10T20:40:17.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0035040 con 0x7fda040cf8d0 2024-09-10T20:40:17.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.462+0000 7fda03200640 1 -- 172.21.15.81:0/1499656765 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda041f1920 con 0x7fda040cf8d0 2024-09-10T20:40:17.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7f2be7e00640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f2bc8081740 0x7f2bc8083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac004020 con 0x7f00b415b530 2024-09-10T20:40:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7fda03200640 1 -- 172.21.15.81:0/1499656765 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda041f1ee0 con 0x7fda040cf8d0 2024-09-10T20:40:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b41fbe50 con 0x7f00b415b530 2024-09-10T20:40:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41fc410 con 0x7f00b415b530 2024-09-10T20:40:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.461+0000 7f7499400640 1 -- start start 2024-09-10T20:40:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f7499400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74940d4560 0x7f74941fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f7499400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749415c460 0x7f7494153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f7499400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7494161810 0x7f7494153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f7499400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74940b0ec0 con 0x7f749415c460 2024-09-10T20:40:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f7499400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f74940b0d40 con 0x7f74940d4560 2024-09-10T20:40:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7f7499400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f74940b1040 con 0x7f7494161810 2024-09-10T20:40:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.462+0000 7faefc400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef41516e0 0x7faef4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7faefc400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef415a1d0 0x7faef40ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7faefc400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef40adde0 0x7faef406e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7faefc400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faef415f650 con 0x7faef40adde0 2024-09-10T20:40:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7faefc400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faef415f4d0 con 0x7faef415a1d0 2024-09-10T20:40:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.463+0000 7faefc400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faef415f7d0 con 0x7faef41516e0 2024-09-10T20:40:17.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.464+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== osd.3 v2:172.21.15.81:6808/906295494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2be004de50 con 0x7f2bc8081740 2024-09-10T20:40:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.464+0000 7f7493400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749415c460 0x7f7494153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.464+0000 7f7498a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7494161810 0x7f7494153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.464+0000 7f7493e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74940d4560 0x7f74941fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.464+0000 7f7493e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74940d4560 0x7f74941fb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46642/0 (socket says 172.21.15.81:46642) 2024-09-10T20:40:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.464+0000 7f7493e00640 1 -- 172.21.15.81:0/43441548 learned_addr learned my addr 172.21.15.81:0/43441548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.464+0000 7faef9a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef41516e0 0x7faef4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7faef9a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef41516e0 0x7faef4159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:55816/0 (socket says 172.21.15.81:55816) 2024-09-10T20:40:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7faef9a00640 1 -- 172.21.15.81:0/319714232 learned_addr learned my addr 172.21.15.81:0/319714232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00b415abb0 con 0x7f00b415b530 2024-09-10T20:40:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7faef9a00640 1 -- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef415a1d0 msgr2=0x7faef40ad8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:40:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7f7493e00640 1 -- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7494161810 msgr2=0x7f7494153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7f7493e00640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7494161810 0x7f7494153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7f7493e00640 1 -- 172.21.15.81:0/43441548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749415c460 msgr2=0x7f7494153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7faef9a00640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef415a1d0 0x7faef40ad8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7faef9a00640 1 -- 172.21.15.81:0/319714232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef40adde0 msgr2=0x7faef406e470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T20:40:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7faef9a00640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faef40adde0 0x7faef406e470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7f7493e00640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749415c460 0x7f7494153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7faef9a00640 1 -- 172.21.15.81:0/319714232 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef415a6e0 con 0x7faef41516e0 2024-09-10T20:40:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7f7493e00640 1 -- 172.21.15.81:0/43441548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749414d6b0 con 0x7f74940d4560 2024-09-10T20:40:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.465+0000 7f7493400640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f749415c460 0x7f7494153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.466+0000 7f7493e00640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74940d4560 0x7f74941fb3e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7484000c00 tx=0x7f7484033ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.466+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484031d60 con 0x7f74940d4560 2024-09-10T20:40:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.466+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74840330d0 con 0x7f74940d4560 2024-09-10T20:40:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.466+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74840334e0 con 0x7f74940d4560 2024-09-10T20:40:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.467+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749414d990 con 0x7f74940d4560 2024-09-10T20:40:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.467+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74942014b0 con 0x7f74940d4560 2024-09-10T20:40:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.467+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f00ac0041c0 con 0x7f00b415b530 2024-09-10T20:40:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd9f0004a00 con 0x7fda040cf8d0 2024-09-10T20:40:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda040cf440 con 0x7fda040cf8d0 2024-09-10T20:40:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7faef9a00640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef41516e0 0x7faef4159c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faeec002230 tx=0x7faeec004c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.467+0000 7fca1e400640 1 -- 172.21.15.81:0/3084920428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9fc004d40 msgr2=0x7fc9fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.467+0000 7fca1e400640 1 --2- 172.21.15.81:0/3084920428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc9fc004d40 0x7fc9fc0051c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca10009e20 tx=0x7fc9fc005830 comp rx=0 tx=0).stop 2024-09-10T20:40:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.467+0000 7fca17e00640 1 -- 172.21.15.81:0/3084920428 reap_dead start 2024-09-10T20:40:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.469+0000 7fca1e400640 1 -- 172.21.15.81:0/3084920428 shutdown_connections 2024-09-10T20:40:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.469+0000 7fca1e400640 1 -- 172.21.15.81:0/3084920428 >> 172.21.15.81:0/3084920428 conn(0x7fca1806cb50 msgr2=0x7fca1806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.469+0000 7fca1e400640 1 -- 172.21.15.81:0/3084920428 shutdown_connections 2024-09-10T20:40:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.469+0000 7fca1e400640 1 -- 172.21.15.81:0/3084920428 wait complete. 2024-09-10T20:40:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec004e10 con 0x7faef41516e0 2024-09-10T20:40:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeec02ba80 con 0x7faef41516e0 2024-09-10T20:40:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec006030 con 0x7faef41516e0 2024-09-10T20:40:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7faefc400640 1 -- 172.21.15.81:0/319714232 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef41f8c70 con 0x7faef41516e0 2024-09-10T20:40:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.469+0000 7faefc400640 1 -- 172.21.15.81:0/319714232 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faef41f9230 con 0x7faef41516e0 2024-09-10T20:40:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.468+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7468001030 con 0x7f74940d4560 2024-09-10T20:40:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.469+0000 7f00abe00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0094078040 0x7f009407a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.470+0000 7f00b3e00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0094078040 0x7f009407a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.469+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f00ac099da0 con 0x7f00b415b530 2024-09-10T20:40:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.470+0000 7f00abe00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f00940817c0 0x7f0094083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.470+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00940842d0 con 0x7f00940817c0 2024-09-10T20:40:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.470+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00ac09c400 con 0x7f00b415b530 2024-09-10T20:40:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.471+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7484061bb0 con 0x7f74940d4560 2024-09-10T20:40:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.471+0000 7f00b3400640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f00940817c0 0x7f0094083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.472+0000 7fca1e400640 1 Processor -- start 2024-09-10T20:40:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.472+0000 7f00b3400640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f00940817c0 0x7f0094083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7fca1e400640 1 -- start start 2024-09-10T20:40:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7f00b3e00640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0094078040 0x7f009407a500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00a4006fd0 tx=0x7f00a4001d70 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00940842d0 con 0x7f00940817c0 2024-09-10T20:40:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7f748be00640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7470077fc0 0x7f747007a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f74840bb5d0 con 0x7f74940d4560 2024-09-10T20:40:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7f748be00640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f7470081740 0x7f7470083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74840337c0 con 0x7f7470081740 2024-09-10T20:40:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.473+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74840bbab0 con 0x7f74940d4560 2024-09-10T20:40:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7f7498a00640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f7470081740 0x7f7470083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7f7493400640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7470077fc0 0x7f747007a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7fca1e400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9fc004d40 0x7fca181e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7fca1e400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca180aa650 0x7fca181ede30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7fca1e400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca181ee370 0x7fca181f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7fca1e400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca180af190 con 0x7fc9fc004d40 2024-09-10T20:40:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7fca1e400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fca180af010 con 0x7fca181ee370 2024-09-10T20:40:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.474+0000 7fca1e400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fca18072450 con 0x7fca180aa650 2024-09-10T20:40:17.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7fca17400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9fc004d40 0x7fca181e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7fd9fa000640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd9e4077f70 0x7fd9e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.471+0000 7faefc400640 1 -- 172.21.15.81:0/319714232 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faef40cf780 con 0x7faef41516e0 2024-09-10T20:40:17.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7fca17400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9fc004d40 0x7fca181e4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52482/0 (socket says 172.21.15.81:52482) 2024-09-10T20:40:17.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7fca17400640 1 -- 172.21.15.81:0/3078995827 learned_addr learned my addr 172.21.15.81:0/3078995827 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7fca16a00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca180aa650 0x7fca181ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7fca17e00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca181ee370 0x7fca181f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7f7493400640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7470077fc0 0x7f747007a480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f747c009fa0 tx=0x7f747c009570 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.475+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faeec046060 con 0x7faef41516e0 2024-09-10T20:40:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.476+0000 7fca17400640 1 -- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca180aa650 msgr2=0x7fca181ede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.476+0000 7fca17400640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca180aa650 0x7fca181ede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.476+0000 7fca17400640 1 -- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca181ee370 msgr2=0x7fca181f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.476+0000 7fca17400640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca181ee370 0x7fca181f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.476+0000 7fca17400640 1 -- 172.21.15.81:0/3078995827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca180a98d0 con 0x7fc9fc004d40 2024-09-10T20:40:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.477+0000 7fca17e00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca181ee370 0x7fca181f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.477+0000 7fca16a00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca180aa650 0x7fca181ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.477+0000 7fca17400640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9fc004d40 0x7fca181e4a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca0800e700 tx=0x7fca0800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.477+0000 7fda01e00640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd9e4077f70 0x7fd9e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08015020 con 0x7fc9fc004d40 2024-09-10T20:40:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7faef1600640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faed4078070 0x7faed407a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca0800ee70 con 0x7fc9fc004d40 2024-09-10T20:40:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0800ca80 con 0x7fc9fc004d40 2024-09-10T20:40:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd9f00b8c90 con 0x7fda040cf8d0 2024-09-10T20:40:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7f7498a00640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f7470081740 0x7f7470083b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faeec0b99a0 con 0x7faef41516e0 2024-09-10T20:40:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7fca1e400640 1 -- 172.21.15.81:0/3078995827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca181f9720 con 0x7fc9fc004d40 2024-09-10T20:40:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.478+0000 7fca1e400640 1 -- 172.21.15.81:0/3078995827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca180a9e50 con 0x7fc9fc004d40 2024-09-10T20:40:17.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.479+0000 7faef9000640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faed4078070 0x7faed407a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.479+0000 7fda01e00640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd9e4077f70 0x7fd9e407a430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4003eb0 tx=0x7fd9f4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.480+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74840337c0 con 0x7f7470081740 2024-09-10T20:40:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.480+0000 7fd9fa000640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd9e4082380 0x7fd9e4084820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.480+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e4084ef0 con 0x7fd9e4082380 2024-09-10T20:40:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.480+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd9f007f240 con 0x7fda040cf8d0 2024-09-10T20:40:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.480+0000 7faef9000640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faed4078070 0x7faed407a530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faef40aec70 tx=0x7faee0005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.481+0000 7faef1600640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7faed40817f0 0x7faed4083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.481+0000 7fda02800640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd9e4082380 0x7fd9e4084820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.481+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faeec03cec0 con 0x7faed40817f0 2024-09-10T20:40:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.481+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faeec0be2a0 con 0x7faef41516e0 2024-09-10T20:40:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.481+0000 7faefa400640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7faed40817f0 0x7faed4083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.482+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca180aa230 con 0x7fc9fc004d40 2024-09-10T20:40:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.482+0000 7fda02800640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd9e4082380 0x7fd9e4084820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.482+0000 7faefa400640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7faed40817f0 0x7faed4083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.483+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== osd.1 v2:172.21.15.81:6810/310566059 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9e4084ef0 con 0x7fd9e4082380 2024-09-10T20:40:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.484+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fca0800cc20 con 0x7fc9fc004d40 2024-09-10T20:40:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.484+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== osd.2 v2:172.21.15.81:6809/2010302829 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faeec03cec0 con 0x7faed40817f0 2024-09-10T20:40:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.486+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf600d1610 con 0x7fbf40081910 2024-09-10T20:40:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.487+0000 7fbf56000640 1 -- 172.21.15.81:0/3051582303 <== osd.4 v2:172.21.15.143:6826/4019230190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbf600d1610 con 0x7fbf40081910 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.485+0000 7fca0f400640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9f8078040 0x7fc9f807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.485+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fca0809a6c0 con 0x7fc9fc004d40 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.486+0000 7fca0f400640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7fc9f80817c0 0x7fc9f8083c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.486+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca08013ec0 con 0x7fc9f80817c0 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.486+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fca080a1050 con 0x7fc9fc004d40 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.486+0000 7fca17e00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7fc9f80817c0 0x7fc9f8083c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.487+0000 7fca16a00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9f8078040 0x7fc9f807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.487+0000 7fca17e00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7fc9f80817c0 0x7fc9f8083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7fbf40081910 msgr2=0x7fbf40083d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7fbf40081910 0x7fbf40083d50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbf400781a0 msgr2=0x7fbf4007a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbf400781a0 0x7fbf4007a660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c034000 tx=0x7fbf4c004730 comp rx=0 tx=0).stop 2024-09-10T20:40:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fca16a00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9f8078040 0x7fc9f807a500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca1814d5d0 tx=0x7fca0400f040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf600d4560 msgr2=0x7fbf601503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fbf5f200640 1 --2- 172.21.15.81:0/3051582303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf600d4560 0x7fbf601503c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000e790 tx=0x7fbf5000ec50 comp rx=0 tx=0).stop 2024-09-10T20:40:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.488+0000 7fbf5e800640 1 -- 172.21.15.81:0/3051582303 reap_dead start 2024-09-10T20:40:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.490+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca08013ec0 con 0x7fc9f80817c0 2024-09-10T20:40:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.489+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 shutdown_connections 2024-09-10T20:40:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.489+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 >> 172.21.15.81:0/3051582303 conn(0x7fbf600d3a40 msgr2=0x7fbf600b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.490+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 shutdown_connections 2024-09-10T20:40:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.490+0000 7fbf5f200640 1 -- 172.21.15.81:0/3051582303 wait complete. 2024-09-10T20:40:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.496+0000 7fa891e00640 1 -- 172.21.15.81:0/3273341143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c161d30 msgr2=0x7fa88c0b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.496+0000 7fa891e00640 1 --2- 172.21.15.81:0/3273341143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c161d30 0x7fa88c0b28b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa874005fd0 tx=0x7fa87402a4b0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.496+0000 7fa891e00640 1 -- 172.21.15.81:0/3273341143 shutdown_connections 2024-09-10T20:40:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.496+0000 7fa891e00640 1 --2- 172.21.15.81:0/3273341143 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa88c162560 0x7fa88c0d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.496+0000 7fa891e00640 1 --2- 172.21.15.81:0/3273341143 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c161d30 0x7fa88c0b28b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.496+0000 7fa891e00640 1 -- 172.21.15.81:0/3273341143 >> 172.21.15.81:0/3273341143 conn(0x7fa88c0d3c50 msgr2=0x7fa88c0d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.497+0000 7fa891e00640 1 -- 172.21.15.81:0/3273341143 shutdown_connections 2024-09-10T20:40:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.497+0000 7fa891e00640 1 -- 172.21.15.81:0/3273341143 wait complete. 2024-09-10T20:40:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.498+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bc0002dd0 con 0x7f2bc8081740 2024-09-10T20:40:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.500+0000 7fa891e00640 1 Processor -- start 2024-09-10T20:40:17.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.500+0000 7fa891e00640 1 -- start start 2024-09-10T20:40:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.502+0000 7fa891e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa88c161d30 0x7fa88c0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.503+0000 7fa891e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c162110 0x7fa88c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.503+0000 7fa891e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa88c162560 0x7fa88c0b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.503+0000 7fa88a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c162110 0x7fa88c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.503+0000 7fa88a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c162110 0x7fa88c156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46670/0 (socket says 172.21.15.81:46670) 2024-09-10T20:40:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.504+0000 7f2bdf400640 1 -- 172.21.15.81:0/4268099080 <== osd.3 v2:172.21.15.81:6808/906295494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2bc0002dd0 con 0x7f2bc8081740 2024-09-10T20:40:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.504+0000 7fa88a000640 1 -- 172.21.15.81:0/2717427198 learned_addr learned my addr 172.21.15.81:0/2717427198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.504+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c0d0370 con 0x7fa88c162560 2024-09-10T20:40:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.504+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c0d29b0 con 0x7fa88c162110 2024-09-10T20:40:17.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.504+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa88c0d04f0 con 0x7fa88c161d30 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.505+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f2bc8081740 msgr2=0x7f2bc8083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.505+0000 7f2bed200640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f2bc8081740 0x7f2bc8083b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bc8077fc0 msgr2=0x7f2bc807a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bc8077fc0 0x7f2bc807a480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8007a50 tx=0x7f2bd8009040 comp rx=0 tx=0).stop 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2be806e8e0 msgr2=0x7f2be8166980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 --2- 172.21.15.81:0/4268099080 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2be806e8e0 0x7f2be8166980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006010 tx=0x7f2be0009300 comp rx=0 tx=0).stop 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2be7e00640 1 -- 172.21.15.81:0/4268099080 reap_dead start 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 shutdown_connections 2024-09-10T20:40:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 >> 172.21.15.81:0/4268099080 conn(0x7f2be806cb50 msgr2=0x7f2be80af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.505+0000 7fa88b400640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa88c162560 0x7fa88c0b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7fa88b400640 1 -- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa88c161d30 msgr2=0x7fa88c0ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7fa88b400640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa88c161d30 0x7fa88c0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7fa88b400640 1 -- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c162110 msgr2=0x7fa88c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7fa88b400640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa88c162110 0x7fa88c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7fa88b400640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88c1f8e30 con 0x7fa88c162560 2024-09-10T20:40:17.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 shutdown_connections 2024-09-10T20:40:17.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.506+0000 7f2bed200640 1 -- 172.21.15.81:0/4268099080 wait complete. 2024-09-10T20:40:17.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.507+0000 7fa88b400640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa88c162560 0x7fa88c0b8df0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c740 tx=0x7fa87c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.507+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c004460 con 0x7fa88c162560 2024-09-10T20:40:17.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.507+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa87c00ce50 con 0x7fa88c162560 2024-09-10T20:40:17.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.507+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0079e0 con 0x7fa88c162560 2024-09-10T20:40:17.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.508+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00b40cf660 con 0x7f00940817c0 2024-09-10T20:40:17.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.508+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88c1f90f0 con 0x7fa88c162560 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.508+0000 7f00abe00640 1 -- 172.21.15.81:0/1182264511 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00b40cf660 con 0x7f00940817c0 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.509+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f00940817c0 msgr2=0x7f0094083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.509+0000 7f00b9600640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f00940817c0 0x7f0094083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.509+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0094078040 msgr2=0x7f009407a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.509+0000 7f00b9600640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0094078040 0x7f009407a500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00a4006fd0 tx=0x7f00a4001d70 comp rx=0 tx=0).stop 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.509+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00b415b530 msgr2=0x7f00b4141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.509+0000 7f00b9600640 1 --2- 172.21.15.81:0/1182264511 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f00b415b530 0x7f00b4141980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00e8f0 tx=0x7f00ac00edb0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.510+0000 7f00b8c00640 1 -- 172.21.15.81:0/1182264511 reap_dead start 2024-09-10T20:40:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.510+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 shutdown_connections 2024-09-10T20:40:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.510+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 >> 172.21.15.81:0/1182264511 conn(0x7f00b406cb50 msgr2=0x7f00b40afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.510+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 shutdown_connections 2024-09-10T20:40:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.508+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa88c1f96b0 con 0x7fa88c162560 2024-09-10T20:40:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.510+0000 7f00b9600640 1 -- 172.21.15.81:0/1182264511 wait complete. 2024-09-10T20:40:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.514+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa87c007bc0 con 0x7fa88c162560 2024-09-10T20:40:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.515+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7468002dd0 con 0x7f7470081740 2024-09-10T20:40:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.515+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa88c0b28b0 con 0x7fa88c162560 2024-09-10T20:40:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.516+0000 7f748be00640 1 -- 172.21.15.81:0/43441548 <== osd.6 v2:172.21.15.143:6818/294800477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7468002dd0 con 0x7f7470081740 2024-09-10T20:40:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.516+0000 7fa883400640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa868077f70 0x7fa86807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.516+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa87c09a700 con 0x7fa88c162560 2024-09-10T20:40:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.516+0000 7fa883400640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fa868081660 0x7fa868083aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.516+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa87c005640 con 0x7fa868081660 2024-09-10T20:40:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.516+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa87c0a1050 con 0x7fa88c162560 2024-09-10T20:40:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.517+0000 7fa88a000640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fa868081660 0x7fa868083aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.517+0000 7fa88aa00640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa868077f70 0x7fa86807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.517+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f7470081740 msgr2=0x7f7470083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.517+0000 7f7499400640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f7470081740 0x7f7470083b80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.518+0000 7fa88a000640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fa868081660 0x7fa868083aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa87c005640 con 0x7fa868081660 2024-09-10T20:40:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7470077fc0 msgr2=0x7f747007a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7f7499400640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7470077fc0 0x7f747007a480 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f747c009fa0 tx=0x7f747c009570 comp rx=0 tx=0).stop 2024-09-10T20:40:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74940d4560 msgr2=0x7f74941fb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7f7499400640 1 --2- 172.21.15.81:0/43441548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74940d4560 0x7f74941fb3e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7484000c00 tx=0x7f7484033ce0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7f7498a00640 1 -- 172.21.15.81:0/43441548 reap_dead start 2024-09-10T20:40:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 shutdown_connections 2024-09-10T20:40:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.519+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 >> 172.21.15.81:0/43441548 conn(0x7f74940d3a40 msgr2=0x7f7494154350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.524 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-10T20:40:17.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T20:40:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.521+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 shutdown_connections 2024-09-10T20:40:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.521+0000 7f7499400640 1 -- 172.21.15.81:0/43441548 wait complete. 2024-09-10T20:40:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.522+0000 7fa88aa00640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa868077f70 0x7fa86807a430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa874033000 tx=0x7fa8740046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.522+0000 7faefc400640 1 -- 172.21.15.81:0/319714232 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faef40cc490 con 0x7faed40817f0 2024-09-10T20:40:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.523+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca180ae8c0 con 0x7fc9f80817c0 2024-09-10T20:40:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.523+0000 7faef1600640 1 -- 172.21.15.81:0/319714232 <== osd.2 v2:172.21.15.81:6809/2010302829 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faef40cc490 con 0x7faed40817f0 2024-09-10T20:40:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.523+0000 7fca0f400640 1 -- 172.21.15.81:0/3078995827 <== osd.0 v2:172.21.15.81:6800/4080460515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca180ae8c0 con 0x7fc9f80817c0 2024-09-10T20:40:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.524+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7fc9f80817c0 msgr2=0x7fc9f8083c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.525+0000 7fca0cc00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7fc9f80817c0 0x7fc9f8083c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.525+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9f8078040 msgr2=0x7fc9f807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.525+0000 7fca0cc00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9f8078040 0x7fc9f807a500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca1814d5d0 tx=0x7fca0400f040 comp rx=0 tx=0).stop 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.525+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9fc004d40 msgr2=0x7fca181e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.526+0000 7fca0cc00640 1 --2- 172.21.15.81:0/3078995827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9fc004d40 0x7fca181e4a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca0800e700 tx=0x7fca0800ebc0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.526+0000 7fca17e00640 1 -- 172.21.15.81:0/3078995827 reap_dead start 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.526+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 shutdown_connections 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.526+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 >> 172.21.15.81:0/3078995827 conn(0x7fca1806cb50 msgr2=0x7fca180731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.526+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 shutdown_connections 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.526+0000 7fca0cc00640 1 -- 172.21.15.81:0/3078995827 wait complete. 2024-09-10T20:40:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.528+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fda04075c90 con 0x7fd9e4082380 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.527+0000 7faee6a00640 1 -- 172.21.15.81:0/319714232 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7faed40817f0 msgr2=0x7faed4083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.527+0000 7faee6a00640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7faed40817f0 0x7faed4083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.527+0000 7faee6a00640 1 -- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faed4078070 msgr2=0x7faed407a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.527+0000 7faee6a00640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faed4078070 0x7faed407a530 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faef40aec70 tx=0x7faee0005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.527+0000 7faee6a00640 1 -- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef41516e0 msgr2=0x7faef4159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.528+0000 7faee6a00640 1 --2- 172.21.15.81:0/319714232 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef41516e0 0x7faef4159c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faeec002230 tx=0x7faeec004c20 comp rx=0 tx=0).stop 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.528+0000 7faefa400640 1 -- 172.21.15.81:0/319714232 reap_dead start 2024-09-10T20:40:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.528+0000 7faee6a00640 1 -- 172.21.15.81:0/319714232 shutdown_connections 2024-09-10T20:40:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.528+0000 7faee6a00640 1 -- 172.21.15.81:0/319714232 >> 172.21.15.81:0/319714232 conn(0x7faef406cb50 msgr2=0x7faef40b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.528+0000 7faee6a00640 1 -- 172.21.15.81:0/319714232 shutdown_connections 2024-09-10T20:40:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.528+0000 7faee6a00640 1 -- 172.21.15.81:0/319714232 wait complete. 2024-09-10T20:40:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.531+0000 7fd9fa000640 1 -- 172.21.15.81:0/1499656765 <== osd.1 v2:172.21.15.81:6810/310566059 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fda04075c90 con 0x7fd9e4082380 2024-09-10T20:40:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.531+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd9e4082380 msgr2=0x7fd9e4084820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.531+0000 7fd9ef400640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd9e4082380 0x7fd9e4084820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.532+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd9e4077f70 msgr2=0x7fd9e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.532+0000 7fd9ef400640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd9e4077f70 0x7fd9e407a430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4003eb0 tx=0x7fd9f4009040 comp rx=0 tx=0).stop 2024-09-10T20:40:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.532+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cf8d0 msgr2=0x7fda040ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.532+0000 7fd9ef400640 1 --2- 172.21.15.81:0/1499656765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda040cf8d0 0x7fda040ad230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0034040 tx=0x7fd9f00038a0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.534+0000 7fda02800640 1 -- 172.21.15.81:0/1499656765 reap_dead start 2024-09-10T20:40:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.534+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 shutdown_connections 2024-09-10T20:40:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.534+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 >> 172.21.15.81:0/1499656765 conn(0x7fda0406cb50 msgr2=0x7fda0406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.534+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 shutdown_connections 2024-09-10T20:40:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.534+0000 7fd9ef400640 1 -- 172.21.15.81:0/1499656765 wait complete. 2024-09-10T20:40:17.540 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-10T20:40:17.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T20:40:17.548 INFO:teuthology.orchestra.run.smithi081.stdout:64424509449 2024-09-10T20:40:17.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T20:40:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.547+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa88c0d42e0 con 0x7fa868081660 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.548+0000 7fa883400640 1 -- 172.21.15.81:0/2717427198 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa88c0d42e0 con 0x7fa868081660 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.548+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fa868081660 msgr2=0x7fa868083aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa891e00640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fa868081660 0x7fa868083aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa868077f70 msgr2=0x7fa86807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa891e00640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa868077f70 0x7fa86807a430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa874033000 tx=0x7fa8740046c0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa88c162560 msgr2=0x7fa88c0b8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa891e00640 1 --2- 172.21.15.81:0/2717427198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa88c162560 0x7fa88c0b8df0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c740 tx=0x7fa87c00cc00 comp rx=0 tx=0).stop 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa88b400640 1 -- 172.21.15.81:0/2717427198 reap_dead start 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 shutdown_connections 2024-09-10T20:40:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.549+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 >> 172.21.15.81:0/2717427198 conn(0x7fa88c0d3c50 msgr2=0x7fa88c0d1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.550+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 shutdown_connections 2024-09-10T20:40:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.550+0000 7fa891e00640 1 -- 172.21.15.81:0/2717427198 wait complete. 2024-09-10T20:40:17.558 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-10T20:40:17.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T20:40:17.561 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-10T20:40:17.562 INFO:teuthology.orchestra.run.smithi081.stdout:64424509452 2024-09-10T20:40:17.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T20:40:17.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T20:40:17.566 INFO:teuthology.orchestra.run.smithi081.stdout:64424509452 2024-09-10T20:40:17.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T20:40:17.585 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-10T20:40:17.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T20:40:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.828+0000 7f5a3b200640 1 -- 172.21.15.81:0/1564120058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a340e39e0 msgr2=0x7f5a3403a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.829+0000 7f5a3b200640 1 --2- 172.21.15.81:0/1564120058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a340e39e0 0x7f5a3403a400 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c06b200 tx=0x7f5a3c0a5bc0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.829+0000 7f5a3b200640 1 -- 172.21.15.81:0/1564120058 shutdown_connections 2024-09-10T20:40:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.830+0000 7f5a3b200640 1 --2- 172.21.15.81:0/1564120058 >> v2:172.21.15.143:3300/0 conn(0x7f5a3403a940 0x7f5a340e6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.830+0000 7f5a3b200640 1 --2- 172.21.15.81:0/1564120058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a340e39e0 0x7f5a3403a400 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.830+0000 7f5a3b200640 1 --2- 172.21.15.81:0/1564120058 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a340e2a60 0x7f5a34037940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.830+0000 7f5a3b200640 1 -- 172.21.15.81:0/1564120058 >> 172.21.15.81:0/1564120058 conn(0x7f5a34055540 msgr2=0x7f5a34055920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.832+0000 7f5a3b200640 1 -- 172.21.15.81:0/1564120058 shutdown_connections 2024-09-10T20:40:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.833+0000 7f5a3b200640 1 -- 172.21.15.81:0/1564120058 wait complete. 2024-09-10T20:40:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.835+0000 7f5a3b200640 1 Processor -- start 2024-09-10T20:40:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.836+0000 7f5a3b200640 1 -- start start 2024-09-10T20:40:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.838+0000 7f5a3b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3403a940 0x7f5a3404f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.839+0000 7f5a39e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3403a940 0x7f5a3404f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.839+0000 7f5a39e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3403a940 0x7f5a3404f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52522/0 (socket says 172.21.15.81:52522) 2024-09-10T20:40:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.839+0000 7f5a39e00640 1 -- 172.21.15.81:0/1189566077 learned_addr learned my addr 172.21.15.81:0/1189566077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.839+0000 7f5a3b200640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a340e2a60 0x7f5a340cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.840+0000 7f5a3b200640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a340e39e0 0x7f5a3404fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.840+0000 7f5a39400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a340e2a60 0x7f5a340cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.841+0000 7f5a3b200640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a340e6c10 con 0x7f5a3403a940 2024-09-10T20:40:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.841+0000 7f5a3a800640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a340e39e0 0x7f5a3404fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.841+0000 7f5a3b200640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5a340e6a90 con 0x7f5a340e2a60 2024-09-10T20:40:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.841+0000 7f5a3b200640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5a340e6d90 con 0x7f5a340e39e0 2024-09-10T20:40:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.842+0000 7f5a39e00640 1 -- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a340e39e0 msgr2=0x7f5a3404fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.842+0000 7f5a39e00640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a340e39e0 0x7f5a3404fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.843+0000 7f5a39e00640 1 -- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a340e2a60 msgr2=0x7f5a340cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.843+0000 7f5a39e00640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a340e2a60 0x7f5a340cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.843+0000 7f5a39e00640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a340505d0 con 0x7f5a3403a940 2024-09-10T20:40:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.843+0000 7f5a3a800640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a340e39e0 0x7f5a3404fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.843+0000 7f5a39400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a340e2a60 0x7f5a340cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.844+0000 7f605d000640 1 -- 172.21.15.81:0/4190716613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d24d0 msgr2=0x7f60580d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.844+0000 7f605d000640 1 --2- 172.21.15.81:0/4190716613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d24d0 0x7f60580d01f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f60580a18e0 tx=0x7f604802aa30 comp rx=0 tx=0).stop 2024-09-10T20:40:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.844+0000 7f5a39e00640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3403a940 0x7f5a3404f2c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400da90 tx=0x7f5a2400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f5a32000640 1 -- 172.21.15.81:0/1189566077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24017070 con 0x7f5a3403a940 2024-09-10T20:40:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f605d000640 1 -- 172.21.15.81:0/4190716613 shutdown_connections 2024-09-10T20:40:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f605d000640 1 --2- 172.21.15.81:0/4190716613 >> v2:172.21.15.81:3300/0 conn(0x7f60580d4560 0x7f60580d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f605d000640 1 --2- 172.21.15.81:0/4190716613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d24d0 0x7f60580d01f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f605d000640 1 -- 172.21.15.81:0/4190716613 >> 172.21.15.81:0/4190716613 conn(0x7f60580d3a40 msgr2=0x7f60580d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f5a32000640 1 -- 172.21.15.81:0/1189566077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a24004310 con 0x7f5a3403a940 2024-09-10T20:40:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f5a32000640 1 -- 172.21.15.81:0/1189566077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24009c00 con 0x7f5a3403a940 2024-09-10T20:40:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f5a3b200640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a340508b0 con 0x7f5a3403a940 2024-09-10T20:40:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f5a3b200640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a34050e70 con 0x7f5a3403a940 2024-09-10T20:40:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.845+0000 7f605d000640 1 -- 172.21.15.81:0/4190716613 shutdown_connections 2024-09-10T20:40:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.846+0000 7f605d000640 1 -- 172.21.15.81:0/4190716613 wait complete. 2024-09-10T20:40:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.849+0000 7f605d000640 1 Processor -- start 2024-09-10T20:40:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.849+0000 7f605d000640 1 -- start start 2024-09-10T20:40:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.848+0000 7f5a3b200640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a340e72a0 con 0x7f5a3403a940 2024-09-10T20:40:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.851+0000 7f605d000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d4560 0x7f605814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.851+0000 7f605d000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f605815db30 0x7f60580cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f605d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058152f50 0x7f60580cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f605d000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60580b3560 con 0x7f6058152f50 2024-09-10T20:40:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f605d000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f60580b33e0 con 0x7f60580d4560 2024-09-10T20:40:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f605d000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f60580b36e0 con 0x7f605815db30 2024-09-10T20:40:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f6056a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f605815db30 0x7f60580cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f6056a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f605815db30 0x7f60580cbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:55898/0 (socket says 172.21.15.81:55898) 2024-09-10T20:40:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f6056a00640 1 -- 172.21.15.81:0/702500765 learned_addr learned my addr 172.21.15.81:0/702500765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.854+0000 7f6057400640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d4560 0x7f605814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.856+0000 7f6056a00640 1 -- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d4560 msgr2=0x7f605814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.852+0000 7f5a32000640 1 -- 172.21.15.81:0/1189566077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a240035f0 con 0x7f5a3403a940 2024-09-10T20:40:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.856+0000 7f6057e00640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058152f50 0x7f60580cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.854+0000 7f5a32000640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a18077fa0 0x7f5a1807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.854+0000 7f5a32000640 1 -- 172.21.15.81:0/1189566077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5a2409a340 con 0x7f5a3403a940 2024-09-10T20:40:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f5a39400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a18077fa0 0x7f5a1807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 -- 172.21.15.81:0/2921229707 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0580 msgr2=0x7f940c161aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 --2- 172.21.15.81:0/2921229707 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0580 0x7f940c161aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f940c08c360 tx=0x7f940402aa30 comp rx=0 tx=0).stop 2024-09-10T20:40:17.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.857+0000 7f6056a00640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d4560 0x7f605814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 -- 172.21.15.81:0/2921229707 shutdown_connections 2024-09-10T20:40:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 --2- 172.21.15.81:0/2921229707 >> v2:172.21.15.81:3300/0 conn(0x7f940c0d0960 0x7f940c162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 --2- 172.21.15.81:0/2921229707 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f940c0b4d00 0x7f940c161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 --2- 172.21.15.81:0/2921229707 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0580 0x7f940c161aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 -- 172.21.15.81:0/2921229707 >> 172.21.15.81:0/2921229707 conn(0x7f940c0d3a20 msgr2=0x7f940c0d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.857+0000 7f6056a00640 1 -- 172.21.15.81:0/702500765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058152f50 msgr2=0x7f60580cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.857+0000 7f6056a00640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058152f50 0x7f60580cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.857+0000 7f6056a00640 1 -- 172.21.15.81:0/702500765 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6058153740 con 0x7f605815db30 2024-09-10T20:40:17.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.859+0000 7f5a39400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a18077fa0 0x7f5a1807a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a340077a0 tx=0x7f5a3c06aa80 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.859+0000 7f6057e00640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058152f50 0x7f60580cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.860+0000 7f6056a00640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f605815db30 0x7f60580cbc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6048009bf0 tx=0x7f6048003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 -- 172.21.15.81:0/2921229707 shutdown_connections 2024-09-10T20:40:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.858+0000 7f940be00640 1 -- 172.21.15.81:0/2921229707 wait complete. 2024-09-10T20:40:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.861+0000 7f940be00640 1 Processor -- start 2024-09-10T20:40:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.861+0000 7f940be00640 1 -- start start 2024-09-10T20:40:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.863+0000 7f940be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f940c0b4d00 0x7f940c15f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.864+0000 7f940be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940c0d0580 0x7f940c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.863+0000 7f604f400640 1 -- 172.21.15.81:0/702500765 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048047070 con 0x7f605815db30 2024-09-10T20:40:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.863+0000 7f604f400640 1 -- 172.21.15.81:0/702500765 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6048004250 con 0x7f605815db30 2024-09-10T20:40:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.863+0000 7f604f400640 1 -- 172.21.15.81:0/702500765 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048033050 con 0x7f605815db30 2024-09-10T20:40:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.864+0000 7f940be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0960 0x7f940c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.864+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605809d740 con 0x7f605815db30 2024-09-10T20:40:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.864+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f605809f430 con 0x7f605815db30 2024-09-10T20:40:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.864+0000 7f5a32000640 1 -- 172.21.15.81:0/1189566077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5a24062a60 con 0x7f5a3403a940 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.864+0000 7f940aa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f940c0b4d00 0x7f940c15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.865+0000 7f940aa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f940c0b4d00 0x7f940c15f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:55910/0 (socket says 172.21.15.81:55910) 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.865+0000 7f940b400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0960 0x7f940c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.865+0000 7f940b400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0960 0x7f940c0c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46746/0 (socket says 172.21.15.81:46746) 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.865+0000 7f940a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940c0d0580 0x7f940c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.865+0000 7f940a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940c0d0580 0x7f940c0c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52546/0 (socket says 172.21.15.81:52546) 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.865+0000 7f940aa00640 1 -- 172.21.15.81:0/3499018977 learned_addr learned my addr 172.21.15.81:0/3499018977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.866+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0d1ec0 con 0x7f940c0d0580 2024-09-10T20:40:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.866+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0d1d40 con 0x7f940c0d0960 2024-09-10T20:40:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.866+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f940c0d2040 con 0x7f940c0b4d00 2024-09-10T20:40:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.866+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605806c500 con 0x7f605815db30 2024-09-10T20:40:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.867+0000 7f940a000640 1 -- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f940c0b4d00 msgr2=0x7f940c15f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.867+0000 7f940a000640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f940c0b4d00 0x7f940c15f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.867+0000 7f940a000640 1 -- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0960 msgr2=0x7f940c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.867+0000 7f940a000640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0960 0x7f940c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.867+0000 7f940a000640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c1f8960 con 0x7f940c0d0580 2024-09-10T20:40:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.867+0000 7f940b400640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0960 0x7f940c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.868+0000 7f940a000640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940c0d0580 0x7f940c0c87d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c970 tx=0x7f93fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.868+0000 7f9403400640 1 -- 172.21.15.81:0/3499018977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc007bb0 con 0x7f940c0d0580 2024-09-10T20:40:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.868+0000 7f9403400640 1 -- 172.21.15.81:0/3499018977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93fc007e40 con 0x7f940c0d0580 2024-09-10T20:40:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.868+0000 7f9403400640 1 -- 172.21.15.81:0/3499018977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00f6b0 con 0x7f940c0d0580 2024-09-10T20:40:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.868+0000 7f604f400640 1 -- 172.21.15.81:0/702500765 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f60480046a0 con 0x7f605815db30 2024-09-10T20:40:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.870+0000 7f604f400640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6038078070 0x7f603807a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.868+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c15f840 con 0x7f940c0d0580 2024-09-10T20:40:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.868+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c0c7a10 con 0x7f940c0d0580 2024-09-10T20:40:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.871+0000 7f604f400640 1 -- 172.21.15.81:0/702500765 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f60480bb310 con 0x7f605815db30 2024-09-10T20:40:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.871+0000 7f6057400640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6038078070 0x7f603807a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.874+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e4005290 con 0x7f940c0d0580 2024-09-10T20:40:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.877+0000 7f6057400640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6038078070 0x7f603807a530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6050006fd0 tx=0x7f6050008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.877+0000 7f604f400640 1 -- 172.21.15.81:0/702500765 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f605806c500 con 0x7f605815db30 2024-09-10T20:40:17.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.880+0000 7ff797200640 1 -- 172.21.15.81:0/3830784467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 msgr2=0x7ff790036820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.880+0000 7ff797200640 1 --2- 172.21.15.81:0/3830784467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 0x7ff790036820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff790035e00 tx=0x7ff7980a5960 comp rx=0 tx=0).stop 2024-09-10T20:40:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.876+0000 7f9403400640 1 -- 172.21.15.81:0/3499018977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f93fc020030 con 0x7f940c0d0580 2024-09-10T20:40:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.879+0000 7f9403400640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f93ec078040 0x7f93ec07a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.879+0000 7f9403400640 1 -- 172.21.15.81:0/3499018977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f93fc09a330 con 0x7f940c0d0580 2024-09-10T20:40:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.881+0000 7f940aa00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f93ec078040 0x7f93ec07a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 -- 172.21.15.81:0/1327061376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 msgr2=0x7fce9815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 --2- 172.21.15.81:0/1327061376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 0x7fce9815d670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fce90005fd0 tx=0x7fce9002a8c0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 -- 172.21.15.81:0/1327061376 shutdown_connections 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 --2- 172.21.15.81:0/1327061376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 0x7fce9815d670 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 --2- 172.21.15.81:0/1327061376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce980d01f0 0x7fce980cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 -- 172.21.15.81:0/1327061376 >> 172.21.15.81:0/1327061376 conn(0x7fce980d3a40 msgr2=0x7fce980d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 -- 172.21.15.81:0/1327061376 shutdown_connections 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.881+0000 7ff797200640 1 -- 172.21.15.81:0/3830784467 shutdown_connections 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.881+0000 7ff797200640 1 --2- 172.21.15.81:0/3830784467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 0x7ff790036820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.881+0000 7ff797200640 1 -- 172.21.15.81:0/3830784467 >> 172.21.15.81:0/3830784467 conn(0x7ff79001d770 msgr2=0x7ff790054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.881+0000 7ff797200640 1 -- 172.21.15.81:0/3830784467 shutdown_connections 2024-09-10T20:40:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.881+0000 7ff797200640 1 -- 172.21.15.81:0/3830784467 wait complete. 2024-09-10T20:40:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7ff797200640 1 Processor -- start 2024-09-10T20:40:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7f940aa00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f93ec078040 0x7f93ec07a500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9404009a60 tx=0x7f940403a040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.884+0000 7ff797200640 1 -- start start 2024-09-10T20:40:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.883+0000 7fce97e00640 1 -- 172.21.15.81:0/1327061376 wait complete. 2024-09-10T20:40:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7fce97e00640 1 Processor -- start 2024-09-10T20:40:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff797200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff79004eb20 0x7ff79004a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7fce97e00640 1 -- start start 2024-09-10T20:40:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff797200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7900e69b0 0x7ff7900d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff797200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 0x7ff790047fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff797200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff790055290 con 0x7ff7900e69b0 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff797200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff7900e48f0 con 0x7ff7900e6d90 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff797200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff7900da3f0 con 0x7ff79004eb20 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff795e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff79004eb20 0x7ff79004a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff795e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff79004eb20 0x7ff79004a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:55940/0 (socket says 172.21.15.81:55940) 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff795e00640 1 -- 172.21.15.81:0/387508423 learned_addr learned my addr 172.21.15.81:0/387508423 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.886+0000 7ff796800640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 0x7ff790047fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.887+0000 7ff795400640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7900e69b0 0x7ff7900d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.887+0000 7ff796800640 1 -- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff79004eb20 msgr2=0x7ff79004a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.887+0000 7ff796800640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff79004eb20 0x7ff79004a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.887+0000 7ff796800640 1 -- 172.21.15.81:0/387508423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7900e69b0 msgr2=0x7ff7900d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.887+0000 7ff796800640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7900e69b0 0x7ff7900d1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.887+0000 7ff796800640 1 -- 172.21.15.81:0/387508423 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7900d2d20 con 0x7ff7900e6d90 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.888+0000 7ff796800640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 0x7ff790047fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff79806c060 tx=0x7ff79807a830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.888+0000 7ff78e000640 1 -- 172.21.15.81:0/387508423 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980ba070 con 0x7ff7900e6d90 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.888+0000 7ff78e000640 1 -- 172.21.15.81:0/387508423 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7980ab830 con 0x7ff7900e6d90 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.888+0000 7ff78e000640 1 -- 172.21.15.81:0/387508423 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980abbe0 con 0x7ff7900e6d90 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.888+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff790048c40 con 0x7ff7900e6d90 2024-09-10T20:40:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.888+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff790049200 con 0x7ff7900e6d90 2024-09-10T20:40:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.889+0000 7f9403400640 1 -- 172.21.15.81:0/3499018977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f93fc014030 con 0x7f940c0d0580 2024-09-10T20:40:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.890+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff770005290 con 0x7ff7900e6d90 2024-09-10T20:40:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.889+0000 7fce97e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce980d01f0 0x7fce981fc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.894+0000 7fce96a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce980d01f0 0x7fce981fc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.893+0000 7ff78e000640 1 -- 172.21.15.81:0/387508423 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff7980bf450 con 0x7ff7900e6d90 2024-09-10T20:40:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.894+0000 7ff78e000640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff778077fa0 0x7ff77807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7ff78e000640 1 -- 172.21.15.81:0/387508423 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff798136630 con 0x7ff7900e6d90 2024-09-10T20:40:17.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.894+0000 7fce96a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce980d01f0 0x7fce981fc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52570/0 (socket says 172.21.15.81:52570) 2024-09-10T20:40:17.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.894+0000 7fce96a00640 1 -- 172.21.15.81:0/2734617688 learned_addr learned my addr 172.21.15.81:0/2734617688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.894+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce980d24a0 0x7fce980b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.894+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 0x7fce980ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce980b33a0 con 0x7fce980d01f0 2024-09-10T20:40:17.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fce9815de70 con 0x7fce980d4560 2024-09-10T20:40:17.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7ff795e00640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff778077fa0 0x7ff77807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce980b3520 con 0x7fce980d24a0 2024-09-10T20:40:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97400640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 0x7fce980ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce96000640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce980d24a0 0x7fce980b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97400640 1 -- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce980d24a0 msgr2=0x7fce980b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97400640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce980d24a0 0x7fce980b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97400640 1 -- 172.21.15.81:0/2734617688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce980d01f0 msgr2=0x7fce981fc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97400640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce980d01f0 0x7fce981fc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.895+0000 7fce97400640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce981fcdd0 con 0x7fce980d4560 2024-09-10T20:40:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.896+0000 7fce96a00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce980d01f0 0x7fce981fc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.897+0000 7fce97400640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 0x7fce980ccf80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce90009000 tx=0x7fce90003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.898+0000 7ff795e00640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff778077fa0 0x7ff77807a460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff788001870 tx=0x7ff788009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.898+0000 7fce8ea00640 1 -- 172.21.15.81:0/2734617688 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90031ba0 con 0x7fce980d4560 2024-09-10T20:40:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.898+0000 7fce8ea00640 1 -- 172.21.15.81:0/2734617688 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce900330d0 con 0x7fce980d4560 2024-09-10T20:40:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.898+0000 7fce8ea00640 1 -- 172.21.15.81:0/2734617688 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90033560 con 0x7fce980d4560 2024-09-10T20:40:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.898+0000 7f71bbe00640 1 -- 172.21.15.81:0/1810535956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b415d620 msgr2=0x7f71b4073b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.898+0000 7f71bbe00640 1 --2- 172.21.15.81:0/1810535956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b415d620 0x7f71b4073b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005fd0 tx=0x7f71ac02acc0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7f71bbe00640 1 -- 172.21.15.81:0/1810535956 shutdown_connections 2024-09-10T20:40:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7f71bbe00640 1 --2- 172.21.15.81:0/1810535956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b415d620 0x7f71b4073b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7f71bbe00640 1 --2- 172.21.15.81:0/1810535956 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b4153f10 0x7f71b40b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7f71bbe00640 1 -- 172.21.15.81:0/1810535956 >> 172.21.15.81:0/1810535956 conn(0x7f71b406cb50 msgr2=0x7f71b406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7ff78e000640 1 -- 172.21.15.81:0/387508423 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff7980fe810 con 0x7ff7900e6d90 2024-09-10T20:40:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7f71bbe00640 1 -- 172.21.15.81:0/1810535956 shutdown_connections 2024-09-10T20:40:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7f71bbe00640 1 -- 172.21.15.81:0/1810535956 wait complete. 2024-09-10T20:40:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce981f8b80 con 0x7fce980d4560 2024-09-10T20:40:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.899+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce981f9140 con 0x7fce980d4560 2024-09-10T20:40:17.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.902+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce980cf4f0 con 0x7fce980d4560 2024-09-10T20:40:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.903+0000 7f71bbe00640 1 Processor -- start 2024-09-10T20:40:17.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.904+0000 7f71bbe00640 1 -- start start 2024-09-10T20:40:17.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.905+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b4153f10 0x7f71b41f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.905+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b41542f0 0x7f71b414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.905+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b415d620 0x7f71b41504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.905+0000 7f71bbe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71b40726f0 con 0x7f71b41542f0 2024-09-10T20:40:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.905+0000 7f71bbe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f71b40744c0 con 0x7f71b4153f10 2024-09-10T20:40:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.905+0000 7f71bbe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f71b4072870 con 0x7f71b415d620 2024-09-10T20:40:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.906+0000 7f71b8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b41542f0 0x7f71b414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.906+0000 7f71b9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b4153f10 0x7f71b41f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.906+0000 7f71b8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b41542f0 0x7f71b414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52574/0 (socket says 172.21.15.81:52574) 2024-09-10T20:40:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.906+0000 7fce8ea00640 1 -- 172.21.15.81:0/2734617688 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fce9004b030 con 0x7fce980d4560 2024-09-10T20:40:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.906+0000 7f71b8a00640 1 -- 172.21.15.81:0/144770378 learned_addr learned my addr 172.21.15.81:0/144770378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.906+0000 7f71b9e00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b415d620 0x7f71b41504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.906+0000 7f71b9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b4153f10 0x7f71b41f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46786/0 (socket says 172.21.15.81:46786) 2024-09-10T20:40:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.908+0000 7fce8ea00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fce78078040 0x7fce7807a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.909+0000 7fce8ea00640 1 -- 172.21.15.81:0/2734617688 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fce900bb530 con 0x7fce980d4560 2024-09-10T20:40:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.909+0000 7f71b8a00640 1 -- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b415d620 msgr2=0x7f71b41504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.910+0000 7fce8ea00640 1 -- 172.21.15.81:0/2734617688 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fce981fcdd0 con 0x7fce980d4560 2024-09-10T20:40:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.910+0000 7fce96a00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fce78078040 0x7fce7807a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.913+0000 7f71b8a00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b415d620 0x7f71b41504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.913+0000 7f71b8a00640 1 -- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b4153f10 msgr2=0x7f71b41f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.913+0000 7f71b8a00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b4153f10 0x7f71b41f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.913+0000 7f71b8a00640 1 -- 172.21.15.81:0/144770378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b40ad8b0 con 0x7f71b41542f0 2024-09-10T20:40:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.913+0000 7f71b9400640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b4153f10 0x7f71b41f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.913+0000 7f71b9e00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b415d620 0x7f71b41504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.914+0000 7f71b8a00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b41542f0 0x7f71b414ff80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c450 tx=0x7f71a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.915+0000 7f71b1600640 1 -- 172.21.15.81:0/144770378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a80052d0 con 0x7f71b41542f0 2024-09-10T20:40:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.915+0000 7f71b1600640 1 -- 172.21.15.81:0/144770378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71a8005470 con 0x7f71b41542f0 2024-09-10T20:40:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.915+0000 7f71b1600640 1 -- 172.21.15.81:0/144770378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8012870 con 0x7f71b41542f0 2024-09-10T20:40:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.915+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b40adb90 con 0x7f71b41542f0 2024-09-10T20:40:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.916+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b40ae150 con 0x7f71b41542f0 2024-09-10T20:40:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.915+0000 7fce96a00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fce78078040 0x7fce7807a500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce880058c0 tx=0x7fce88009260 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.919+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b40b4950 con 0x7f71b41542f0 2024-09-10T20:40:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.922+0000 7f71b1600640 1 -- 172.21.15.81:0/144770378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f71a80035f0 con 0x7f71b41542f0 2024-09-10T20:40:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.923+0000 7fca0b200640 1 -- 172.21.15.81:0/4131040032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c1575c0 msgr2=0x7fca0c074000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.923+0000 7fca0b200640 1 --2- 172.21.15.81:0/4131040032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c1575c0 0x7fca0c074000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009370 tx=0x7fc9fc02b650 comp rx=0 tx=0).stop 2024-09-10T20:40:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.924+0000 7f71b1600640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f719407c380 0x7f719407e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.924+0000 7fca0b200640 1 -- 172.21.15.81:0/4131040032 shutdown_connections 2024-09-10T20:40:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.924+0000 7fca0b200640 1 --2- 172.21.15.81:0/4131040032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c1575c0 0x7fca0c074000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.924+0000 7fca0b200640 1 -- 172.21.15.81:0/4131040032 >> 172.21.15.81:0/4131040032 conn(0x7fca0c0cf6d0 msgr2=0x7fca0c0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.924+0000 7fca0b200640 1 -- 172.21.15.81:0/4131040032 shutdown_connections 2024-09-10T20:40:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.924+0000 7f71b1600640 1 -- 172.21.15.81:0/144770378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f71a8099c10 con 0x7f71b41542f0 2024-09-10T20:40:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.925+0000 7f71b9400640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f719407c380 0x7f719407e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.926+0000 7f71b9400640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f719407c380 0x7f719407e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71a0006fd0 tx=0x7f71a000d040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.924+0000 7fca0b200640 1 -- 172.21.15.81:0/4131040032 wait complete. 2024-09-10T20:40:17.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.927+0000 7fca0b200640 1 Processor -- start 2024-09-10T20:40:17.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.927+0000 7fca0b200640 1 -- start start 2024-09-10T20:40:17.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.929+0000 7fca0b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c0b2e40 0x7fca0c2008e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.930+0000 7fca0b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca0c1575c0 0x7fca0c0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.930+0000 7fca09e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c0b2e40 0x7fca0c2008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.930+0000 7fca09e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c0b2e40 0x7fca0c2008e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46802/0 (socket says 172.21.15.81:46802) 2024-09-10T20:40:17.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.930+0000 7fca09e00640 1 -- 172.21.15.81:0/2818951339 learned_addr learned my addr 172.21.15.81:0/2818951339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.930+0000 7fca0b200640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c159f50 0x7fca0c0ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.931+0000 7fca09400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca0c1575c0 0x7fca0c0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.931+0000 7fca0a800640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c159f50 0x7fca0c0ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.931+0000 7fca0b200640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c0b43c0 con 0x7fca0c1575c0 2024-09-10T20:40:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.931+0000 7fca0b200640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c0b4240 con 0x7fca0c0b2e40 2024-09-10T20:40:17.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.931+0000 7fca0b200640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fca0c070360 con 0x7fca0c159f50 2024-09-10T20:40:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.933+0000 7fca0a800640 1 -- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c0b2e40 msgr2=0x7fca0c2008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.933+0000 7fca0a800640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c0b2e40 0x7fca0c2008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.933+0000 7fca0a800640 1 -- 172.21.15.81:0/2818951339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca0c1575c0 msgr2=0x7fca0c0abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.933+0000 7fca0a800640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca0c1575c0 0x7fca0c0abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.933+0000 7fca0a800640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c0b0900 con 0x7fca0c159f50 2024-09-10T20:40:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.933+0000 7fca09e00640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c0b2e40 0x7fca0c2008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.933+0000 7fca09400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca0c1575c0 0x7fca0c0abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:17.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.934+0000 7fca0a800640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c159f50 0x7fca0c0ac160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c840 tx=0x7fca0400cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.934+0000 7f71b1600640 1 -- 172.21.15.81:0/144770378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f71a80623c0 con 0x7f71b41542f0 2024-09-10T20:40:17.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.934+0000 7fca02000640 1 -- 172.21.15.81:0/2818951339 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04017070 con 0x7fca0c159f50 2024-09-10T20:40:17.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.934+0000 7fca02000640 1 -- 172.21.15.81:0/2818951339 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca04005070 con 0x7fca0c159f50 2024-09-10T20:40:17.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.934+0000 7fca0b200640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0c0b0be0 con 0x7fca0c159f50 2024-09-10T20:40:17.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.934+0000 7fca0b200640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0c0b11a0 con 0x7fca0c159f50 2024-09-10T20:40:17.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.935+0000 7fca02000640 1 -- 172.21.15.81:0/2818951339 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca040054c0 con 0x7fca0c159f50 2024-09-10T20:40:17.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.939+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e0005290 con 0x7fca0c159f50 2024-09-10T20:40:17.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.940+0000 7fca02000640 1 -- 172.21.15.81:0/2818951339 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fca04005660 con 0x7fca0c159f50 2024-09-10T20:40:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.942+0000 7fca02000640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9ec077f70 0x7fc9ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.942+0000 7fca02000640 1 -- 172.21.15.81:0/2818951339 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fca04099bb0 con 0x7fca0c159f50 2024-09-10T20:40:17.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.943+0000 7fca09e00640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9ec077f70 0x7fc9ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.947+0000 7fca09e00640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9ec077f70 0x7fc9ec07a430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca0c158320 tx=0x7fc9fc004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.947+0000 7fac0be00640 1 -- 172.21.15.81:0/480797775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c142490 msgr2=0x7fac0c142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.947+0000 7fac0be00640 1 --2- 172.21.15.81:0/480797775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c142490 0x7fac0c142940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fabf4005fd0 tx=0x7fabf402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.947+0000 7fac0be00640 1 -- 172.21.15.81:0/480797775 shutdown_connections 2024-09-10T20:40:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.947+0000 7fac0be00640 1 --2- 172.21.15.81:0/480797775 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c142490 0x7fac0c142940 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.947+0000 7fac0be00640 1 --2- 172.21.15.81:0/480797775 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac0c0ae710 0x7fac0c0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.947+0000 7fac0be00640 1 -- 172.21.15.81:0/480797775 >> 172.21.15.81:0/480797775 conn(0x7fac0c0cf6d0 msgr2=0x7fac0c0cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.948+0000 7fac0be00640 1 -- 172.21.15.81:0/480797775 shutdown_connections 2024-09-10T20:40:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.948+0000 7fac0be00640 1 -- 172.21.15.81:0/480797775 wait complete. 2024-09-10T20:40:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.948+0000 7fca02000640 1 -- 172.21.15.81:0/2818951339 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fca040622d0 con 0x7fca0c159f50 2024-09-10T20:40:17.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.950+0000 7fac0be00640 1 Processor -- start 2024-09-10T20:40:17.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.951+0000 7fac0be00640 1 -- start start 2024-09-10T20:40:17.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.952+0000 7fac0be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c0ae710 0x7fac0c1f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.952+0000 7fac0be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac0c0aeaf0 0x7fac0c146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0aa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c0ae710 0x7fac0c1f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0aa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c0ae710 0x7fac0c1f94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46814/0 (socket says 172.21.15.81:46814) 2024-09-10T20:40:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0aa00640 1 -- 172.21.15.81:0/1893922527 learned_addr learned my addr 172.21.15.81:0/1893922527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0be00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0c142490 0x7fac0c0b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0a000640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac0c0aeaf0 0x7fac0c146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c06e790 con 0x7fac0c142490 2024-09-10T20:40:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c1432b0 con 0x7fac0c0ae710 2024-09-10T20:40:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.953+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fac0c06e910 con 0x7fac0c0aeaf0 2024-09-10T20:40:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.955+0000 7fac0b400640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0c142490 0x7fac0c0b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.956+0000 7fac0b400640 1 -- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac0c0aeaf0 msgr2=0x7fac0c146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.956+0000 7fac0b400640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac0c0aeaf0 0x7fac0c146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.956+0000 7fac0b400640 1 -- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c0ae710 msgr2=0x7fac0c1f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.956+0000 7fac0b400640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c0ae710 0x7fac0c1f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.956+0000 7fac0b400640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c0b0280 con 0x7fac0c142490 2024-09-10T20:40:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.957+0000 7fac0b400640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0c142490 0x7fac0c0b0470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac0c074720 tx=0x7fabf4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.957+0000 7fac02a00640 1 -- 172.21.15.81:0/1893922527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf403e030 con 0x7fac0c142490 2024-09-10T20:40:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.957+0000 7fac02a00640 1 -- 172.21.15.81:0/1893922527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabf4003d10 con 0x7fac0c142490 2024-09-10T20:40:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.958+0000 7fac02a00640 1 -- 172.21.15.81:0/1893922527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4035040 con 0x7fac0c142490 2024-09-10T20:40:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.960+0000 7fac0a000640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac0c0aeaf0 0x7fac0c146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.960+0000 7fac0aa00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c0ae710 0x7fac0c1f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.961+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c0af700 con 0x7fac0c142490 2024-09-10T20:40:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.961+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c0afcc0 con 0x7fac0c142490 2024-09-10T20:40:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.962+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c142940 con 0x7fac0c142490 2024-09-10T20:40:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.975+0000 7fac02a00640 1 -- 172.21.15.81:0/1893922527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fabf4004a00 con 0x7fac0c142490 2024-09-10T20:40:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.980+0000 7fac02a00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fabe8077fa0 0x7fabe807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:17.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.981+0000 7fac02a00640 1 -- 172.21.15.81:0/1893922527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fabf40bacf0 con 0x7fac0c142490 2024-09-10T20:40:17.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.981+0000 7fac0aa00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fabe8077fa0 0x7fabe807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.985+0000 7fac0aa00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fabe8077fa0 0x7fabe807a460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac04005c40 tx=0x7fac040083a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:17.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:17.987+0000 7fac02a00640 1 -- 172.21.15.81:0/1893922527 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fabf4083490 con 0x7fac0c142490 2024-09-10T20:40:18.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.286+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f60580b99c0 con 0x7f605815db30 2024-09-10T20:40:18.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.287+0000 7f604f400640 1 -- 172.21.15.81:0/702500765 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6048083ab0 con 0x7f605815db30 2024-09-10T20:40:18.291 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-10T20:40:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.291+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6038078070 msgr2=0x7f603807a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.291+0000 7f605d000640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6038078070 0x7f603807a530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6050006fd0 tx=0x7f6050008040 comp rx=0 tx=0).stop 2024-09-10T20:40:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f605815db30 msgr2=0x7f60580cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f605815db30 0x7f60580cbc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6048009bf0 tx=0x7f6048003f10 comp rx=0 tx=0).stop 2024-09-10T20:40:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 shutdown_connections 2024-09-10T20:40:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6038078070 0x7f603807a530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058152f50 0x7f60580cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f605815db30 0x7f60580cbc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 --2- 172.21.15.81:0/702500765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60580d4560 0x7f605814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.292+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 >> 172.21.15.81:0/702500765 conn(0x7f60580d3a40 msgr2=0x7f60580b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.293+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 shutdown_connections 2024-09-10T20:40:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.293+0000 7f605d000640 1 -- 172.21.15.81:0/702500765 wait complete. 2024-09-10T20:40:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.315+0000 7f5a3b200640 1 -- 172.21.15.81:0/1189566077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5a3400ed10 con 0x7f5a3403a940 2024-09-10T20:40:18.323 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-10T20:40:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.316+0000 7f5a32000640 1 -- 172.21.15.81:0/1189566077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a24062360 con 0x7f5a3403a940 2024-09-10T20:40:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.320+0000 7f5a2b400640 1 -- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a18077fa0 msgr2=0x7f5a1807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.320+0000 7f5a2b400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a18077fa0 0x7f5a1807a460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a340077a0 tx=0x7f5a3c06aa80 comp rx=0 tx=0).stop 2024-09-10T20:40:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.320+0000 7f5a2b400640 1 -- 172.21.15.81:0/1189566077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3403a940 msgr2=0x7f5a3404f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.320+0000 7f5a2b400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3403a940 0x7f5a3404f2c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400da90 tx=0x7f5a2400df50 comp rx=0 tx=0).stop 2024-09-10T20:40:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.321+0000 7f5a2b400640 1 -- 172.21.15.81:0/1189566077 shutdown_connections 2024-09-10T20:40:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.321+0000 7f5a2b400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a18077fa0 0x7f5a1807a460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.321+0000 7f5a2b400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a340e39e0 0x7f5a3404fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.321+0000 7f5a2b400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a340e2a60 0x7f5a340cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.321+0000 7f5a2b400640 1 --2- 172.21.15.81:0/1189566077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3403a940 0x7f5a3404f2c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.321+0000 7f5a2b400640 1 -- 172.21.15.81:0/1189566077 >> 172.21.15.81:0/1189566077 conn(0x7f5a34055540 msgr2=0x7f5a3403c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.7 2024-09-10T20:40:18.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.324+0000 7f5a2b400640 1 -- 172.21.15.81:0/1189566077 shutdown_connections 2024-09-10T20:40:18.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.325+0000 7f5a2b400640 1 -- 172.21.15.81:0/1189566077 wait complete. 2024-09-10T20:40:18.329 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.343 INFO:teuthology.orchestra.run.smithi081.stdout:64424509450 2024-09-10T20:40:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.337+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f93e4005580 con 0x7f940c0d0580 2024-09-10T20:40:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.338+0000 7f9403400640 1 -- 172.21.15.81:0/3499018977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93fc06b1f0 con 0x7f940c0d0580 2024-09-10T20:40:18.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f93ec078040 msgr2=0x7f93ec07a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f93ec078040 0x7f93ec07a500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9404009a60 tx=0x7f940403a040 comp rx=0 tx=0).stop 2024-09-10T20:40:18.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940c0d0580 msgr2=0x7f940c0c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940c0d0580 0x7f940c0c87d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00c970 tx=0x7f93fc00ce30 comp rx=0 tx=0).stop 2024-09-10T20:40:18.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 shutdown_connections 2024-09-10T20:40:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f93ec078040 0x7f93ec07a500 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f940c0d0960 0x7f940c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.342+0000 7f940be00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940c0d0580 0x7f940c0c87d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.343+0000 7f940be00640 1 --2- 172.21.15.81:0/3499018977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f940c0b4d00 0x7f940c15f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.343+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 >> 172.21.15.81:0/3499018977 conn(0x7f940c0d3a20 msgr2=0x7f940c1602e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.343+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 shutdown_connections 2024-09-10T20:40:18.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.343+0000 7f940be00640 1 -- 172.21.15.81:0/3499018977 wait complete. 2024-09-10T20:40:18.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2024-09-10T20:40:18.358 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-09-10T20:40:18.369 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.370+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fce980b99c0 con 0x7fce980d4560 2024-09-10T20:40:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.371+0000 7fce8ea00640 1 -- 172.21.15.81:0/2734617688 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce9003f030 con 0x7fce980d4560 2024-09-10T20:40:18.375 INFO:teuthology.orchestra.run.smithi081.stdout:64424509451 2024-09-10T20:40:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.373+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fce78078040 msgr2=0x7fce7807a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.373+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fce78078040 0x7fce7807a500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce880058c0 tx=0x7fce88009260 comp rx=0 tx=0).stop 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.373+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 msgr2=0x7fce980ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.373+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 0x7fce980ccf80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce90009000 tx=0x7fce90003ba0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 shutdown_connections 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fce78078040 0x7fce7807a500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce980d4560 0x7fce980ccf80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce980d24a0 0x7fce980b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 --2- 172.21.15.81:0/2734617688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce980d01f0 0x7fce981fc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 >> 172.21.15.81:0/2734617688 conn(0x7fce980d3a40 msgr2=0x7fce980d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 shutdown_connections 2024-09-10T20:40:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.374+0000 7fce97e00640 1 -- 172.21.15.81:0/2734617688 wait complete. 2024-09-10T20:40:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.375+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff770005850 con 0x7ff7900e6d90 2024-09-10T20:40:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.375+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f71b415c2f0 con 0x7f71b41542f0 2024-09-10T20:40:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.375+0000 7f71b1600640 1 -- 172.21.15.81:0/144770378 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71a8061cc0 con 0x7f71b41542f0 2024-09-10T20:40:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.375+0000 7ff78e000640 1 -- 172.21.15.81:0/387508423 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff798103240 con 0x7ff7900e6d90 2024-09-10T20:40:18.380 INFO:teuthology.orchestra.run.smithi081.stdout:64424509452 2024-09-10T20:40:18.380 INFO:teuthology.orchestra.run.smithi081.stdout:64424509449 2024-09-10T20:40:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff778077fa0 msgr2=0x7ff77807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff778077fa0 0x7ff77807a460 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff788001870 tx=0x7ff788009040 comp rx=0 tx=0).stop 2024-09-10T20:40:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 msgr2=0x7ff790047fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 0x7ff790047fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff79806c060 tx=0x7ff79807a830 comp rx=0 tx=0).stop 2024-09-10T20:40:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 shutdown_connections 2024-09-10T20:40:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff778077fa0 0x7ff77807a460 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff7900e6d90 0x7ff790047fe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7900e69b0 0x7ff7900d1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 --2- 172.21.15.81:0/387508423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff79004eb20 0x7ff79004a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.378+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 >> 172.21.15.81:0/387508423 conn(0x7ff79001d770 msgr2=0x7ff7900049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.379+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 shutdown_connections 2024-09-10T20:40:18.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.379+0000 7ff797200640 1 -- 172.21.15.81:0/387508423 wait complete. 2024-09-10T20:40:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f719407c380 msgr2=0x7f719407e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f719407c380 0x7f719407e840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71a0006fd0 tx=0x7f71a000d040 comp rx=0 tx=0).stop 2024-09-10T20:40:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b41542f0 msgr2=0x7f71b414ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b41542f0 0x7f71b414ff80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c450 tx=0x7f71a800c910 comp rx=0 tx=0).stop 2024-09-10T20:40:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 shutdown_connections 2024-09-10T20:40:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f719407c380 0x7f719407e840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b415d620 0x7f71b41504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b41542f0 0x7f71b414ff80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 --2- 172.21.15.81:0/144770378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b4153f10 0x7f71b41f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 >> 172.21.15.81:0/144770378 conn(0x7f71b406cb50 msgr2=0x7f71b40689c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 shutdown_connections 2024-09-10T20:40:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.380+0000 7f71bbe00640 1 -- 172.21.15.81:0/144770378 wait complete. 2024-09-10T20:40:18.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.6 2024-09-10T20:40:18.397 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-10T20:40:18.402 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.2 2024-09-10T20:40:18.409 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.455+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc9e0005580 con 0x7fca0c159f50 2024-09-10T20:40:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.455+0000 7fca02000640 1 -- 172.21.15.81:0/2818951339 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca04061bd0 con 0x7fca0c159f50 2024-09-10T20:40:18.459 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-10T20:40:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9ec077f70 msgr2=0x7fc9ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9ec077f70 0x7fc9ec07a430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca0c158320 tx=0x7fc9fc004730 comp rx=0 tx=0).stop 2024-09-10T20:40:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c159f50 msgr2=0x7fca0c0ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c159f50 0x7fca0c0ac160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fca0400c840 tx=0x7fca0400cd00 comp rx=0 tx=0).stop 2024-09-10T20:40:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 shutdown_connections 2024-09-10T20:40:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc9ec077f70 0x7fc9ec07a430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca0c159f50 0x7fca0c0ac160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca0c1575c0 0x7fca0c0abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 --2- 172.21.15.81:0/2818951339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca0c0b2e40 0x7fca0c2008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 >> 172.21.15.81:0/2818951339 conn(0x7fca0c0cf6d0 msgr2=0x7fca0c15ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 shutdown_connections 2024-09-10T20:40:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.458+0000 7fc9f7400640 1 -- 172.21.15.81:0/2818951339 wait complete. 2024-09-10T20:40:18.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-09-10T20:40:18.479 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.479+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fac0c160420 con 0x7fac0c142490 2024-09-10T20:40:18.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.479+0000 7fac02a00640 1 -- 172.21.15.81:0/1893922527 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fabf4082d90 con 0x7fac0c142490 2024-09-10T20:40:18.483 INFO:teuthology.orchestra.run.smithi081.stdout:64424509452 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fabe8077fa0 msgr2=0x7fabe807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fabe8077fa0 0x7fabe807a460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac04005c40 tx=0x7fac040083a0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0c142490 msgr2=0x7fac0c0b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0c142490 0x7fac0c0b0470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac0c074720 tx=0x7fabf4003820 comp rx=0 tx=0).stop 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 shutdown_connections 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fabe8077fa0 0x7fabe807a460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0c142490 0x7fac0c0b0470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac0c0aeaf0 0x7fac0c146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 --2- 172.21.15.81:0/1893922527 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac0c0ae710 0x7fac0c1f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 >> 172.21.15.81:0/1893922527 conn(0x7fac0c0cf6d0 msgr2=0x7fac0c0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 shutdown_connections 2024-09-10T20:40:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.482+0000 7fac0be00640 1 -- 172.21.15.81:0/1893922527 wait complete. 2024-09-10T20:40:18.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.1 2024-09-10T20:40:18.501 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:18.501 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:40:18.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:40:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.699+0000 7f7a47e00640 1 -- 172.21.15.81:0/2092504037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4806e0a0 msgr2=0x7f7a480d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.699+0000 7f7a47e00640 1 --2- 172.21.15.81:0/2092504037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4806e0a0 0x7f7a480d2090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009830 tx=0x7f7a3402a520 comp rx=0 tx=0).stop 2024-09-10T20:40:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.700+0000 7f7a47e00640 1 -- 172.21.15.81:0/2092504037 shutdown_connections 2024-09-10T20:40:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.700+0000 7f7a47e00640 1 --2- 172.21.15.81:0/2092504037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a4806e0a0 0x7f7a480d2090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.700+0000 7f7a47e00640 1 -- 172.21.15.81:0/2092504037 >> 172.21.15.81:0/2092504037 conn(0x7f7a480d3ab0 msgr2=0x7f7a480d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.700+0000 7f7a47e00640 1 -- 172.21.15.81:0/2092504037 shutdown_connections 2024-09-10T20:40:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.700+0000 7f7a47e00640 1 -- 172.21.15.81:0/2092504037 wait complete. 2024-09-10T20:40:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.701+0000 7f7a47e00640 1 Processor -- start 2024-09-10T20:40:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.701+0000 7f7a47e00640 1 -- start start 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.702+0000 7f7a47e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4806e0a0 0x7f7a481573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.702+0000 7f7a47e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a48161140 0x7f7a48157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.702+0000 7f7a47e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a48158b50 0x7f7a481584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.702+0000 7f7a47e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4806e8f0 con 0x7f7a48158b50 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.702+0000 7f7a47e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4806e770 con 0x7f7a4806e0a0 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.702+0000 7f7a47e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7a480b3030 con 0x7f7a48161140 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a48158b50 0x7f7a481584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a46a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4806e0a0 0x7f7a481573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a48158b50 0x7f7a481584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52606/0 (socket says 172.21.15.81:52606) 2024-09-10T20:40:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 -- 172.21.15.81:0/1107542173 learned_addr learned my addr 172.21.15.81:0/1107542173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a46a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4806e0a0 0x7f7a481573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46830/0 (socket says 172.21.15.81:46830) 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a46000640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a48161140 0x7f7a48157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 -- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a48161140 msgr2=0x7f7a48157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a48161140 0x7f7a48157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 -- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4806e0a0 msgr2=0x7f7a481573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4806e0a0 0x7f7a481573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 -- 172.21.15.81:0/1107542173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480b76d0 con 0x7f7a48158b50 2024-09-10T20:40:18.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a47400640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a48158b50 0x7f7a481584f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000cb50 tx=0x7f7a4000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.703+0000 7f7a3f400640 1 -- 172.21.15.81:0/1107542173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40016020 con 0x7f7a48158b50 2024-09-10T20:40:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.704+0000 7f7a3f400640 1 -- 172.21.15.81:0/1107542173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a4000ae30 con 0x7f7a48158b50 2024-09-10T20:40:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.704+0000 7f7a3f400640 1 -- 172.21.15.81:0/1107542173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40012680 con 0x7f7a48158b50 2024-09-10T20:40:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.704+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a480b79b0 con 0x7f7a48158b50 2024-09-10T20:40:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.704+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a480b7f70 con 0x7f7a48158b50 2024-09-10T20:40:18.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.705+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a480b58e0 con 0x7f7a48158b50 2024-09-10T20:40:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.706+0000 7f7a3f400640 1 -- 172.21.15.81:0/1107542173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7a4001a3b0 con 0x7f7a48158b50 2024-09-10T20:40:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.707+0000 7f7a3f400640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7a28077fa0 0x7f7a2807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:18.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.707+0000 7f7a3f400640 1 -- 172.21.15.81:0/1107542173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7a4009a660 con 0x7f7a48158b50 2024-09-10T20:40:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.707+0000 7f7a46a00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7a28077fa0 0x7f7a2807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:18.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.708+0000 7f7a46a00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7a28077fa0 0x7f7a2807a460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a38001720 tx=0x7f7a38009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:18.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.715+0000 7f7a3f400640 1 -- 172.21.15.81:0/1107542173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7a480b58e0 con 0x7f7a48158b50 2024-09-10T20:40:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.902+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a4815bd60 con 0x7f7a28077fa0 2024-09-10T20:40:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.912+0000 7f7a3f400640 1 -- 172.21.15.81:0/1107542173 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f7a4815bd60 con 0x7f7a28077fa0 2024-09-10T20:40:18.919 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7a28077fa0 msgr2=0x7f7a2807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7a28077fa0 0x7f7a2807a460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a38001720 tx=0x7f7a38009040 comp rx=0 tx=0).stop 2024-09-10T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a48158b50 msgr2=0x7f7a481584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a48158b50 0x7f7a481584f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000cb50 tx=0x7f7a4000a430 comp rx=0 tx=0).stop 2024-09-10T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 shutdown_connections 2024-09-10T20:40:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7a28077fa0 0x7f7a2807a460 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a48158b50 0x7f7a481584f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7a48161140 0x7f7a48157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 --2- 172.21.15.81:0/1107542173 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7a4806e0a0 0x7f7a481573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 >> 172.21.15.81:0/1107542173 conn(0x7f7a480d3ab0 msgr2=0x7f7a480d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 shutdown_connections 2024-09-10T20:40:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:18.917+0000 7f7a47e00640 1 -- 172.21.15.81:0/1107542173 wait complete. 2024-09-10T20:40:18.937 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-10T20:40:17.850341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003283"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578249+0000","last_change":"2024-09-10T20:39:51.832835+0000","last_active":"2024-09-10T20:39:58.578249+0000","last_peered":"2024-09-10T20:39:58.578249+0000","last_clean":"2024-09-10T20:39:58.578249+0000","last_became_active":"2024-09-10T20:39:51.832002+0000","last_became_peered":"2024-09-10T20:39:51.832002+0000","last_unstale":"2024-09-10T20:39:58.578249+0000","last_undegraded":"2024-09-10T20:39:58.578249+0000","last_fullsized":"2024-09-10T20:39:58.578249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871856+0000","last_change":"2024-09-10T20:39:52.861599+0000","last_active":"2024-09-10T20:39:57.871856+0000","last_peered":"2024-09-10T20:39:57.871856+0000","last_clean":"2024-09-10T20:39:57.871856+0000","last_became_active":"2024-09-10T20:39:52.861276+0000","last_became_peered":"2024-09-10T20:39:52.861276+0000","last_unstale":"2024-09-10T20:39:57.871856+0000","last_undegraded":"2024-09-10T20:39:57.871856+0000","last_fullsized":"2024-09-10T20:39:57.871856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:26.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577180+0000","last_change":"2024-09-10T20:39:56.877062+0000","last_active":"2024-09-10T20:39:58.577180+0000","last_peered":"2024-09-10T20:39:58.577180+0000","last_clean":"2024-09-10T20:39:58.577180+0000","last_became_active":"2024-09-10T20:39:56.876685+0000","last_became_peered":"2024-09-10T20:39:56.876685+0000","last_unstale":"2024-09-10T20:39:58.577180+0000","last_undegraded":"2024-09-10T20:39:58.577180+0000","last_fullsized":"2024-09-10T20:39:58.577180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:57.795507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871926+0000","last_change":"2024-09-10T20:39:51.834265+0000","last_active":"2024-09-10T20:39:57.871926+0000","last_peered":"2024-09-10T20:39:57.871926+0000","last_clean":"2024-09-10T20:39:57.871926+0000","last_became_active":"2024-09-10T20:39:51.833454+0000","last_became_peered":"2024-09-10T20:39:51.833454+0000","last_unstale":"2024-09-10T20:39:57.871926+0000","last_undegraded":"2024-09-10T20:39:57.871926+0000","last_fullsized":"2024-09-10T20:39:57.871926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:16.293652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871601+0000","last_change":"2024-09-10T20:39:52.844795+0000","last_active":"2024-09-10T20:39:57.871601+0000","last_peered":"2024-09-10T20:39:57.871601+0000","last_clean":"2024-09-10T20:39:57.871601+0000","last_became_active":"2024-09-10T20:39:52.844523+0000","last_became_peered":"2024-09-10T20:39:52.844523+0000","last_unstale":"2024-09-10T20:39:57.871601+0000","last_undegraded":"2024-09-10T20:39:57.871601+0000","last_fullsized":"2024-09-10T20:39:57.871601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:29.651685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576325+0000","last_change":"2024-09-10T20:39:56.889126+0000","last_active":"2024-09-10T20:39:58.576325+0000","last_peered":"2024-09-10T20:39:58.576325+0000","last_clean":"2024-09-10T20:39:58.576325+0000","last_became_active":"2024-09-10T20:39:56.884086+0000","last_became_peered":"2024-09-10T20:39:56.884086+0000","last_unstale":"2024-09-10T20:39:58.576325+0000","last_undegraded":"2024-09-10T20:39:58.576325+0000","last_fullsized":"2024-09-10T20:39:58.576325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.634765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456681+0000","last_change":"2024-09-10T20:39:51.837410+0000","last_active":"2024-09-10T20:39:58.456681+0000","last_peered":"2024-09-10T20:39:58.456681+0000","last_clean":"2024-09-10T20:39:58.456681+0000","last_became_active":"2024-09-10T20:39:51.828041+0000","last_became_peered":"2024-09-10T20:39:51.828041+0000","last_unstale":"2024-09-10T20:39:58.456681+0000","last_undegraded":"2024-09-10T20:39:58.456681+0000","last_fullsized":"2024-09-10T20:39:58.456681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075788+0000","last_change":"2024-09-10T20:39:52.841937+0000","last_active":"2024-09-10T20:39:58.075788+0000","last_peered":"2024-09-10T20:39:58.075788+0000","last_clean":"2024-09-10T20:39:58.075788+0000","last_became_active":"2024-09-10T20:39:52.841667+0000","last_became_peered":"2024-09-10T20:39:52.841667+0000","last_unstale":"2024-09-10T20:39:58.075788+0000","last_undegraded":"2024-09-10T20:39:58.075788+0000","last_fullsized":"2024-09-10T20:39:58.075788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:38.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576484+0000","last_change":"2024-09-10T20:39:56.878639+0000","last_active":"2024-09-10T20:39:58.576484+0000","last_peered":"2024-09-10T20:39:58.576484+0000","last_clean":"2024-09-10T20:39:58.576484+0000","last_became_active":"2024-09-10T20:39:56.878151+0000","last_became_peered":"2024-09-10T20:39:56.878151+0000","last_unstale":"2024-09-10T20:39:58.576484+0000","last_undegraded":"2024-09-10T20:39:58.576484+0000","last_fullsized":"2024-09-10T20:39:58.576484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456590+0000","last_change":"2024-09-10T20:39:51.824906+0000","last_active":"2024-09-10T20:39:58.456590+0000","last_peered":"2024-09-10T20:39:58.456590+0000","last_clean":"2024-09-10T20:39:58.456590+0000","last_became_active":"2024-09-10T20:39:51.824622+0000","last_became_peered":"2024-09-10T20:39:51.824622+0000","last_unstale":"2024-09-10T20:39:58.456590+0000","last_undegraded":"2024-09-10T20:39:58.456590+0000","last_fullsized":"2024-09-10T20:39:58.456590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873160+0000","last_change":"2024-09-10T20:39:52.842836+0000","last_active":"2024-09-10T20:39:57.873160+0000","last_peered":"2024-09-10T20:39:57.873160+0000","last_clean":"2024-09-10T20:39:57.873160+0000","last_became_active":"2024-09-10T20:39:52.842556+0000","last_became_peered":"2024-09-10T20:39:52.842556+0000","last_unstale":"2024-09-10T20:39:57.873160+0000","last_undegraded":"2024-09-10T20:39:57.873160+0000","last_fullsized":"2024-09-10T20:39:57.873160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.528995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576402+0000","last_change":"2024-09-10T20:39:56.878895+0000","last_active":"2024-09-10T20:39:58.576402+0000","last_peered":"2024-09-10T20:39:58.576402+0000","last_clean":"2024-09-10T20:39:58.576402+0000","last_became_active":"2024-09-10T20:39:56.878478+0000","last_became_peered":"2024-09-10T20:39:56.878478+0000","last_unstale":"2024-09-10T20:39:58.576402+0000","last_undegraded":"2024-09-10T20:39:58.576402+0000","last_fullsized":"2024-09-10T20:39:58.576402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.002662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872865+0000","last_change":"2024-09-10T20:39:52.840391+0000","last_active":"2024-09-10T20:39:57.872865+0000","last_peered":"2024-09-10T20:39:57.872865+0000","last_clean":"2024-09-10T20:39:57.872865+0000","last_became_active":"2024-09-10T20:39:52.840140+0000","last_became_peered":"2024-09-10T20:39:52.840140+0000","last_unstale":"2024-09-10T20:39:57.872865+0000","last_undegraded":"2024-09-10T20:39:57.872865+0000","last_fullsized":"2024-09-10T20:39:57.872865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872887+0000","last_change":"2024-09-10T20:39:51.831131+0000","last_active":"2024-09-10T20:39:57.872887+0000","last_peered":"2024-09-10T20:39:57.872887+0000","last_clean":"2024-09-10T20:39:57.872887+0000","last_became_active":"2024-09-10T20:39:51.830920+0000","last_became_peered":"2024-09-10T20:39:51.830920+0000","last_unstale":"2024-09-10T20:39:57.872887+0000","last_undegraded":"2024-09-10T20:39:57.872887+0000","last_fullsized":"2024-09-10T20:39:57.872887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872932+0000","last_change":"2024-09-10T20:39:56.885978+0000","last_active":"2024-09-10T20:39:57.872932+0000","last_peered":"2024-09-10T20:39:57.872932+0000","last_clean":"2024-09-10T20:39:57.872932+0000","last_became_active":"2024-09-10T20:39:56.882428+0000","last_became_peered":"2024-09-10T20:39:56.882428+0000","last_unstale":"2024-09-10T20:39:57.872932+0000","last_undegraded":"2024-09-10T20:39:57.872932+0000","last_fullsized":"2024-09-10T20:39:57.872932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:17.375025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578529+0000","last_change":"2024-09-10T20:39:52.851120+0000","last_active":"2024-09-10T20:39:58.578529+0000","last_peered":"2024-09-10T20:39:58.578529+0000","last_clean":"2024-09-10T20:39:58.578529+0000","last_became_active":"2024-09-10T20:39:52.850838+0000","last_became_peered":"2024-09-10T20:39:52.850838+0000","last_unstale":"2024-09-10T20:39:58.578529+0000","last_undegraded":"2024-09-10T20:39:58.578529+0000","last_fullsized":"2024-09-10T20:39:58.578529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870734+0000","last_change":"2024-09-10T20:39:51.828895+0000","last_active":"2024-09-10T20:39:57.870734+0000","last_peered":"2024-09-10T20:39:57.870734+0000","last_clean":"2024-09-10T20:39:57.870734+0000","last_became_active":"2024-09-10T20:39:51.828619+0000","last_became_peered":"2024-09-10T20:39:51.828619+0000","last_unstale":"2024-09-10T20:39:57.870734+0000","last_undegraded":"2024-09-10T20:39:57.870734+0000","last_fullsized":"2024-09-10T20:39:57.870734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456333+0000","last_change":"2024-09-10T20:39:56.872443+0000","last_active":"2024-09-10T20:39:58.456333+0000","last_peered":"2024-09-10T20:39:58.456333+0000","last_clean":"2024-09-10T20:39:58.456333+0000","last_became_active":"2024-09-10T20:39:56.871357+0000","last_became_peered":"2024-09-10T20:39:56.871357+0000","last_unstale":"2024-09-10T20:39:58.456333+0000","last_undegraded":"2024-09-10T20:39:58.456333+0000","last_fullsized":"2024-09-10T20:39:58.456333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:26.208173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576821+0000","last_change":"2024-09-10T20:39:52.840929+0000","last_active":"2024-09-10T20:39:58.576821+0000","last_peered":"2024-09-10T20:39:58.576821+0000","last_clean":"2024-09-10T20:39:58.576821+0000","last_became_active":"2024-09-10T20:39:52.840635+0000","last_became_peered":"2024-09-10T20:39:52.840635+0000","last_unstale":"2024-09-10T20:39:58.576821+0000","last_undegraded":"2024-09-10T20:39:58.576821+0000","last_fullsized":"2024-09-10T20:39:58.576821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:19.765338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577744+0000","last_change":"2024-09-10T20:39:51.834045+0000","last_active":"2024-09-10T20:39:58.577744+0000","last_peered":"2024-09-10T20:39:58.577744+0000","last_clean":"2024-09-10T20:39:58.577744+0000","last_became_active":"2024-09-10T20:39:51.833137+0000","last_became_peered":"2024-09-10T20:39:51.833137+0000","last_unstale":"2024-09-10T20:39:58.577744+0000","last_undegraded":"2024-09-10T20:39:58.577744+0000","last_fullsized":"2024-09-10T20:39:58.577744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578854+0000","last_change":"2024-09-10T20:39:56.878162+0000","last_active":"2024-09-10T20:39:58.578854+0000","last_peered":"2024-09-10T20:39:58.578854+0000","last_clean":"2024-09-10T20:39:58.578854+0000","last_became_active":"2024-09-10T20:39:56.875227+0000","last_became_peered":"2024-09-10T20:39:56.875227+0000","last_unstale":"2024-09-10T20:39:58.578854+0000","last_undegraded":"2024-09-10T20:39:58.578854+0000","last_fullsized":"2024-09-10T20:39:58.578854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:47.514540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872355+0000","last_change":"2024-09-10T20:39:52.850499+0000","last_active":"2024-09-10T20:39:57.872355+0000","last_peered":"2024-09-10T20:39:57.872355+0000","last_clean":"2024-09-10T20:39:57.872355+0000","last_became_active":"2024-09-10T20:39:52.846216+0000","last_became_peered":"2024-09-10T20:39:52.846216+0000","last_unstale":"2024-09-10T20:39:57.872355+0000","last_undegraded":"2024-09-10T20:39:57.872355+0000","last_fullsized":"2024-09-10T20:39:57.872355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:42.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.455967+0000","last_change":"2024-09-10T20:39:51.828243+0000","last_active":"2024-09-10T20:39:58.455967+0000","last_peered":"2024-09-10T20:39:58.455967+0000","last_clean":"2024-09-10T20:39:58.455967+0000","last_became_active":"2024-09-10T20:39:51.827821+0000","last_became_peered":"2024-09-10T20:39:51.827821+0000","last_unstale":"2024-09-10T20:39:58.455967+0000","last_undegraded":"2024-09-10T20:39:58.455967+0000","last_fullsized":"2024-09-10T20:39:58.455967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577056+0000","last_change":"2024-09-10T20:39:56.884287+0000","last_active":"2024-09-10T20:39:58.577056+0000","last_peered":"2024-09-10T20:39:58.577056+0000","last_clean":"2024-09-10T20:39:58.577056+0000","last_became_active":"2024-09-10T20:39:56.882564+0000","last_became_peered":"2024-09-10T20:39:56.882564+0000","last_unstale":"2024-09-10T20:39:58.577056+0000","last_undegraded":"2024-09-10T20:39:58.577056+0000","last_fullsized":"2024-09-10T20:39:58.577056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577841+0000","last_change":"2024-09-10T20:39:52.838040+0000","last_active":"2024-09-10T20:39:58.577841+0000","last_peered":"2024-09-10T20:39:58.577841+0000","last_clean":"2024-09-10T20:39:58.577841+0000","last_became_active":"2024-09-10T20:39:52.837734+0000","last_became_peered":"2024-09-10T20:39:52.837734+0000","last_unstale":"2024-09-10T20:39:58.577841+0000","last_undegraded":"2024-09-10T20:39:58.577841+0000","last_fullsized":"2024-09-10T20:39:58.577841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:10.528107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873618+0000","last_change":"2024-09-10T20:39:51.844086+0000","last_active":"2024-09-10T20:39:57.873618+0000","last_peered":"2024-09-10T20:39:57.873618+0000","last_clean":"2024-09-10T20:39:57.873618+0000","last_became_active":"2024-09-10T20:39:51.843824+0000","last_became_peered":"2024-09-10T20:39:51.843824+0000","last_unstale":"2024-09-10T20:39:57.873618+0000","last_undegraded":"2024-09-10T20:39:57.873618+0000","last_fullsized":"2024-09-10T20:39:57.873618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:12.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576560+0000","last_change":"2024-09-10T20:39:56.884552+0000","last_active":"2024-09-10T20:39:58.576560+0000","last_peered":"2024-09-10T20:39:58.576560+0000","last_clean":"2024-09-10T20:39:58.576560+0000","last_became_active":"2024-09-10T20:39:56.884088+0000","last_became_peered":"2024-09-10T20:39:56.884088+0000","last_unstale":"2024-09-10T20:39:58.576560+0000","last_undegraded":"2024-09-10T20:39:58.576560+0000","last_fullsized":"2024-09-10T20:39:58.576560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578171+0000","last_change":"2024-09-10T20:39:52.850808+0000","last_active":"2024-09-10T20:39:58.578171+0000","last_peered":"2024-09-10T20:39:58.578171+0000","last_clean":"2024-09-10T20:39:58.578171+0000","last_became_active":"2024-09-10T20:39:52.850148+0000","last_became_peered":"2024-09-10T20:39:52.850148+0000","last_unstale":"2024-09-10T20:39:58.578171+0000","last_undegraded":"2024-09-10T20:39:58.578171+0000","last_fullsized":"2024-09-10T20:39:58.578171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:27.749969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578141+0000","last_change":"2024-09-10T20:39:51.835027+0000","last_active":"2024-09-10T20:39:58.578141+0000","last_peered":"2024-09-10T20:39:58.578141+0000","last_clean":"2024-09-10T20:39:58.578141+0000","last_became_active":"2024-09-10T20:39:51.833252+0000","last_became_peered":"2024-09-10T20:39:51.833252+0000","last_unstale":"2024-09-10T20:39:58.578141+0000","last_undegraded":"2024-09-10T20:39:58.578141+0000","last_fullsized":"2024-09-10T20:39:58.578141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576875+0000","last_change":"2024-09-10T20:39:56.878033+0000","last_active":"2024-09-10T20:39:58.576875+0000","last_peered":"2024-09-10T20:39:58.576875+0000","last_clean":"2024-09-10T20:39:58.576875+0000","last_became_active":"2024-09-10T20:39:56.877576+0000","last_became_peered":"2024-09-10T20:39:56.877576+0000","last_unstale":"2024-09-10T20:39:58.576875+0000","last_undegraded":"2024-09-10T20:39:58.576875+0000","last_fullsized":"2024-09-10T20:39:58.576875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870354+0000","last_change":"2024-09-10T20:39:52.859765+0000","last_active":"2024-09-10T20:39:57.870354+0000","last_peered":"2024-09-10T20:39:57.870354+0000","last_clean":"2024-09-10T20:39:57.870354+0000","last_became_active":"2024-09-10T20:39:52.858175+0000","last_became_peered":"2024-09-10T20:39:52.858175+0000","last_unstale":"2024-09-10T20:39:57.870354+0000","last_undegraded":"2024-09-10T20:39:57.870354+0000","last_fullsized":"2024-09-10T20:39:57.870354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:43.478637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873400+0000","last_change":"2024-09-10T20:39:51.836469+0000","last_active":"2024-09-10T20:39:57.873400+0000","last_peered":"2024-09-10T20:39:57.873400+0000","last_clean":"2024-09-10T20:39:57.873400+0000","last_became_active":"2024-09-10T20:39:51.835832+0000","last_became_peered":"2024-09-10T20:39:51.835832+0000","last_unstale":"2024-09-10T20:39:57.873400+0000","last_undegraded":"2024-09-10T20:39:57.873400+0000","last_fullsized":"2024-09-10T20:39:57.873400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.987131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870998+0000","last_change":"2024-09-10T20:39:56.875872+0000","last_active":"2024-09-10T20:39:57.870998+0000","last_peered":"2024-09-10T20:39:57.870998+0000","last_clean":"2024-09-10T20:39:57.870998+0000","last_became_active":"2024-09-10T20:39:56.875431+0000","last_became_peered":"2024-09-10T20:39:56.875431+0000","last_unstale":"2024-09-10T20:39:57.870998+0000","last_undegraded":"2024-09-10T20:39:57.870998+0000","last_fullsized":"2024-09-10T20:39:57.870998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576757+0000","last_change":"2024-09-10T20:39:52.865010+0000","last_active":"2024-09-10T20:39:58.576757+0000","last_peered":"2024-09-10T20:39:58.576757+0000","last_clean":"2024-09-10T20:39:58.576757+0000","last_became_active":"2024-09-10T20:39:52.859434+0000","last_became_peered":"2024-09-10T20:39:52.859434+0000","last_unstale":"2024-09-10T20:39:58.576757+0000","last_undegraded":"2024-09-10T20:39:58.576757+0000","last_fullsized":"2024-09-10T20:39:58.576757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871107+0000","last_change":"2024-09-10T20:39:51.827144+0000","last_active":"2024-09-10T20:39:57.871107+0000","last_peered":"2024-09-10T20:39:57.871107+0000","last_clean":"2024-09-10T20:39:57.871107+0000","last_became_active":"2024-09-10T20:39:51.826880+0000","last_became_peered":"2024-09-10T20:39:51.826880+0000","last_unstale":"2024-09-10T20:39:57.871107+0000","last_undegraded":"2024-09-10T20:39:57.871107+0000","last_fullsized":"2024-09-10T20:39:57.871107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:45.750240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870236+0000","last_change":"2024-09-10T20:39:56.882585+0000","last_active":"2024-09-10T20:39:57.870236+0000","last_peered":"2024-09-10T20:39:57.870236+0000","last_clean":"2024-09-10T20:39:57.870236+0000","last_became_active":"2024-09-10T20:39:56.882093+0000","last_became_peered":"2024-09-10T20:39:56.882093+0000","last_unstale":"2024-09-10T20:39:57.870236+0000","last_undegraded":"2024-09-10T20:39:57.870236+0000","last_fullsized":"2024-09-10T20:39:57.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456325+0000","last_change":"2024-09-10T20:39:52.861639+0000","last_active":"2024-09-10T20:39:58.456325+0000","last_peered":"2024-09-10T20:39:58.456325+0000","last_clean":"2024-09-10T20:39:58.456325+0000","last_became_active":"2024-09-10T20:39:52.861383+0000","last_became_peered":"2024-09-10T20:39:52.861383+0000","last_unstale":"2024-09-10T20:39:58.456325+0000","last_undegraded":"2024-09-10T20:39:58.456325+0000","last_fullsized":"2024-09-10T20:39:58.456325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:47.156926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872896+0000","last_change":"2024-09-10T20:39:51.835770+0000","last_active":"2024-09-10T20:39:57.872896+0000","last_peered":"2024-09-10T20:39:57.872896+0000","last_clean":"2024-09-10T20:39:57.872896+0000","last_became_active":"2024-09-10T20:39:51.835470+0000","last_became_peered":"2024-09-10T20:39:51.835470+0000","last_unstale":"2024-09-10T20:39:57.872896+0000","last_undegraded":"2024-09-10T20:39:57.872896+0000","last_fullsized":"2024-09-10T20:39:57.872896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:38.530675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870076+0000","last_change":"2024-09-10T20:39:56.882138+0000","last_active":"2024-09-10T20:39:57.870076+0000","last_peered":"2024-09-10T20:39:57.870076+0000","last_clean":"2024-09-10T20:39:57.870076+0000","last_became_active":"2024-09-10T20:39:56.875117+0000","last_became_peered":"2024-09-10T20:39:56.875117+0000","last_unstale":"2024-09-10T20:39:57.870076+0000","last_undegraded":"2024-09-10T20:39:57.870076+0000","last_fullsized":"2024-09-10T20:39:57.870076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869855+0000","last_change":"2024-09-10T20:39:52.842774+0000","last_active":"2024-09-10T20:39:57.869855+0000","last_peered":"2024-09-10T20:39:57.869855+0000","last_clean":"2024-09-10T20:39:57.869855+0000","last_became_active":"2024-09-10T20:39:52.842446+0000","last_became_peered":"2024-09-10T20:39:52.842446+0000","last_unstale":"2024-09-10T20:39:57.869855+0000","last_undegraded":"2024-09-10T20:39:57.869855+0000","last_fullsized":"2024-09-10T20:39:57.869855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:29.034488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577469+0000","last_change":"2024-09-10T20:39:51.834088+0000","last_active":"2024-09-10T20:39:58.577469+0000","last_peered":"2024-09-10T20:39:58.577469+0000","last_clean":"2024-09-10T20:39:58.577469+0000","last_became_active":"2024-09-10T20:39:51.830213+0000","last_became_peered":"2024-09-10T20:39:51.830213+0000","last_unstale":"2024-09-10T20:39:58.577469+0000","last_undegraded":"2024-09-10T20:39:58.577469+0000","last_fullsized":"2024-09-10T20:39:58.577469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:08.073166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871242+0000","last_change":"2024-09-10T20:39:56.876963+0000","last_active":"2024-09-10T20:39:57.871242+0000","last_peered":"2024-09-10T20:39:57.871242+0000","last_clean":"2024-09-10T20:39:57.871242+0000","last_became_active":"2024-09-10T20:39:56.876565+0000","last_became_peered":"2024-09-10T20:39:56.876565+0000","last_unstale":"2024-09-10T20:39:57.871242+0000","last_undegraded":"2024-09-10T20:39:57.871242+0000","last_fullsized":"2024-09-10T20:39:57.871242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869844+0000","last_change":"2024-09-10T20:39:52.860096+0000","last_active":"2024-09-10T20:39:57.869844+0000","last_peered":"2024-09-10T20:39:57.869844+0000","last_clean":"2024-09-10T20:39:57.869844+0000","last_became_active":"2024-09-10T20:39:52.859815+0000","last_became_peered":"2024-09-10T20:39:52.859815+0000","last_unstale":"2024-09-10T20:39:57.869844+0000","last_undegraded":"2024-09-10T20:39:57.869844+0000","last_fullsized":"2024-09-10T20:39:57.869844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:02.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872428+0000","last_change":"2024-09-10T20:39:51.837166+0000","last_active":"2024-09-10T20:39:57.872428+0000","last_peered":"2024-09-10T20:39:57.872428+0000","last_clean":"2024-09-10T20:39:57.872428+0000","last_became_active":"2024-09-10T20:39:51.836893+0000","last_became_peered":"2024-09-10T20:39:51.836893+0000","last_unstale":"2024-09-10T20:39:57.872428+0000","last_undegraded":"2024-09-10T20:39:57.872428+0000","last_fullsized":"2024-09-10T20:39:57.872428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:18.758447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871780+0000","last_change":"2024-09-10T20:39:56.874406+0000","last_active":"2024-09-10T20:39:57.871780+0000","last_peered":"2024-09-10T20:39:57.871780+0000","last_clean":"2024-09-10T20:39:57.871780+0000","last_became_active":"2024-09-10T20:39:56.874005+0000","last_became_peered":"2024-09-10T20:39:56.874005+0000","last_unstale":"2024-09-10T20:39:57.871780+0000","last_undegraded":"2024-09-10T20:39:57.871780+0000","last_fullsized":"2024-09-10T20:39:57.871780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:19.234557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577223+0000","last_change":"2024-09-10T20:39:52.860106+0000","last_active":"2024-09-10T20:39:58.577223+0000","last_peered":"2024-09-10T20:39:58.577223+0000","last_clean":"2024-09-10T20:39:58.577223+0000","last_became_active":"2024-09-10T20:39:52.859856+0000","last_became_peered":"2024-09-10T20:39:52.859856+0000","last_unstale":"2024-09-10T20:39:58.577223+0000","last_undegraded":"2024-09-10T20:39:58.577223+0000","last_fullsized":"2024-09-10T20:39:58.577223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872964+0000","last_change":"2024-09-10T20:39:51.830052+0000","last_active":"2024-09-10T20:39:57.872964+0000","last_peered":"2024-09-10T20:39:57.872964+0000","last_clean":"2024-09-10T20:39:57.872964+0000","last_became_active":"2024-09-10T20:39:51.829826+0000","last_became_peered":"2024-09-10T20:39:51.829826+0000","last_unstale":"2024-09-10T20:39:57.872964+0000","last_undegraded":"2024-09-10T20:39:57.872964+0000","last_fullsized":"2024-09-10T20:39:57.872964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075483+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:39:58.075483+0000","last_peered":"2024-09-10T20:39:58.075483+0000","last_clean":"2024-09-10T20:39:58.075483+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:39:58.075483+0000","last_undegraded":"2024-09-10T20:39:58.075483+0000","last_fullsized":"2024-09-10T20:39:58.075483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873275+0000","last_change":"2024-09-10T20:39:56.886319+0000","last_active":"2024-09-10T20:39:57.873275+0000","last_peered":"2024-09-10T20:39:57.873275+0000","last_clean":"2024-09-10T20:39:57.873275+0000","last_became_active":"2024-09-10T20:39:56.884644+0000","last_became_peered":"2024-09-10T20:39:56.884644+0000","last_unstale":"2024-09-10T20:39:57.873275+0000","last_undegraded":"2024-09-10T20:39:57.873275+0000","last_fullsized":"2024-09-10T20:39:57.873275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.635249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873205+0000","last_change":"2024-09-10T20:39:52.841498+0000","last_active":"2024-09-10T20:39:57.873205+0000","last_peered":"2024-09-10T20:39:57.873205+0000","last_clean":"2024-09-10T20:39:57.873205+0000","last_became_active":"2024-09-10T20:39:52.841257+0000","last_became_peered":"2024-09-10T20:39:52.841257+0000","last_unstale":"2024-09-10T20:39:57.873205+0000","last_undegraded":"2024-09-10T20:39:57.873205+0000","last_fullsized":"2024-09-10T20:39:57.873205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:56.841902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870555+0000","last_change":"2024-09-10T20:39:51.831320+0000","last_active":"2024-09-10T20:39:57.870555+0000","last_peered":"2024-09-10T20:39:57.870555+0000","last_clean":"2024-09-10T20:39:57.870555+0000","last_became_active":"2024-09-10T20:39:51.831030+0000","last_became_peered":"2024-09-10T20:39:51.831030+0000","last_unstale":"2024-09-10T20:39:57.870555+0000","last_undegraded":"2024-09-10T20:39:57.870555+0000","last_fullsized":"2024-09-10T20:39:57.870555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576384+0000","last_change":"2024-09-10T20:39:56.876055+0000","last_active":"2024-09-10T20:39:58.576384+0000","last_peered":"2024-09-10T20:39:58.576384+0000","last_clean":"2024-09-10T20:39:58.576384+0000","last_became_active":"2024-09-10T20:39:56.875602+0000","last_became_peered":"2024-09-10T20:39:56.875602+0000","last_unstale":"2024-09-10T20:39:58.576384+0000","last_undegraded":"2024-09-10T20:39:58.576384+0000","last_fullsized":"2024-09-10T20:39:58.576384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:01.886686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456584+0000","last_change":"2024-09-10T20:39:52.856423+0000","last_active":"2024-09-10T20:39:58.456584+0000","last_peered":"2024-09-10T20:39:58.456584+0000","last_clean":"2024-09-10T20:39:58.456584+0000","last_became_active":"2024-09-10T20:39:52.855409+0000","last_became_peered":"2024-09-10T20:39:52.855409+0000","last_unstale":"2024-09-10T20:39:58.456584+0000","last_undegraded":"2024-09-10T20:39:58.456584+0000","last_fullsized":"2024-09-10T20:39:58.456584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:35.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871541+0000","last_change":"2024-09-10T20:39:51.833978+0000","last_active":"2024-09-10T20:39:57.871541+0000","last_peered":"2024-09-10T20:39:57.871541+0000","last_clean":"2024-09-10T20:39:57.871541+0000","last_became_active":"2024-09-10T20:39:51.833436+0000","last_became_peered":"2024-09-10T20:39:51.833436+0000","last_unstale":"2024-09-10T20:39:57.871541+0000","last_undegraded":"2024-09-10T20:39:57.871541+0000","last_fullsized":"2024-09-10T20:39:57.871541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:00.812828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870986+0000","last_change":"2024-09-10T20:39:56.879933+0000","last_active":"2024-09-10T20:39:57.870986+0000","last_peered":"2024-09-10T20:39:57.870986+0000","last_clean":"2024-09-10T20:39:57.870986+0000","last_became_active":"2024-09-10T20:39:56.879254+0000","last_became_peered":"2024-09-10T20:39:56.879254+0000","last_unstale":"2024-09-10T20:39:57.870986+0000","last_undegraded":"2024-09-10T20:39:57.870986+0000","last_fullsized":"2024-09-10T20:39:57.870986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:10.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456878+0000","last_change":"2024-09-10T20:39:52.852816+0000","last_active":"2024-09-10T20:39:58.456878+0000","last_peered":"2024-09-10T20:39:58.456878+0000","last_clean":"2024-09-10T20:39:58.456878+0000","last_became_active":"2024-09-10T20:39:52.851310+0000","last_became_peered":"2024-09-10T20:39:52.851310+0000","last_unstale":"2024-09-10T20:39:58.456878+0000","last_undegraded":"2024-09-10T20:39:58.456878+0000","last_fullsized":"2024-09-10T20:39:58.456878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577993+0000","last_change":"2024-09-10T20:39:51.831688+0000","last_active":"2024-09-10T20:39:58.577993+0000","last_peered":"2024-09-10T20:39:58.577993+0000","last_clean":"2024-09-10T20:39:58.577993+0000","last_became_active":"2024-09-10T20:39:51.827155+0000","last_became_peered":"2024-09-10T20:39:51.827155+0000","last_unstale":"2024-09-10T20:39:58.577993+0000","last_undegraded":"2024-09-10T20:39:58.577993+0000","last_fullsized":"2024-09-10T20:39:58.577993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872194+0000","last_change":"2024-09-10T20:39:56.882581+0000","last_active":"2024-09-10T20:39:57.872194+0000","last_peered":"2024-09-10T20:39:57.872194+0000","last_clean":"2024-09-10T20:39:57.872194+0000","last_became_active":"2024-09-10T20:39:56.882242+0000","last_became_peered":"2024-09-10T20:39:56.882242+0000","last_unstale":"2024-09-10T20:39:57.872194+0000","last_undegraded":"2024-09-10T20:39:57.872194+0000","last_fullsized":"2024-09-10T20:39:57.872194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:18.763655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577376+0000","last_change":"2024-09-10T20:39:52.858795+0000","last_active":"2024-09-10T20:39:58.577376+0000","last_peered":"2024-09-10T20:39:58.577376+0000","last_clean":"2024-09-10T20:39:58.577376+0000","last_became_active":"2024-09-10T20:39:52.858501+0000","last_became_peered":"2024-09-10T20:39:52.858501+0000","last_unstale":"2024-09-10T20:39:58.577376+0000","last_undegraded":"2024-09-10T20:39:58.577376+0000","last_fullsized":"2024-09-10T20:39:58.577376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:13.273835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456897+0000","last_change":"2024-09-10T20:39:51.838792+0000","last_active":"2024-09-10T20:39:58.456897+0000","last_peered":"2024-09-10T20:39:58.456897+0000","last_clean":"2024-09-10T20:39:58.456897+0000","last_became_active":"2024-09-10T20:39:51.838547+0000","last_became_peered":"2024-09-10T20:39:51.838547+0000","last_unstale":"2024-09-10T20:39:58.456897+0000","last_undegraded":"2024-09-10T20:39:58.456897+0000","last_fullsized":"2024-09-10T20:39:58.456897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075650+0000","last_change":"2024-09-10T20:39:56.872369+0000","last_active":"2024-09-10T20:39:58.075650+0000","last_peered":"2024-09-10T20:39:58.075650+0000","last_clean":"2024-09-10T20:39:58.075650+0000","last_became_active":"2024-09-10T20:39:56.871964+0000","last_became_peered":"2024-09-10T20:39:56.871964+0000","last_unstale":"2024-09-10T20:39:58.075650+0000","last_undegraded":"2024-09-10T20:39:58.075650+0000","last_fullsized":"2024-09-10T20:39:58.075650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:17.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872297+0000","last_change":"2024-09-10T20:39:52.848064+0000","last_active":"2024-09-10T20:39:57.872297+0000","last_peered":"2024-09-10T20:39:57.872297+0000","last_clean":"2024-09-10T20:39:57.872297+0000","last_became_active":"2024-09-10T20:39:52.847836+0000","last_became_peered":"2024-09-10T20:39:52.847836+0000","last_unstale":"2024-09-10T20:39:57.872297+0000","last_undegraded":"2024-09-10T20:39:57.872297+0000","last_fullsized":"2024-09-10T20:39:57.872297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:17.051921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577568+0000","last_change":"2024-09-10T20:39:51.827434+0000","last_active":"2024-09-10T20:39:58.577568+0000","last_peered":"2024-09-10T20:39:58.577568+0000","last_clean":"2024-09-10T20:39:58.577568+0000","last_became_active":"2024-09-10T20:39:51.826046+0000","last_became_peered":"2024-09-10T20:39:51.826046+0000","last_unstale":"2024-09-10T20:39:58.577568+0000","last_undegraded":"2024-09-10T20:39:58.577568+0000","last_fullsized":"2024-09-10T20:39:58.577568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871947+0000","last_change":"2024-09-10T20:39:56.879394+0000","last_active":"2024-09-10T20:39:57.871947+0000","last_peered":"2024-09-10T20:39:57.871947+0000","last_clean":"2024-09-10T20:39:57.871947+0000","last_became_active":"2024-09-10T20:39:56.879041+0000","last_became_peered":"2024-09-10T20:39:56.879041+0000","last_unstale":"2024-09-10T20:39:57.871947+0000","last_undegraded":"2024-09-10T20:39:57.871947+0000","last_fullsized":"2024-09-10T20:39:57.871947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:42.040215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075444+0000","last_change":"2024-09-10T20:39:52.836545+0000","last_active":"2024-09-10T20:39:58.075444+0000","last_peered":"2024-09-10T20:39:58.075444+0000","last_clean":"2024-09-10T20:39:58.075444+0000","last_became_active":"2024-09-10T20:39:52.836266+0000","last_became_peered":"2024-09-10T20:39:52.836266+0000","last_unstale":"2024-09-10T20:39:58.075444+0000","last_undegraded":"2024-09-10T20:39:58.075444+0000","last_fullsized":"2024-09-10T20:39:58.075444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:39.345060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456157+0000","last_change":"2024-09-10T20:39:51.833755+0000","last_active":"2024-09-10T20:39:58.456157+0000","last_peered":"2024-09-10T20:39:58.456157+0000","last_clean":"2024-09-10T20:39:58.456157+0000","last_became_active":"2024-09-10T20:39:51.833384+0000","last_became_peered":"2024-09-10T20:39:51.833384+0000","last_unstale":"2024-09-10T20:39:58.456157+0000","last_undegraded":"2024-09-10T20:39:58.456157+0000","last_fullsized":"2024-09-10T20:39:58.456157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871522+0000","last_change":"2024-09-10T20:39:56.876669+0000","last_active":"2024-09-10T20:39:57.871522+0000","last_peered":"2024-09-10T20:39:57.871522+0000","last_clean":"2024-09-10T20:39:57.871522+0000","last_became_active":"2024-09-10T20:39:56.876230+0000","last_became_peered":"2024-09-10T20:39:56.876230+0000","last_unstale":"2024-09-10T20:39:57.871522+0000","last_undegraded":"2024-09-10T20:39:57.871522+0000","last_fullsized":"2024-09-10T20:39:57.871522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:04.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872716+0000","last_change":"2024-09-10T20:39:52.840978+0000","last_active":"2024-09-10T20:39:57.872716+0000","last_peered":"2024-09-10T20:39:57.872716+0000","last_clean":"2024-09-10T20:39:57.872716+0000","last_became_active":"2024-09-10T20:39:52.840710+0000","last_became_peered":"2024-09-10T20:39:52.840710+0000","last_unstale":"2024-09-10T20:39:57.872716+0000","last_undegraded":"2024-09-10T20:39:57.872716+0000","last_fullsized":"2024-09-10T20:39:57.872716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:17.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872789+0000","last_change":"2024-09-10T20:39:51.837821+0000","last_active":"2024-09-10T20:39:57.872789+0000","last_peered":"2024-09-10T20:39:57.872789+0000","last_clean":"2024-09-10T20:39:57.872789+0000","last_became_active":"2024-09-10T20:39:51.836390+0000","last_became_peered":"2024-09-10T20:39:51.836390+0000","last_unstale":"2024-09-10T20:39:57.872789+0000","last_undegraded":"2024-09-10T20:39:57.872789+0000","last_fullsized":"2024-09-10T20:39:57.872789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:47.684343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869817+0000","last_change":"2024-09-10T20:39:56.875780+0000","last_active":"2024-09-10T20:39:57.869817+0000","last_peered":"2024-09-10T20:39:57.869817+0000","last_clean":"2024-09-10T20:39:57.869817+0000","last_became_active":"2024-09-10T20:39:56.875088+0000","last_became_peered":"2024-09-10T20:39:56.875088+0000","last_unstale":"2024-09-10T20:39:57.869817+0000","last_undegraded":"2024-09-10T20:39:57.869817+0000","last_fullsized":"2024-09-10T20:39:57.869817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:21.298196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870634+0000","last_change":"2024-09-10T20:39:52.856029+0000","last_active":"2024-09-10T20:39:57.870634+0000","last_peered":"2024-09-10T20:39:57.870634+0000","last_clean":"2024-09-10T20:39:57.870634+0000","last_became_active":"2024-09-10T20:39:52.855776+0000","last_became_peered":"2024-09-10T20:39:52.855776+0000","last_unstale":"2024-09-10T20:39:57.870634+0000","last_undegraded":"2024-09-10T20:39:57.870634+0000","last_fullsized":"2024-09-10T20:39:57.870634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:31.338948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578682+0000","last_change":"2024-09-10T20:39:51.828785+0000","last_active":"2024-09-10T20:39:58.578682+0000","last_peered":"2024-09-10T20:39:58.578682+0000","last_clean":"2024-09-10T20:39:58.578682+0000","last_became_active":"2024-09-10T20:39:51.828496+0000","last_became_peered":"2024-09-10T20:39:51.828496+0000","last_unstale":"2024-09-10T20:39:58.578682+0000","last_undegraded":"2024-09-10T20:39:58.578682+0000","last_fullsized":"2024-09-10T20:39:58.578682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:36.547419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873081+0000","last_change":"2024-09-10T20:39:56.885656+0000","last_active":"2024-09-10T20:39:57.873081+0000","last_peered":"2024-09-10T20:39:57.873081+0000","last_clean":"2024-09-10T20:39:57.873081+0000","last_became_active":"2024-09-10T20:39:56.881762+0000","last_became_peered":"2024-09-10T20:39:56.881762+0000","last_unstale":"2024-09-10T20:39:57.873081+0000","last_undegraded":"2024-09-10T20:39:57.873081+0000","last_fullsized":"2024-09-10T20:39:57.873081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:42.541386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456583+0000","last_change":"2024-09-10T20:39:52.851647+0000","last_active":"2024-09-10T20:39:58.456583+0000","last_peered":"2024-09-10T20:39:58.456583+0000","last_clean":"2024-09-10T20:39:58.456583+0000","last_became_active":"2024-09-10T20:39:52.851358+0000","last_became_peered":"2024-09-10T20:39:52.851358+0000","last_unstale":"2024-09-10T20:39:58.456583+0000","last_undegraded":"2024-09-10T20:39:58.456583+0000","last_fullsized":"2024-09-10T20:39:58.456583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:43.399295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:40:04.050528+0000","last_change":"2024-09-10T20:39:51.836741+0000","last_active":"2024-09-10T20:40:04.050528+0000","last_peered":"2024-09-10T20:40:04.050528+0000","last_clean":"2024-09-10T20:40:04.050528+0000","last_became_active":"2024-09-10T20:39:51.836492+0000","last_became_peered":"2024-09-10T20:39:51.836492+0000","last_unstale":"2024-09-10T20:40:04.050528+0000","last_undegraded":"2024-09-10T20:40:04.050528+0000","last_fullsized":"2024-09-10T20:40:04.050528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.827648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577118+0000","last_change":"2024-09-10T20:39:56.870600+0000","last_active":"2024-09-10T20:39:58.577118+0000","last_peered":"2024-09-10T20:39:58.577118+0000","last_clean":"2024-09-10T20:39:58.577118+0000","last_became_active":"2024-09-10T20:39:56.870128+0000","last_became_peered":"2024-09-10T20:39:56.870128+0000","last_unstale":"2024-09-10T20:39:58.577118+0000","last_undegraded":"2024-09-10T20:39:58.577118+0000","last_fullsized":"2024-09-10T20:39:58.577118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872529+0000","last_change":"2024-09-10T20:39:52.867767+0000","last_active":"2024-09-10T20:39:57.872529+0000","last_peered":"2024-09-10T20:39:57.872529+0000","last_clean":"2024-09-10T20:39:57.872529+0000","last_became_active":"2024-09-10T20:39:52.867458+0000","last_became_peered":"2024-09-10T20:39:52.867458+0000","last_unstale":"2024-09-10T20:39:57.872529+0000","last_undegraded":"2024-09-10T20:39:57.872529+0000","last_fullsized":"2024-09-10T20:39:57.872529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.084789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578769+0000","last_change":"2024-09-10T20:39:51.836668+0000","last_active":"2024-09-10T20:39:58.578769+0000","last_peered":"2024-09-10T20:39:58.578769+0000","last_clean":"2024-09-10T20:39:58.578769+0000","last_became_active":"2024-09-10T20:39:51.835742+0000","last_became_peered":"2024-09-10T20:39:51.835742+0000","last_unstale":"2024-09-10T20:39:58.578769+0000","last_undegraded":"2024-09-10T20:39:58.578769+0000","last_fullsized":"2024-09-10T20:39:58.578769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576664+0000","last_change":"2024-09-10T20:39:56.882037+0000","last_active":"2024-09-10T20:39:58.576664+0000","last_peered":"2024-09-10T20:39:58.576664+0000","last_clean":"2024-09-10T20:39:58.576664+0000","last_became_active":"2024-09-10T20:39:56.881084+0000","last_became_peered":"2024-09-10T20:39:56.881084+0000","last_unstale":"2024-09-10T20:39:58.576664+0000","last_undegraded":"2024-09-10T20:39:58.576664+0000","last_fullsized":"2024-09-10T20:39:58.576664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871674+0000","last_change":"2024-09-10T20:39:52.849174+0000","last_active":"2024-09-10T20:39:57.871674+0000","last_peered":"2024-09-10T20:39:57.871674+0000","last_clean":"2024-09-10T20:39:57.871674+0000","last_became_active":"2024-09-10T20:39:52.848762+0000","last_became_peered":"2024-09-10T20:39:52.848762+0000","last_unstale":"2024-09-10T20:39:57.871674+0000","last_undegraded":"2024-09-10T20:39:57.871674+0000","last_fullsized":"2024-09-10T20:39:57.871674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:16.849067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456678+0000","last_change":"2024-09-10T20:39:51.827946+0000","last_active":"2024-09-10T20:39:58.456678+0000","last_peered":"2024-09-10T20:39:58.456678+0000","last_clean":"2024-09-10T20:39:58.456678+0000","last_became_active":"2024-09-10T20:39:51.827668+0000","last_became_peered":"2024-09-10T20:39:51.827668+0000","last_unstale":"2024-09-10T20:39:58.456678+0000","last_undegraded":"2024-09-10T20:39:58.456678+0000","last_fullsized":"2024-09-10T20:39:58.456678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576917+0000","last_change":"2024-09-10T20:39:56.890560+0000","last_active":"2024-09-10T20:39:58.576917+0000","last_peered":"2024-09-10T20:39:58.576917+0000","last_clean":"2024-09-10T20:39:58.576917+0000","last_became_active":"2024-09-10T20:39:56.890207+0000","last_became_peered":"2024-09-10T20:39:56.890207+0000","last_unstale":"2024-09-10T20:39:58.576917+0000","last_undegraded":"2024-09-10T20:39:58.576917+0000","last_fullsized":"2024-09-10T20:39:58.576917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:35.374852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577293+0000","last_change":"2024-09-10T20:39:52.865954+0000","last_active":"2024-09-10T20:39:58.577293+0000","last_peered":"2024-09-10T20:39:58.577293+0000","last_clean":"2024-09-10T20:39:58.577293+0000","last_became_active":"2024-09-10T20:39:52.865077+0000","last_became_peered":"2024-09-10T20:39:52.865077+0000","last_unstale":"2024-09-10T20:39:58.577293+0000","last_undegraded":"2024-09-10T20:39:58.577293+0000","last_fullsized":"2024-09-10T20:39:58.577293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:20.726727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076179+0000","last_change":"2024-09-10T20:39:51.822729+0000","last_active":"2024-09-10T20:39:58.076179+0000","last_peered":"2024-09-10T20:39:58.076179+0000","last_clean":"2024-09-10T20:39:58.076179+0000","last_became_active":"2024-09-10T20:39:51.822465+0000","last_became_peered":"2024-09-10T20:39:51.822465+0000","last_unstale":"2024-09-10T20:39:58.076179+0000","last_undegraded":"2024-09-10T20:39:58.076179+0000","last_fullsized":"2024-09-10T20:39:58.076179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577450+0000","last_change":"2024-09-10T20:39:56.871160+0000","last_active":"2024-09-10T20:39:58.577450+0000","last_peered":"2024-09-10T20:39:58.577450+0000","last_clean":"2024-09-10T20:39:58.577450+0000","last_became_active":"2024-09-10T20:39:56.870762+0000","last_became_peered":"2024-09-10T20:39:56.870762+0000","last_unstale":"2024-09-10T20:39:58.577450+0000","last_undegraded":"2024-09-10T20:39:58.577450+0000","last_fullsized":"2024-09-10T20:39:58.577450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:40.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577908+0000","last_change":"2024-09-10T20:39:56.875335+0000","last_active":"2024-09-10T20:39:58.577908+0000","last_peered":"2024-09-10T20:39:58.577908+0000","last_clean":"2024-09-10T20:39:58.577908+0000","last_became_active":"2024-09-10T20:39:56.874929+0000","last_became_peered":"2024-09-10T20:39:56.874929+0000","last_unstale":"2024-09-10T20:39:58.577908+0000","last_undegraded":"2024-09-10T20:39:58.577908+0000","last_fullsized":"2024-09-10T20:39:58.577908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:00.877805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577652+0000","last_change":"2024-09-10T20:39:52.841133+0000","last_active":"2024-09-10T20:39:58.577652+0000","last_peered":"2024-09-10T20:39:58.577652+0000","last_clean":"2024-09-10T20:39:58.577652+0000","last_became_active":"2024-09-10T20:39:52.840806+0000","last_became_peered":"2024-09-10T20:39:52.840806+0000","last_unstale":"2024-09-10T20:39:58.577652+0000","last_undegraded":"2024-09-10T20:39:58.577652+0000","last_fullsized":"2024-09-10T20:39:58.577652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:22.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872394+0000","last_change":"2024-09-10T20:39:51.834171+0000","last_active":"2024-09-10T20:39:57.872394+0000","last_peered":"2024-09-10T20:39:57.872394+0000","last_clean":"2024-09-10T20:39:57.872394+0000","last_became_active":"2024-09-10T20:39:51.833897+0000","last_became_peered":"2024-09-10T20:39:51.833897+0000","last_unstale":"2024-09-10T20:39:57.872394+0000","last_undegraded":"2024-09-10T20:39:57.872394+0000","last_fullsized":"2024-09-10T20:39:57.872394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:19.719836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872638+0000","last_change":"2024-09-10T20:39:56.872254+0000","last_active":"2024-09-10T20:39:57.872638+0000","last_peered":"2024-09-10T20:39:57.872638+0000","last_clean":"2024-09-10T20:39:57.872638+0000","last_became_active":"2024-09-10T20:39:56.871890+0000","last_became_peered":"2024-09-10T20:39:56.871890+0000","last_unstale":"2024-09-10T20:39:57.872638+0000","last_undegraded":"2024-09-10T20:39:57.872638+0000","last_fullsized":"2024-09-10T20:39:57.872638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:13.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869957+0000","last_change":"2024-09-10T20:39:52.851621+0000","last_active":"2024-09-10T20:39:57.869957+0000","last_peered":"2024-09-10T20:39:57.869957+0000","last_clean":"2024-09-10T20:39:57.869957+0000","last_became_active":"2024-09-10T20:39:52.851307+0000","last_became_peered":"2024-09-10T20:39:52.851307+0000","last_unstale":"2024-09-10T20:39:57.869957+0000","last_undegraded":"2024-09-10T20:39:57.869957+0000","last_fullsized":"2024-09-10T20:39:57.869957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:02.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869951+0000","last_change":"2024-09-10T20:39:51.832088+0000","last_active":"2024-09-10T20:39:57.869951+0000","last_peered":"2024-09-10T20:39:57.869951+0000","last_clean":"2024-09-10T20:39:57.869951+0000","last_became_active":"2024-09-10T20:39:51.831590+0000","last_became_peered":"2024-09-10T20:39:51.831590+0000","last_unstale":"2024-09-10T20:39:57.869951+0000","last_undegraded":"2024-09-10T20:39:57.869951+0000","last_fullsized":"2024-09-10T20:39:57.869951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:11.450509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872645+0000","last_change":"2024-09-10T20:39:51.841531+0000","last_active":"2024-09-10T20:39:57.872645+0000","last_peered":"2024-09-10T20:39:57.872645+0000","last_clean":"2024-09-10T20:39:57.872645+0000","last_became_active":"2024-09-10T20:39:51.841294+0000","last_became_peered":"2024-09-10T20:39:51.841294+0000","last_unstale":"2024-09-10T20:39:57.872645+0000","last_undegraded":"2024-09-10T20:39:57.872645+0000","last_fullsized":"2024-09-10T20:39:57.872645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.838524+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.838252+0000","last_became_peered":"2024-09-10T20:39:52.838252+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:32.234408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577531+0000","last_change":"2024-09-10T20:39:56.874073+0000","last_active":"2024-09-10T20:39:58.577531+0000","last_peered":"2024-09-10T20:39:58.577531+0000","last_clean":"2024-09-10T20:39:58.577531+0000","last_became_active":"2024-09-10T20:39:56.873456+0000","last_became_peered":"2024-09-10T20:39:56.873456+0000","last_unstale":"2024-09-10T20:39:58.577531+0000","last_undegraded":"2024-09-10T20:39:58.577531+0000","last_fullsized":"2024-09-10T20:39:58.577531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:51.097723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870967+0000","last_change":"2024-09-10T20:39:51.823981+0000","last_active":"2024-09-10T20:39:57.870967+0000","last_peered":"2024-09-10T20:39:57.870967+0000","last_clean":"2024-09-10T20:39:57.870967+0000","last_became_active":"2024-09-10T20:39:51.823667+0000","last_became_peered":"2024-09-10T20:39:51.823667+0000","last_unstale":"2024-09-10T20:39:57.870967+0000","last_undegraded":"2024-09-10T20:39:57.870967+0000","last_fullsized":"2024-09-10T20:39:57.870967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:53.926735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075527+0000","last_change":"2024-09-10T20:39:52.842250+0000","last_active":"2024-09-10T20:39:58.075527+0000","last_peered":"2024-09-10T20:39:58.075527+0000","last_clean":"2024-09-10T20:39:58.075527+0000","last_became_active":"2024-09-10T20:39:52.842013+0000","last_became_peered":"2024-09-10T20:39:52.842013+0000","last_unstale":"2024-09-10T20:39:58.075527+0000","last_undegraded":"2024-09-10T20:39:58.075527+0000","last_fullsized":"2024-09-10T20:39:58.075527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:19.358235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578569+0000","last_change":"2024-09-10T20:39:56.873781+0000","last_active":"2024-09-10T20:39:58.578569+0000","last_peered":"2024-09-10T20:39:58.578569+0000","last_clean":"2024-09-10T20:39:58.578569+0000","last_became_active":"2024-09-10T20:39:56.871150+0000","last_became_peered":"2024-09-10T20:39:56.871150+0000","last_unstale":"2024-09-10T20:39:58.578569+0000","last_undegraded":"2024-09-10T20:39:58.578569+0000","last_fullsized":"2024-09-10T20:39:58.578569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:03.889499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576369+0000","last_change":"2024-09-10T20:39:52.858032+0000","last_active":"2024-09-10T20:39:58.576369+0000","last_peered":"2024-09-10T20:39:58.576369+0000","last_clean":"2024-09-10T20:39:58.576369+0000","last_became_active":"2024-09-10T20:39:52.851049+0000","last_became_peered":"2024-09-10T20:39:52.851049+0000","last_unstale":"2024-09-10T20:39:58.576369+0000","last_undegraded":"2024-09-10T20:39:58.576369+0000","last_fullsized":"2024-09-10T20:39:58.576369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.850149+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.849435+0000","last_became_peered":"2024-09-10T20:39:52.849435+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:13.186313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872460+0000","last_change":"2024-09-10T20:39:52.849458+0000","last_active":"2024-09-10T20:39:57.872460+0000","last_peered":"2024-09-10T20:39:57.872460+0000","last_clean":"2024-09-10T20:39:57.872460+0000","last_became_active":"2024-09-10T20:39:52.844995+0000","last_became_peered":"2024-09-10T20:39:52.844995+0000","last_unstale":"2024-09-10T20:39:57.872460+0000","last_undegraded":"2024-09-10T20:39:57.872460+0000","last_fullsized":"2024-09-10T20:39:57.872460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870856+0000","last_change":"2024-09-10T20:39:52.840179+0000","last_active":"2024-09-10T20:39:57.870856+0000","last_peered":"2024-09-10T20:39:57.870856+0000","last_clean":"2024-09-10T20:39:57.870856+0000","last_became_active":"2024-09-10T20:39:52.839890+0000","last_became_peered":"2024-09-10T20:39:52.839890+0000","last_unstale":"2024-09-10T20:39:57.870856+0000","last_undegraded":"2024-09-10T20:39:57.870856+0000","last_fullsized":"2024-09-10T20:39:57.870856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:47.732259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870243+0000","last_change":"2024-09-10T20:39:52.853516+0000","last_active":"2024-09-10T20:39:57.870243+0000","last_peered":"2024-09-10T20:39:57.870243+0000","last_clean":"2024-09-10T20:39:57.870243+0000","last_became_active":"2024-09-10T20:39:52.853256+0000","last_became_peered":"2024-09-10T20:39:52.853256+0000","last_unstale":"2024-09-10T20:39:57.870243+0000","last_undegraded":"2024-09-10T20:39:57.870243+0000","last_fullsized":"2024-09-10T20:39:57.870243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:59.853596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870433+0000","last_change":"2024-09-10T20:39:52.859738+0000","last_active":"2024-09-10T20:39:57.870433+0000","last_peered":"2024-09-10T20:39:57.870433+0000","last_clean":"2024-09-10T20:39:57.870433+0000","last_became_active":"2024-09-10T20:39:52.859463+0000","last_became_peered":"2024-09-10T20:39:52.859463+0000","last_unstale":"2024-09-10T20:39:57.870433+0000","last_undegraded":"2024-09-10T20:39:57.870433+0000","last_fullsized":"2024-09-10T20:39:57.870433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:55.113983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577211+0000","last_change":"2024-09-10T20:39:52.867039+0000","last_active":"2024-09-10T20:39:58.577211+0000","last_peered":"2024-09-10T20:39:58.577211+0000","last_clean":"2024-09-10T20:39:58.577211+0000","last_became_active":"2024-09-10T20:39:52.865884+0000","last_became_peered":"2024-09-10T20:39:52.865884+0000","last_unstale":"2024-09-10T20:39:58.577211+0000","last_undegraded":"2024-09-10T20:39:58.577211+0000","last_fullsized":"2024-09-10T20:39:58.577211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:39.994022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871253+0000","last_change":"2024-09-10T20:39:52.844959+0000","last_active":"2024-09-10T20:39:57.871253+0000","last_peered":"2024-09-10T20:39:57.871253+0000","last_clean":"2024-09-10T20:39:57.871253+0000","last_became_active":"2024-09-10T20:39:52.844642+0000","last_became_peered":"2024-09-10T20:39:52.844642+0000","last_unstale":"2024-09-10T20:39:57.871253+0000","last_undegraded":"2024-09-10T20:39:57.871253+0000","last_fullsized":"2024-09-10T20:39:57.871253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:52:36.606145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872318+0000","last_change":"2024-09-10T20:39:52.844163+0000","last_active":"2024-09-10T20:39:57.872318+0000","last_peered":"2024-09-10T20:39:57.872318+0000","last_clean":"2024-09-10T20:39:57.872318+0000","last_became_active":"2024-09-10T20:39:52.843914+0000","last_became_peered":"2024-09-10T20:39:52.843914+0000","last_unstale":"2024-09-10T20:39:57.872318+0000","last_undegraded":"2024-09-10T20:39:57.872318+0000","last_fullsized":"2024-09-10T20:39:57.872318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:57.293478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869918+0000","last_change":"2024-09-10T20:39:52.858267+0000","last_active":"2024-09-10T20:39:57.869918+0000","last_peered":"2024-09-10T20:39:57.869918+0000","last_clean":"2024-09-10T20:39:57.869918+0000","last_became_active":"2024-09-10T20:39:52.857994+0000","last_became_peered":"2024-09-10T20:39:52.857994+0000","last_unstale":"2024-09-10T20:39:57.869918+0000","last_undegraded":"2024-09-10T20:39:57.869918+0000","last_fullsized":"2024-09-10T20:39:57.869918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:54.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075525+0000","last_change":"2024-09-10T20:39:52.839856+0000","last_active":"2024-09-10T20:39:58.075525+0000","last_peered":"2024-09-10T20:39:58.075525+0000","last_clean":"2024-09-10T20:39:58.075525+0000","last_became_active":"2024-09-10T20:39:52.839371+0000","last_became_peered":"2024-09-10T20:39:52.839371+0000","last_unstale":"2024-09-10T20:39:58.075525+0000","last_undegraded":"2024-09-10T20:39:58.075525+0000","last_fullsized":"2024-09-10T20:39:58.075525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:26.611475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577919+0000","last_change":"2024-09-10T20:39:52.847903+0000","last_active":"2024-09-10T20:39:58.577919+0000","last_peered":"2024-09-10T20:39:58.577919+0000","last_clean":"2024-09-10T20:39:58.577919+0000","last_became_active":"2024-09-10T20:39:52.845560+0000","last_became_peered":"2024-09-10T20:39:52.845560+0000","last_unstale":"2024-09-10T20:39:58.577919+0000","last_undegraded":"2024-09-10T20:39:58.577919+0000","last_fullsized":"2024-09-10T20:39:58.577919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:17.131990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456492+0000","last_change":"2024-09-10T20:39:52.848817+0000","last_active":"2024-09-10T20:39:58.456492+0000","last_peered":"2024-09-10T20:39:58.456492+0000","last_clean":"2024-09-10T20:39:58.456492+0000","last_became_active":"2024-09-10T20:39:52.848189+0000","last_became_peered":"2024-09-10T20:39:52.848189+0000","last_unstale":"2024-09-10T20:39:58.456492+0000","last_undegraded":"2024-09-10T20:39:58.456492+0000","last_fullsized":"2024-09-10T20:39:58.456492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:21.966758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873355+0000","last_change":"2024-09-10T20:39:52.846495+0000","last_active":"2024-09-10T20:39:57.873355+0000","last_peered":"2024-09-10T20:39:57.873355+0000","last_clean":"2024-09-10T20:39:57.873355+0000","last_became_active":"2024-09-10T20:39:52.846187+0000","last_became_peered":"2024-09-10T20:39:52.846187+0000","last_unstale":"2024-09-10T20:39:57.873355+0000","last_undegraded":"2024-09-10T20:39:57.873355+0000","last_fullsized":"2024-09-10T20:39:57.873355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:15.910087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578849+0000","last_change":"2024-09-10T20:39:52.862017+0000","last_active":"2024-09-10T20:39:58.578849+0000","last_peered":"2024-09-10T20:39:58.578849+0000","last_clean":"2024-09-10T20:39:58.578849+0000","last_became_active":"2024-09-10T20:39:52.861762+0000","last_became_peered":"2024-09-10T20:39:52.861762+0000","last_unstale":"2024-09-10T20:39:58.578849+0000","last_undegraded":"2024-09-10T20:39:58.578849+0000","last_fullsized":"2024-09-10T20:39:58.578849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873597+0000","last_change":"2024-09-10T20:39:52.849628+0000","last_active":"2024-09-10T20:39:57.873597+0000","last_peered":"2024-09-10T20:39:57.873597+0000","last_clean":"2024-09-10T20:39:57.873597+0000","last_became_active":"2024-09-10T20:39:52.849327+0000","last_became_peered":"2024-09-10T20:39:52.849327+0000","last_unstale":"2024-09-10T20:39:57.873597+0000","last_undegraded":"2024-09-10T20:39:57.873597+0000","last_fullsized":"2024-09-10T20:39:57.873597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:13.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872215+0000","last_change":"2024-09-10T20:39:52.859978+0000","last_active":"2024-09-10T20:39:57.872215+0000","last_peered":"2024-09-10T20:39:57.872215+0000","last_clean":"2024-09-10T20:39:57.872215+0000","last_became_active":"2024-09-10T20:39:52.859786+0000","last_became_peered":"2024-09-10T20:39:52.859786+0000","last_unstale":"2024-09-10T20:39:57.872215+0000","last_undegraded":"2024-09-10T20:39:57.872215+0000","last_fullsized":"2024-09-10T20:39:57.872215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869715+0000","last_change":"2024-09-10T20:39:52.839446+0000","last_active":"2024-09-10T20:39:57.869715+0000","last_peered":"2024-09-10T20:39:57.869715+0000","last_clean":"2024-09-10T20:39:57.869715+0000","last_became_active":"2024-09-10T20:39:52.839065+0000","last_became_peered":"2024-09-10T20:39:52.839065+0000","last_unstale":"2024-09-10T20:39:57.869715+0000","last_undegraded":"2024-09-10T20:39:57.869715+0000","last_fullsized":"2024-09-10T20:39:57.869715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:18:21.362301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870520+0000","last_change":"2024-09-10T20:39:52.850996+0000","last_active":"2024-09-10T20:39:57.870520+0000","last_peered":"2024-09-10T20:39:57.870520+0000","last_clean":"2024-09-10T20:39:57.870520+0000","last_became_active":"2024-09-10T20:39:52.850689+0000","last_became_peered":"2024-09-10T20:39:52.850689+0000","last_unstale":"2024-09-10T20:39:57.870520+0000","last_undegraded":"2024-09-10T20:39:57.870520+0000","last_fullsized":"2024-09-10T20:39:57.870520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:41.036260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871243+0000","last_change":"2024-09-10T20:39:52.852058+0000","last_active":"2024-09-10T20:39:57.871243+0000","last_peered":"2024-09-10T20:39:57.871243+0000","last_clean":"2024-09-10T20:39:57.871243+0000","last_became_active":"2024-09-10T20:39:52.851810+0000","last_became_peered":"2024-09-10T20:39:52.851810+0000","last_unstale":"2024-09-10T20:39:57.871243+0000","last_undegraded":"2024-09-10T20:39:57.871243+0000","last_fullsized":"2024-09-10T20:39:57.871243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:53.759604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456464+0000","last_change":"2024-09-10T20:39:52.848422+0000","last_active":"2024-09-10T20:39:58.456464+0000","last_peered":"2024-09-10T20:39:58.456464+0000","last_clean":"2024-09-10T20:39:58.456464+0000","last_became_active":"2024-09-10T20:39:52.847754+0000","last_became_peered":"2024-09-10T20:39:52.847754+0000","last_unstale":"2024-09-10T20:39:58.456464+0000","last_undegraded":"2024-09-10T20:39:58.456464+0000","last_fullsized":"2024-09-10T20:39:58.456464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:20.826273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456507+0000","last_change":"2024-09-10T20:39:52.848711+0000","last_active":"2024-09-10T20:39:58.456507+0000","last_peered":"2024-09-10T20:39:58.456507+0000","last_clean":"2024-09-10T20:39:58.456507+0000","last_became_active":"2024-09-10T20:39:52.848350+0000","last_became_peered":"2024-09-10T20:39:52.848350+0000","last_unstale":"2024-09-10T20:39:58.456507+0000","last_undegraded":"2024-09-10T20:39:58.456507+0000","last_fullsized":"2024-09-10T20:39:58.456507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:57.850783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456664+0000","last_change":"2024-09-10T20:39:52.858551+0000","last_active":"2024-09-10T20:39:58.456664+0000","last_peered":"2024-09-10T20:39:58.456664+0000","last_clean":"2024-09-10T20:39:58.456664+0000","last_became_active":"2024-09-10T20:39:52.858293+0000","last_became_peered":"2024-09-10T20:39:52.858293+0000","last_unstale":"2024-09-10T20:39:58.456664+0000","last_undegraded":"2024-09-10T20:39:58.456664+0000","last_fullsized":"2024-09-10T20:39:58.456664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076168+0000","last_change":"2024-09-10T20:39:52.846940+0000","last_active":"2024-09-10T20:39:58.076168+0000","last_peered":"2024-09-10T20:39:58.076168+0000","last_clean":"2024-09-10T20:39:58.076168+0000","last_became_active":"2024-09-10T20:39:52.846684+0000","last_became_peered":"2024-09-10T20:39:52.846684+0000","last_unstale":"2024-09-10T20:39:58.076168+0000","last_undegraded":"2024-09-10T20:39:58.076168+0000","last_fullsized":"2024-09-10T20:39:58.076168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869746+0000","last_change":"2024-09-10T20:39:52.837716+0000","last_active":"2024-09-10T20:39:57.869746+0000","last_peered":"2024-09-10T20:39:57.869746+0000","last_clean":"2024-09-10T20:39:57.869746+0000","last_became_active":"2024-09-10T20:39:52.837340+0000","last_became_peered":"2024-09-10T20:39:52.837340+0000","last_unstale":"2024-09-10T20:39:57.869746+0000","last_undegraded":"2024-09-10T20:39:57.869746+0000","last_fullsized":"2024-09-10T20:39:57.869746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.144804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456132+0000","last_change":"2024-09-10T20:39:52.844070+0000","last_active":"2024-09-10T20:39:58.456132+0000","last_peered":"2024-09-10T20:39:58.456132+0000","last_clean":"2024-09-10T20:39:58.456132+0000","last_became_active":"2024-09-10T20:39:52.843767+0000","last_became_peered":"2024-09-10T20:39:52.843767+0000","last_unstale":"2024-09-10T20:39:58.456132+0000","last_undegraded":"2024-09-10T20:39:58.456132+0000","last_fullsized":"2024-09-10T20:39:58.456132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:25.772255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576576+0000","last_change":"2024-09-10T20:39:52.857416+0000","last_active":"2024-09-10T20:39:58.576576+0000","last_peered":"2024-09-10T20:39:58.576576+0000","last_clean":"2024-09-10T20:39:58.576576+0000","last_became_active":"2024-09-10T20:39:52.857072+0000","last_became_peered":"2024-09-10T20:39:52.857072+0000","last_unstale":"2024-09-10T20:39:58.576576+0000","last_undegraded":"2024-09-10T20:39:58.576576+0000","last_fullsized":"2024-09-10T20:39:58.576576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:48.691234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456292+0000","last_change":"2024-09-10T20:39:52.848949+0000","last_active":"2024-09-10T20:39:58.456292+0000","last_peered":"2024-09-10T20:39:58.456292+0000","last_clean":"2024-09-10T20:39:58.456292+0000","last_became_active":"2024-09-10T20:39:52.848651+0000","last_became_peered":"2024-09-10T20:39:52.848651+0000","last_unstale":"2024-09-10T20:39:58.456292+0000","last_undegraded":"2024-09-10T20:39:58.456292+0000","last_fullsized":"2024-09-10T20:39:58.456292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:15.293386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576714+0000","last_change":"2024-09-10T20:39:52.866936+0000","last_active":"2024-09-10T20:39:58.576714+0000","last_peered":"2024-09-10T20:39:58.576714+0000","last_clean":"2024-09-10T20:39:58.576714+0000","last_became_active":"2024-09-10T20:39:52.857238+0000","last_became_peered":"2024-09-10T20:39:52.857238+0000","last_unstale":"2024-09-10T20:39:58.576714+0000","last_undegraded":"2024-09-10T20:39:58.576714+0000","last_fullsized":"2024-09-10T20:39:58.576714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871449+0000","last_change":"2024-09-10T20:39:52.847418+0000","last_active":"2024-09-10T20:39:57.871449+0000","last_peered":"2024-09-10T20:39:57.871449+0000","last_clean":"2024-09-10T20:39:57.871449+0000","last_became_active":"2024-09-10T20:39:52.847135+0000","last_became_peered":"2024-09-10T20:39:52.847135+0000","last_unstale":"2024-09-10T20:39:57.871449+0000","last_undegraded":"2024-09-10T20:39:57.871449+0000","last_fullsized":"2024-09-10T20:39:57.871449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:41.028633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871755+0000","last_change":"2024-09-10T20:39:52.858784+0000","last_active":"2024-09-10T20:39:57.871755+0000","last_peered":"2024-09-10T20:39:57.871755+0000","last_clean":"2024-09-10T20:39:57.871755+0000","last_became_active":"2024-09-10T20:39:52.858556+0000","last_became_peered":"2024-09-10T20:39:52.858556+0000","last_unstale":"2024-09-10T20:39:57.871755+0000","last_undegraded":"2024-09-10T20:39:57.871755+0000","last_fullsized":"2024-09-10T20:39:57.871755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:04.350523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456833+0000","last_change":"2024-09-10T20:39:52.856985+0000","last_active":"2024-09-10T20:39:58.456833+0000","last_peered":"2024-09-10T20:39:58.456833+0000","last_clean":"2024-09-10T20:39:58.456833+0000","last_became_active":"2024-09-10T20:39:52.853995+0000","last_became_peered":"2024-09-10T20:39:52.853995+0000","last_unstale":"2024-09-10T20:39:58.456833+0000","last_undegraded":"2024-09-10T20:39:58.456833+0000","last_fullsized":"2024-09-10T20:39:58.456833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:40:18.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.133+0000 7f2553e00640 1 -- 172.21.15.81:0/1377793579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255406e0a0 msgr2=0x7f25540d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.133+0000 7f2553e00640 1 --2- 172.21.15.81:0/1377793579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255406e0a0 0x7f25540d2090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f255408c2e0 tx=0x7f253c02a4d0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.134+0000 7f2553e00640 1 -- 172.21.15.81:0/1377793579 shutdown_connections 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.134+0000 7f2553e00640 1 --2- 172.21.15.81:0/1377793579 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25540d25d0 0x7f255406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.134+0000 7f2553e00640 1 --2- 172.21.15.81:0/1377793579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f255406e0a0 0x7f25540d2090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.134+0000 7f2553e00640 1 --2- 172.21.15.81:0/1377793579 >> v2:172.21.15.143:3300/0 conn(0x7f2554161140 0x7f25540b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.134+0000 7f2553e00640 1 -- 172.21.15.81:0/1377793579 >> 172.21.15.81:0/1377793579 conn(0x7f25540d3ab0 msgr2=0x7f25540d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.134+0000 7f2553e00640 1 -- 172.21.15.81:0/1377793579 shutdown_connections 2024-09-10T20:40:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.134+0000 7f2553e00640 1 -- 172.21.15.81:0/1377793579 wait complete. 2024-09-10T20:40:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.135+0000 7f2553e00640 1 Processor -- start 2024-09-10T20:40:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.136+0000 7f2553e00640 1 -- start start 2024-09-10T20:40:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.136+0000 7f2553e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255406e0a0 0x7f25540b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.136+0000 7f2553e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2554161140 0x7f25541f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.136+0000 7f2553e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25541558f0 0x7f25540c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.136+0000 7f2553e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f255406e770 con 0x7f2554161140 2024-09-10T20:40:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.136+0000 7f2553e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2554161730 con 0x7f25541558f0 2024-09-10T20:40:19.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.136+0000 7f2553e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f255406e8f0 con 0x7f255406e0a0 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2554161140 0x7f25541f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2554161140 0x7f25541f8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52630/0 (socket says 172.21.15.81:52630) 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 -- 172.21.15.81:0/3532419552 learned_addr learned my addr 172.21.15.81:0/3532419552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f2552a00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255406e0a0 0x7f25540b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f2553400640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25541558f0 0x7f25540c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 -- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255406e0a0 msgr2=0x7f25540b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255406e0a0 0x7f25540b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 -- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25541558f0 msgr2=0x7f25540c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25541558f0 0x7f25540c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 -- 172.21.15.81:0/3532419552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25540b4fa0 con 0x7f2554161140 2024-09-10T20:40:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.137+0000 7f254a000640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2554161140 0x7f25541f8530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f253c009850 tx=0x7f253c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.138+0000 7f254be00640 1 -- 172.21.15.81:0/3532419552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c03f070 con 0x7f2554161140 2024-09-10T20:40:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.138+0000 7f254be00640 1 -- 172.21.15.81:0/3532419552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f253c0047a0 con 0x7f2554161140 2024-09-10T20:40:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.138+0000 7f254be00640 1 -- 172.21.15.81:0/3532419552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c035030 con 0x7f2554161140 2024-09-10T20:40:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.138+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25541f8a70 con 0x7f2554161140 2024-09-10T20:40:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.138+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25540cc120 con 0x7f2554161140 2024-09-10T20:40:19.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.139+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25540b93e0 con 0x7f2554161140 2024-09-10T20:40:19.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.140+0000 7f254be00640 1 -- 172.21.15.81:0/3532419552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f253c004bb0 con 0x7f2554161140 2024-09-10T20:40:19.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.141+0000 7f254be00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2530077f70 0x7f253007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.141+0000 7f254be00640 1 -- 172.21.15.81:0/3532419552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f253c0bb190 con 0x7f2554161140 2024-09-10T20:40:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.141+0000 7f2552a00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2530077f70 0x7f253007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.142+0000 7f2552a00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2530077f70 0x7f253007a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2544009ac0 tx=0x7f2544005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.145+0000 7f254be00640 1 -- 172.21.15.81:0/3532419552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f25541f8a70 con 0x7f2554161140 2024-09-10T20:40:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.330+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25540b9100 con 0x7f2530077f70 2024-09-10T20:40:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.336+0000 7f254be00640 1 -- 172.21.15.81:0/3532419552 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f25540b9100 con 0x7f2530077f70 2024-09-10T20:40:19.344 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:19.346 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:40:19.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2530077f70 msgr2=0x7f253007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2530077f70 0x7f253007a430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2544009ac0 tx=0x7f2544005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2554161140 msgr2=0x7f25541f8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2554161140 0x7f25541f8530 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f253c009850 tx=0x7f253c0038a0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 shutdown_connections 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2530077f70 0x7f253007a430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f25541558f0 0x7f25540c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2554161140 0x7f25541f8530 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 --2- 172.21.15.81:0/3532419552 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f255406e0a0 0x7f25540b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 >> 172.21.15.81:0/3532419552 conn(0x7f25540d3ab0 msgr2=0x7f25540b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 shutdown_connections 2024-09-10T20:40:19.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.341+0000 7f2553e00640 1 -- 172.21.15.81:0/3532419552 wait complete. 2024-09-10T20:40:19.360 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-10T20:40:17.850341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003283"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578249+0000","last_change":"2024-09-10T20:39:51.832835+0000","last_active":"2024-09-10T20:39:58.578249+0000","last_peered":"2024-09-10T20:39:58.578249+0000","last_clean":"2024-09-10T20:39:58.578249+0000","last_became_active":"2024-09-10T20:39:51.832002+0000","last_became_peered":"2024-09-10T20:39:51.832002+0000","last_unstale":"2024-09-10T20:39:58.578249+0000","last_undegraded":"2024-09-10T20:39:58.578249+0000","last_fullsized":"2024-09-10T20:39:58.578249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871856+0000","last_change":"2024-09-10T20:39:52.861599+0000","last_active":"2024-09-10T20:39:57.871856+0000","last_peered":"2024-09-10T20:39:57.871856+0000","last_clean":"2024-09-10T20:39:57.871856+0000","last_became_active":"2024-09-10T20:39:52.861276+0000","last_became_peered":"2024-09-10T20:39:52.861276+0000","last_unstale":"2024-09-10T20:39:57.871856+0000","last_undegraded":"2024-09-10T20:39:57.871856+0000","last_fullsized":"2024-09-10T20:39:57.871856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:22:26.883049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577180+0000","last_change":"2024-09-10T20:39:56.877062+0000","last_active":"2024-09-10T20:39:58.577180+0000","last_peered":"2024-09-10T20:39:58.577180+0000","last_clean":"2024-09-10T20:39:58.577180+0000","last_became_active":"2024-09-10T20:39:56.876685+0000","last_became_peered":"2024-09-10T20:39:56.876685+0000","last_unstale":"2024-09-10T20:39:58.577180+0000","last_undegraded":"2024-09-10T20:39:58.577180+0000","last_fullsized":"2024-09-10T20:39:58.577180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:57.795507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871926+0000","last_change":"2024-09-10T20:39:51.834265+0000","last_active":"2024-09-10T20:39:57.871926+0000","last_peered":"2024-09-10T20:39:57.871926+0000","last_clean":"2024-09-10T20:39:57.871926+0000","last_became_active":"2024-09-10T20:39:51.833454+0000","last_became_peered":"2024-09-10T20:39:51.833454+0000","last_unstale":"2024-09-10T20:39:57.871926+0000","last_undegraded":"2024-09-10T20:39:57.871926+0000","last_fullsized":"2024-09-10T20:39:57.871926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:16.293652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871601+0000","last_change":"2024-09-10T20:39:52.844795+0000","last_active":"2024-09-10T20:39:57.871601+0000","last_peered":"2024-09-10T20:39:57.871601+0000","last_clean":"2024-09-10T20:39:57.871601+0000","last_became_active":"2024-09-10T20:39:52.844523+0000","last_became_peered":"2024-09-10T20:39:52.844523+0000","last_unstale":"2024-09-10T20:39:57.871601+0000","last_undegraded":"2024-09-10T20:39:57.871601+0000","last_fullsized":"2024-09-10T20:39:57.871601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:29.651685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576325+0000","last_change":"2024-09-10T20:39:56.889126+0000","last_active":"2024-09-10T20:39:58.576325+0000","last_peered":"2024-09-10T20:39:58.576325+0000","last_clean":"2024-09-10T20:39:58.576325+0000","last_became_active":"2024-09-10T20:39:56.884086+0000","last_became_peered":"2024-09-10T20:39:56.884086+0000","last_unstale":"2024-09-10T20:39:58.576325+0000","last_undegraded":"2024-09-10T20:39:58.576325+0000","last_fullsized":"2024-09-10T20:39:58.576325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:14:43.634765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456681+0000","last_change":"2024-09-10T20:39:51.837410+0000","last_active":"2024-09-10T20:39:58.456681+0000","last_peered":"2024-09-10T20:39:58.456681+0000","last_clean":"2024-09-10T20:39:58.456681+0000","last_became_active":"2024-09-10T20:39:51.828041+0000","last_became_peered":"2024-09-10T20:39:51.828041+0000","last_unstale":"2024-09-10T20:39:58.456681+0000","last_undegraded":"2024-09-10T20:39:58.456681+0000","last_fullsized":"2024-09-10T20:39:58.456681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075788+0000","last_change":"2024-09-10T20:39:52.841937+0000","last_active":"2024-09-10T20:39:58.075788+0000","last_peered":"2024-09-10T20:39:58.075788+0000","last_clean":"2024-09-10T20:39:58.075788+0000","last_became_active":"2024-09-10T20:39:52.841667+0000","last_became_peered":"2024-09-10T20:39:52.841667+0000","last_unstale":"2024-09-10T20:39:58.075788+0000","last_undegraded":"2024-09-10T20:39:58.075788+0000","last_fullsized":"2024-09-10T20:39:58.075788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:38.915461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576484+0000","last_change":"2024-09-10T20:39:56.878639+0000","last_active":"2024-09-10T20:39:58.576484+0000","last_peered":"2024-09-10T20:39:58.576484+0000","last_clean":"2024-09-10T20:39:58.576484+0000","last_became_active":"2024-09-10T20:39:56.878151+0000","last_became_peered":"2024-09-10T20:39:56.878151+0000","last_unstale":"2024-09-10T20:39:58.576484+0000","last_undegraded":"2024-09-10T20:39:58.576484+0000","last_fullsized":"2024-09-10T20:39:58.576484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456590+0000","last_change":"2024-09-10T20:39:51.824906+0000","last_active":"2024-09-10T20:39:58.456590+0000","last_peered":"2024-09-10T20:39:58.456590+0000","last_clean":"2024-09-10T20:39:58.456590+0000","last_became_active":"2024-09-10T20:39:51.824622+0000","last_became_peered":"2024-09-10T20:39:51.824622+0000","last_unstale":"2024-09-10T20:39:58.456590+0000","last_undegraded":"2024-09-10T20:39:58.456590+0000","last_fullsized":"2024-09-10T20:39:58.456590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873160+0000","last_change":"2024-09-10T20:39:52.842836+0000","last_active":"2024-09-10T20:39:57.873160+0000","last_peered":"2024-09-10T20:39:57.873160+0000","last_clean":"2024-09-10T20:39:57.873160+0000","last_became_active":"2024-09-10T20:39:52.842556+0000","last_became_peered":"2024-09-10T20:39:52.842556+0000","last_unstale":"2024-09-10T20:39:57.873160+0000","last_undegraded":"2024-09-10T20:39:57.873160+0000","last_fullsized":"2024-09-10T20:39:57.873160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:26:59.528995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576402+0000","last_change":"2024-09-10T20:39:56.878895+0000","last_active":"2024-09-10T20:39:58.576402+0000","last_peered":"2024-09-10T20:39:58.576402+0000","last_clean":"2024-09-10T20:39:58.576402+0000","last_became_active":"2024-09-10T20:39:56.878478+0000","last_became_peered":"2024-09-10T20:39:56.878478+0000","last_unstale":"2024-09-10T20:39:58.576402+0000","last_undegraded":"2024-09-10T20:39:58.576402+0000","last_fullsized":"2024-09-10T20:39:58.576402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.002662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872865+0000","last_change":"2024-09-10T20:39:52.840391+0000","last_active":"2024-09-10T20:39:57.872865+0000","last_peered":"2024-09-10T20:39:57.872865+0000","last_clean":"2024-09-10T20:39:57.872865+0000","last_became_active":"2024-09-10T20:39:52.840140+0000","last_became_peered":"2024-09-10T20:39:52.840140+0000","last_unstale":"2024-09-10T20:39:57.872865+0000","last_undegraded":"2024-09-10T20:39:57.872865+0000","last_fullsized":"2024-09-10T20:39:57.872865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872887+0000","last_change":"2024-09-10T20:39:51.831131+0000","last_active":"2024-09-10T20:39:57.872887+0000","last_peered":"2024-09-10T20:39:57.872887+0000","last_clean":"2024-09-10T20:39:57.872887+0000","last_became_active":"2024-09-10T20:39:51.830920+0000","last_became_peered":"2024-09-10T20:39:51.830920+0000","last_unstale":"2024-09-10T20:39:57.872887+0000","last_undegraded":"2024-09-10T20:39:57.872887+0000","last_fullsized":"2024-09-10T20:39:57.872887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872932+0000","last_change":"2024-09-10T20:39:56.885978+0000","last_active":"2024-09-10T20:39:57.872932+0000","last_peered":"2024-09-10T20:39:57.872932+0000","last_clean":"2024-09-10T20:39:57.872932+0000","last_became_active":"2024-09-10T20:39:56.882428+0000","last_became_peered":"2024-09-10T20:39:56.882428+0000","last_unstale":"2024-09-10T20:39:57.872932+0000","last_undegraded":"2024-09-10T20:39:57.872932+0000","last_fullsized":"2024-09-10T20:39:57.872932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:40:17.375025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578529+0000","last_change":"2024-09-10T20:39:52.851120+0000","last_active":"2024-09-10T20:39:58.578529+0000","last_peered":"2024-09-10T20:39:58.578529+0000","last_clean":"2024-09-10T20:39:58.578529+0000","last_became_active":"2024-09-10T20:39:52.850838+0000","last_became_peered":"2024-09-10T20:39:52.850838+0000","last_unstale":"2024-09-10T20:39:58.578529+0000","last_undegraded":"2024-09-10T20:39:58.578529+0000","last_fullsized":"2024-09-10T20:39:58.578529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870734+0000","last_change":"2024-09-10T20:39:51.828895+0000","last_active":"2024-09-10T20:39:57.870734+0000","last_peered":"2024-09-10T20:39:57.870734+0000","last_clean":"2024-09-10T20:39:57.870734+0000","last_became_active":"2024-09-10T20:39:51.828619+0000","last_became_peered":"2024-09-10T20:39:51.828619+0000","last_unstale":"2024-09-10T20:39:57.870734+0000","last_undegraded":"2024-09-10T20:39:57.870734+0000","last_fullsized":"2024-09-10T20:39:57.870734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456333+0000","last_change":"2024-09-10T20:39:56.872443+0000","last_active":"2024-09-10T20:39:58.456333+0000","last_peered":"2024-09-10T20:39:58.456333+0000","last_clean":"2024-09-10T20:39:58.456333+0000","last_became_active":"2024-09-10T20:39:56.871357+0000","last_became_peered":"2024-09-10T20:39:56.871357+0000","last_unstale":"2024-09-10T20:39:58.456333+0000","last_undegraded":"2024-09-10T20:39:58.456333+0000","last_fullsized":"2024-09-10T20:39:58.456333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:26.208173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576821+0000","last_change":"2024-09-10T20:39:52.840929+0000","last_active":"2024-09-10T20:39:58.576821+0000","last_peered":"2024-09-10T20:39:58.576821+0000","last_clean":"2024-09-10T20:39:58.576821+0000","last_became_active":"2024-09-10T20:39:52.840635+0000","last_became_peered":"2024-09-10T20:39:52.840635+0000","last_unstale":"2024-09-10T20:39:58.576821+0000","last_undegraded":"2024-09-10T20:39:58.576821+0000","last_fullsized":"2024-09-10T20:39:58.576821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:19.765338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577744+0000","last_change":"2024-09-10T20:39:51.834045+0000","last_active":"2024-09-10T20:39:58.577744+0000","last_peered":"2024-09-10T20:39:58.577744+0000","last_clean":"2024-09-10T20:39:58.577744+0000","last_became_active":"2024-09-10T20:39:51.833137+0000","last_became_peered":"2024-09-10T20:39:51.833137+0000","last_unstale":"2024-09-10T20:39:58.577744+0000","last_undegraded":"2024-09-10T20:39:58.577744+0000","last_fullsized":"2024-09-10T20:39:58.577744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578854+0000","last_change":"2024-09-10T20:39:56.878162+0000","last_active":"2024-09-10T20:39:58.578854+0000","last_peered":"2024-09-10T20:39:58.578854+0000","last_clean":"2024-09-10T20:39:58.578854+0000","last_became_active":"2024-09-10T20:39:56.875227+0000","last_became_peered":"2024-09-10T20:39:56.875227+0000","last_unstale":"2024-09-10T20:39:58.578854+0000","last_undegraded":"2024-09-10T20:39:58.578854+0000","last_fullsized":"2024-09-10T20:39:58.578854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:47.514540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872355+0000","last_change":"2024-09-10T20:39:52.850499+0000","last_active":"2024-09-10T20:39:57.872355+0000","last_peered":"2024-09-10T20:39:57.872355+0000","last_clean":"2024-09-10T20:39:57.872355+0000","last_became_active":"2024-09-10T20:39:52.846216+0000","last_became_peered":"2024-09-10T20:39:52.846216+0000","last_unstale":"2024-09-10T20:39:57.872355+0000","last_undegraded":"2024-09-10T20:39:57.872355+0000","last_fullsized":"2024-09-10T20:39:57.872355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:42.967388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.455967+0000","last_change":"2024-09-10T20:39:51.828243+0000","last_active":"2024-09-10T20:39:58.455967+0000","last_peered":"2024-09-10T20:39:58.455967+0000","last_clean":"2024-09-10T20:39:58.455967+0000","last_became_active":"2024-09-10T20:39:51.827821+0000","last_became_peered":"2024-09-10T20:39:51.827821+0000","last_unstale":"2024-09-10T20:39:58.455967+0000","last_undegraded":"2024-09-10T20:39:58.455967+0000","last_fullsized":"2024-09-10T20:39:58.455967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577056+0000","last_change":"2024-09-10T20:39:56.884287+0000","last_active":"2024-09-10T20:39:58.577056+0000","last_peered":"2024-09-10T20:39:58.577056+0000","last_clean":"2024-09-10T20:39:58.577056+0000","last_became_active":"2024-09-10T20:39:56.882564+0000","last_became_peered":"2024-09-10T20:39:56.882564+0000","last_unstale":"2024-09-10T20:39:58.577056+0000","last_undegraded":"2024-09-10T20:39:58.577056+0000","last_fullsized":"2024-09-10T20:39:58.577056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577841+0000","last_change":"2024-09-10T20:39:52.838040+0000","last_active":"2024-09-10T20:39:58.577841+0000","last_peered":"2024-09-10T20:39:58.577841+0000","last_clean":"2024-09-10T20:39:58.577841+0000","last_became_active":"2024-09-10T20:39:52.837734+0000","last_became_peered":"2024-09-10T20:39:52.837734+0000","last_unstale":"2024-09-10T20:39:58.577841+0000","last_undegraded":"2024-09-10T20:39:58.577841+0000","last_fullsized":"2024-09-10T20:39:58.577841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:48:10.528107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873618+0000","last_change":"2024-09-10T20:39:51.844086+0000","last_active":"2024-09-10T20:39:57.873618+0000","last_peered":"2024-09-10T20:39:57.873618+0000","last_clean":"2024-09-10T20:39:57.873618+0000","last_became_active":"2024-09-10T20:39:51.843824+0000","last_became_peered":"2024-09-10T20:39:51.843824+0000","last_unstale":"2024-09-10T20:39:57.873618+0000","last_undegraded":"2024-09-10T20:39:57.873618+0000","last_fullsized":"2024-09-10T20:39:57.873618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:12.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576560+0000","last_change":"2024-09-10T20:39:56.884552+0000","last_active":"2024-09-10T20:39:58.576560+0000","last_peered":"2024-09-10T20:39:58.576560+0000","last_clean":"2024-09-10T20:39:58.576560+0000","last_became_active":"2024-09-10T20:39:56.884088+0000","last_became_peered":"2024-09-10T20:39:56.884088+0000","last_unstale":"2024-09-10T20:39:58.576560+0000","last_undegraded":"2024-09-10T20:39:58.576560+0000","last_fullsized":"2024-09-10T20:39:58.576560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578171+0000","last_change":"2024-09-10T20:39:52.850808+0000","last_active":"2024-09-10T20:39:58.578171+0000","last_peered":"2024-09-10T20:39:58.578171+0000","last_clean":"2024-09-10T20:39:58.578171+0000","last_became_active":"2024-09-10T20:39:52.850148+0000","last_became_peered":"2024-09-10T20:39:52.850148+0000","last_unstale":"2024-09-10T20:39:58.578171+0000","last_undegraded":"2024-09-10T20:39:58.578171+0000","last_fullsized":"2024-09-10T20:39:58.578171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:31:27.749969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578141+0000","last_change":"2024-09-10T20:39:51.835027+0000","last_active":"2024-09-10T20:39:58.578141+0000","last_peered":"2024-09-10T20:39:58.578141+0000","last_clean":"2024-09-10T20:39:58.578141+0000","last_became_active":"2024-09-10T20:39:51.833252+0000","last_became_peered":"2024-09-10T20:39:51.833252+0000","last_unstale":"2024-09-10T20:39:58.578141+0000","last_undegraded":"2024-09-10T20:39:58.578141+0000","last_fullsized":"2024-09-10T20:39:58.578141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:52.308914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576875+0000","last_change":"2024-09-10T20:39:56.878033+0000","last_active":"2024-09-10T20:39:58.576875+0000","last_peered":"2024-09-10T20:39:58.576875+0000","last_clean":"2024-09-10T20:39:58.576875+0000","last_became_active":"2024-09-10T20:39:56.877576+0000","last_became_peered":"2024-09-10T20:39:56.877576+0000","last_unstale":"2024-09-10T20:39:58.576875+0000","last_undegraded":"2024-09-10T20:39:58.576875+0000","last_fullsized":"2024-09-10T20:39:58.576875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870354+0000","last_change":"2024-09-10T20:39:52.859765+0000","last_active":"2024-09-10T20:39:57.870354+0000","last_peered":"2024-09-10T20:39:57.870354+0000","last_clean":"2024-09-10T20:39:57.870354+0000","last_became_active":"2024-09-10T20:39:52.858175+0000","last_became_peered":"2024-09-10T20:39:52.858175+0000","last_unstale":"2024-09-10T20:39:57.870354+0000","last_undegraded":"2024-09-10T20:39:57.870354+0000","last_fullsized":"2024-09-10T20:39:57.870354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:49:43.478637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873400+0000","last_change":"2024-09-10T20:39:51.836469+0000","last_active":"2024-09-10T20:39:57.873400+0000","last_peered":"2024-09-10T20:39:57.873400+0000","last_clean":"2024-09-10T20:39:57.873400+0000","last_became_active":"2024-09-10T20:39:51.835832+0000","last_became_peered":"2024-09-10T20:39:51.835832+0000","last_unstale":"2024-09-10T20:39:57.873400+0000","last_undegraded":"2024-09-10T20:39:57.873400+0000","last_fullsized":"2024-09-10T20:39:57.873400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:38.987131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870998+0000","last_change":"2024-09-10T20:39:56.875872+0000","last_active":"2024-09-10T20:39:57.870998+0000","last_peered":"2024-09-10T20:39:57.870998+0000","last_clean":"2024-09-10T20:39:57.870998+0000","last_became_active":"2024-09-10T20:39:56.875431+0000","last_became_peered":"2024-09-10T20:39:56.875431+0000","last_unstale":"2024-09-10T20:39:57.870998+0000","last_undegraded":"2024-09-10T20:39:57.870998+0000","last_fullsized":"2024-09-10T20:39:57.870998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576757+0000","last_change":"2024-09-10T20:39:52.865010+0000","last_active":"2024-09-10T20:39:58.576757+0000","last_peered":"2024-09-10T20:39:58.576757+0000","last_clean":"2024-09-10T20:39:58.576757+0000","last_became_active":"2024-09-10T20:39:52.859434+0000","last_became_peered":"2024-09-10T20:39:52.859434+0000","last_unstale":"2024-09-10T20:39:58.576757+0000","last_undegraded":"2024-09-10T20:39:58.576757+0000","last_fullsized":"2024-09-10T20:39:58.576757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871107+0000","last_change":"2024-09-10T20:39:51.827144+0000","last_active":"2024-09-10T20:39:57.871107+0000","last_peered":"2024-09-10T20:39:57.871107+0000","last_clean":"2024-09-10T20:39:57.871107+0000","last_became_active":"2024-09-10T20:39:51.826880+0000","last_became_peered":"2024-09-10T20:39:51.826880+0000","last_unstale":"2024-09-10T20:39:57.871107+0000","last_undegraded":"2024-09-10T20:39:57.871107+0000","last_fullsized":"2024-09-10T20:39:57.871107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:45.750240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870236+0000","last_change":"2024-09-10T20:39:56.882585+0000","last_active":"2024-09-10T20:39:57.870236+0000","last_peered":"2024-09-10T20:39:57.870236+0000","last_clean":"2024-09-10T20:39:57.870236+0000","last_became_active":"2024-09-10T20:39:56.882093+0000","last_became_peered":"2024-09-10T20:39:56.882093+0000","last_unstale":"2024-09-10T20:39:57.870236+0000","last_undegraded":"2024-09-10T20:39:57.870236+0000","last_fullsized":"2024-09-10T20:39:57.870236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:39.857168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456325+0000","last_change":"2024-09-10T20:39:52.861639+0000","last_active":"2024-09-10T20:39:58.456325+0000","last_peered":"2024-09-10T20:39:58.456325+0000","last_clean":"2024-09-10T20:39:58.456325+0000","last_became_active":"2024-09-10T20:39:52.861383+0000","last_became_peered":"2024-09-10T20:39:52.861383+0000","last_unstale":"2024-09-10T20:39:58.456325+0000","last_undegraded":"2024-09-10T20:39:58.456325+0000","last_fullsized":"2024-09-10T20:39:58.456325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:47.156926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872896+0000","last_change":"2024-09-10T20:39:51.835770+0000","last_active":"2024-09-10T20:39:57.872896+0000","last_peered":"2024-09-10T20:39:57.872896+0000","last_clean":"2024-09-10T20:39:57.872896+0000","last_became_active":"2024-09-10T20:39:51.835470+0000","last_became_peered":"2024-09-10T20:39:51.835470+0000","last_unstale":"2024-09-10T20:39:57.872896+0000","last_undegraded":"2024-09-10T20:39:57.872896+0000","last_fullsized":"2024-09-10T20:39:57.872896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:38.530675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870076+0000","last_change":"2024-09-10T20:39:56.882138+0000","last_active":"2024-09-10T20:39:57.870076+0000","last_peered":"2024-09-10T20:39:57.870076+0000","last_clean":"2024-09-10T20:39:57.870076+0000","last_became_active":"2024-09-10T20:39:56.875117+0000","last_became_peered":"2024-09-10T20:39:56.875117+0000","last_unstale":"2024-09-10T20:39:57.870076+0000","last_undegraded":"2024-09-10T20:39:57.870076+0000","last_fullsized":"2024-09-10T20:39:57.870076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:47.435199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869855+0000","last_change":"2024-09-10T20:39:52.842774+0000","last_active":"2024-09-10T20:39:57.869855+0000","last_peered":"2024-09-10T20:39:57.869855+0000","last_clean":"2024-09-10T20:39:57.869855+0000","last_became_active":"2024-09-10T20:39:52.842446+0000","last_became_peered":"2024-09-10T20:39:52.842446+0000","last_unstale":"2024-09-10T20:39:57.869855+0000","last_undegraded":"2024-09-10T20:39:57.869855+0000","last_fullsized":"2024-09-10T20:39:57.869855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:12:29.034488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577469+0000","last_change":"2024-09-10T20:39:51.834088+0000","last_active":"2024-09-10T20:39:58.577469+0000","last_peered":"2024-09-10T20:39:58.577469+0000","last_clean":"2024-09-10T20:39:58.577469+0000","last_became_active":"2024-09-10T20:39:51.830213+0000","last_became_peered":"2024-09-10T20:39:51.830213+0000","last_unstale":"2024-09-10T20:39:58.577469+0000","last_undegraded":"2024-09-10T20:39:58.577469+0000","last_fullsized":"2024-09-10T20:39:58.577469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:08.073166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871242+0000","last_change":"2024-09-10T20:39:56.876963+0000","last_active":"2024-09-10T20:39:57.871242+0000","last_peered":"2024-09-10T20:39:57.871242+0000","last_clean":"2024-09-10T20:39:57.871242+0000","last_became_active":"2024-09-10T20:39:56.876565+0000","last_became_peered":"2024-09-10T20:39:56.876565+0000","last_unstale":"2024-09-10T20:39:57.871242+0000","last_undegraded":"2024-09-10T20:39:57.871242+0000","last_fullsized":"2024-09-10T20:39:57.871242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869844+0000","last_change":"2024-09-10T20:39:52.860096+0000","last_active":"2024-09-10T20:39:57.869844+0000","last_peered":"2024-09-10T20:39:57.869844+0000","last_clean":"2024-09-10T20:39:57.869844+0000","last_became_active":"2024-09-10T20:39:52.859815+0000","last_became_peered":"2024-09-10T20:39:52.859815+0000","last_unstale":"2024-09-10T20:39:57.869844+0000","last_undegraded":"2024-09-10T20:39:57.869844+0000","last_fullsized":"2024-09-10T20:39:57.869844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:02.982260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872428+0000","last_change":"2024-09-10T20:39:51.837166+0000","last_active":"2024-09-10T20:39:57.872428+0000","last_peered":"2024-09-10T20:39:57.872428+0000","last_clean":"2024-09-10T20:39:57.872428+0000","last_became_active":"2024-09-10T20:39:51.836893+0000","last_became_peered":"2024-09-10T20:39:51.836893+0000","last_unstale":"2024-09-10T20:39:57.872428+0000","last_undegraded":"2024-09-10T20:39:57.872428+0000","last_fullsized":"2024-09-10T20:39:57.872428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:18.758447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871780+0000","last_change":"2024-09-10T20:39:56.874406+0000","last_active":"2024-09-10T20:39:57.871780+0000","last_peered":"2024-09-10T20:39:57.871780+0000","last_clean":"2024-09-10T20:39:57.871780+0000","last_became_active":"2024-09-10T20:39:56.874005+0000","last_became_peered":"2024-09-10T20:39:56.874005+0000","last_unstale":"2024-09-10T20:39:57.871780+0000","last_undegraded":"2024-09-10T20:39:57.871780+0000","last_fullsized":"2024-09-10T20:39:57.871780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:19.234557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577223+0000","last_change":"2024-09-10T20:39:52.860106+0000","last_active":"2024-09-10T20:39:58.577223+0000","last_peered":"2024-09-10T20:39:58.577223+0000","last_clean":"2024-09-10T20:39:58.577223+0000","last_became_active":"2024-09-10T20:39:52.859856+0000","last_became_peered":"2024-09-10T20:39:52.859856+0000","last_unstale":"2024-09-10T20:39:58.577223+0000","last_undegraded":"2024-09-10T20:39:58.577223+0000","last_fullsized":"2024-09-10T20:39:58.577223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:50:39.512271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872964+0000","last_change":"2024-09-10T20:39:51.830052+0000","last_active":"2024-09-10T20:39:57.872964+0000","last_peered":"2024-09-10T20:39:57.872964+0000","last_clean":"2024-09-10T20:39:57.872964+0000","last_became_active":"2024-09-10T20:39:51.829826+0000","last_became_peered":"2024-09-10T20:39:51.829826+0000","last_unstale":"2024-09-10T20:39:57.872964+0000","last_undegraded":"2024-09-10T20:39:57.872964+0000","last_fullsized":"2024-09-10T20:39:57.872964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:12.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075483+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:39:58.075483+0000","last_peered":"2024-09-10T20:39:58.075483+0000","last_clean":"2024-09-10T20:39:58.075483+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:39:58.075483+0000","last_undegraded":"2024-09-10T20:39:58.075483+0000","last_fullsized":"2024-09-10T20:39:58.075483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873275+0000","last_change":"2024-09-10T20:39:56.886319+0000","last_active":"2024-09-10T20:39:57.873275+0000","last_peered":"2024-09-10T20:39:57.873275+0000","last_clean":"2024-09-10T20:39:57.873275+0000","last_became_active":"2024-09-10T20:39:56.884644+0000","last_became_peered":"2024-09-10T20:39:56.884644+0000","last_unstale":"2024-09-10T20:39:57.873275+0000","last_undegraded":"2024-09-10T20:39:57.873275+0000","last_fullsized":"2024-09-10T20:39:57.873275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:42.635249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873205+0000","last_change":"2024-09-10T20:39:52.841498+0000","last_active":"2024-09-10T20:39:57.873205+0000","last_peered":"2024-09-10T20:39:57.873205+0000","last_clean":"2024-09-10T20:39:57.873205+0000","last_became_active":"2024-09-10T20:39:52.841257+0000","last_became_peered":"2024-09-10T20:39:52.841257+0000","last_unstale":"2024-09-10T20:39:57.873205+0000","last_undegraded":"2024-09-10T20:39:57.873205+0000","last_fullsized":"2024-09-10T20:39:57.873205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:49:56.841902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870555+0000","last_change":"2024-09-10T20:39:51.831320+0000","last_active":"2024-09-10T20:39:57.870555+0000","last_peered":"2024-09-10T20:39:57.870555+0000","last_clean":"2024-09-10T20:39:57.870555+0000","last_became_active":"2024-09-10T20:39:51.831030+0000","last_became_peered":"2024-09-10T20:39:51.831030+0000","last_unstale":"2024-09-10T20:39:57.870555+0000","last_undegraded":"2024-09-10T20:39:57.870555+0000","last_fullsized":"2024-09-10T20:39:57.870555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576384+0000","last_change":"2024-09-10T20:39:56.876055+0000","last_active":"2024-09-10T20:39:58.576384+0000","last_peered":"2024-09-10T20:39:58.576384+0000","last_clean":"2024-09-10T20:39:58.576384+0000","last_became_active":"2024-09-10T20:39:56.875602+0000","last_became_peered":"2024-09-10T20:39:56.875602+0000","last_unstale":"2024-09-10T20:39:58.576384+0000","last_undegraded":"2024-09-10T20:39:58.576384+0000","last_fullsized":"2024-09-10T20:39:58.576384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:07:01.886686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456584+0000","last_change":"2024-09-10T20:39:52.856423+0000","last_active":"2024-09-10T20:39:58.456584+0000","last_peered":"2024-09-10T20:39:58.456584+0000","last_clean":"2024-09-10T20:39:58.456584+0000","last_became_active":"2024-09-10T20:39:52.855409+0000","last_became_peered":"2024-09-10T20:39:52.855409+0000","last_unstale":"2024-09-10T20:39:58.456584+0000","last_undegraded":"2024-09-10T20:39:58.456584+0000","last_fullsized":"2024-09-10T20:39:58.456584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:35.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871541+0000","last_change":"2024-09-10T20:39:51.833978+0000","last_active":"2024-09-10T20:39:57.871541+0000","last_peered":"2024-09-10T20:39:57.871541+0000","last_clean":"2024-09-10T20:39:57.871541+0000","last_became_active":"2024-09-10T20:39:51.833436+0000","last_became_peered":"2024-09-10T20:39:51.833436+0000","last_unstale":"2024-09-10T20:39:57.871541+0000","last_undegraded":"2024-09-10T20:39:57.871541+0000","last_fullsized":"2024-09-10T20:39:57.871541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:00.812828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870986+0000","last_change":"2024-09-10T20:39:56.879933+0000","last_active":"2024-09-10T20:39:57.870986+0000","last_peered":"2024-09-10T20:39:57.870986+0000","last_clean":"2024-09-10T20:39:57.870986+0000","last_became_active":"2024-09-10T20:39:56.879254+0000","last_became_peered":"2024-09-10T20:39:56.879254+0000","last_unstale":"2024-09-10T20:39:57.870986+0000","last_undegraded":"2024-09-10T20:39:57.870986+0000","last_fullsized":"2024-09-10T20:39:57.870986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:10.307223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456878+0000","last_change":"2024-09-10T20:39:52.852816+0000","last_active":"2024-09-10T20:39:58.456878+0000","last_peered":"2024-09-10T20:39:58.456878+0000","last_clean":"2024-09-10T20:39:58.456878+0000","last_became_active":"2024-09-10T20:39:52.851310+0000","last_became_peered":"2024-09-10T20:39:52.851310+0000","last_unstale":"2024-09-10T20:39:58.456878+0000","last_undegraded":"2024-09-10T20:39:58.456878+0000","last_fullsized":"2024-09-10T20:39:58.456878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:47.061819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577993+0000","last_change":"2024-09-10T20:39:51.831688+0000","last_active":"2024-09-10T20:39:58.577993+0000","last_peered":"2024-09-10T20:39:58.577993+0000","last_clean":"2024-09-10T20:39:58.577993+0000","last_became_active":"2024-09-10T20:39:51.827155+0000","last_became_peered":"2024-09-10T20:39:51.827155+0000","last_unstale":"2024-09-10T20:39:58.577993+0000","last_undegraded":"2024-09-10T20:39:58.577993+0000","last_fullsized":"2024-09-10T20:39:58.577993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:51:16.933625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872194+0000","last_change":"2024-09-10T20:39:56.882581+0000","last_active":"2024-09-10T20:39:57.872194+0000","last_peered":"2024-09-10T20:39:57.872194+0000","last_clean":"2024-09-10T20:39:57.872194+0000","last_became_active":"2024-09-10T20:39:56.882242+0000","last_became_peered":"2024-09-10T20:39:56.882242+0000","last_unstale":"2024-09-10T20:39:57.872194+0000","last_undegraded":"2024-09-10T20:39:57.872194+0000","last_fullsized":"2024-09-10T20:39:57.872194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:18.763655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577376+0000","last_change":"2024-09-10T20:39:52.858795+0000","last_active":"2024-09-10T20:39:58.577376+0000","last_peered":"2024-09-10T20:39:58.577376+0000","last_clean":"2024-09-10T20:39:58.577376+0000","last_became_active":"2024-09-10T20:39:52.858501+0000","last_became_peered":"2024-09-10T20:39:52.858501+0000","last_unstale":"2024-09-10T20:39:58.577376+0000","last_undegraded":"2024-09-10T20:39:58.577376+0000","last_fullsized":"2024-09-10T20:39:58.577376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:13.273835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456897+0000","last_change":"2024-09-10T20:39:51.838792+0000","last_active":"2024-09-10T20:39:58.456897+0000","last_peered":"2024-09-10T20:39:58.456897+0000","last_clean":"2024-09-10T20:39:58.456897+0000","last_became_active":"2024-09-10T20:39:51.838547+0000","last_became_peered":"2024-09-10T20:39:51.838547+0000","last_unstale":"2024-09-10T20:39:58.456897+0000","last_undegraded":"2024-09-10T20:39:58.456897+0000","last_fullsized":"2024-09-10T20:39:58.456897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:09.046672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075650+0000","last_change":"2024-09-10T20:39:56.872369+0000","last_active":"2024-09-10T20:39:58.075650+0000","last_peered":"2024-09-10T20:39:58.075650+0000","last_clean":"2024-09-10T20:39:58.075650+0000","last_became_active":"2024-09-10T20:39:56.871964+0000","last_became_peered":"2024-09-10T20:39:56.871964+0000","last_unstale":"2024-09-10T20:39:58.075650+0000","last_undegraded":"2024-09-10T20:39:58.075650+0000","last_fullsized":"2024-09-10T20:39:58.075650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:17.309739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872297+0000","last_change":"2024-09-10T20:39:52.848064+0000","last_active":"2024-09-10T20:39:57.872297+0000","last_peered":"2024-09-10T20:39:57.872297+0000","last_clean":"2024-09-10T20:39:57.872297+0000","last_became_active":"2024-09-10T20:39:52.847836+0000","last_became_peered":"2024-09-10T20:39:52.847836+0000","last_unstale":"2024-09-10T20:39:57.872297+0000","last_undegraded":"2024-09-10T20:39:57.872297+0000","last_fullsized":"2024-09-10T20:39:57.872297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:17.051921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577568+0000","last_change":"2024-09-10T20:39:51.827434+0000","last_active":"2024-09-10T20:39:58.577568+0000","last_peered":"2024-09-10T20:39:58.577568+0000","last_clean":"2024-09-10T20:39:58.577568+0000","last_became_active":"2024-09-10T20:39:51.826046+0000","last_became_peered":"2024-09-10T20:39:51.826046+0000","last_unstale":"2024-09-10T20:39:58.577568+0000","last_undegraded":"2024-09-10T20:39:58.577568+0000","last_fullsized":"2024-09-10T20:39:58.577568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:06.396463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871947+0000","last_change":"2024-09-10T20:39:56.879394+0000","last_active":"2024-09-10T20:39:57.871947+0000","last_peered":"2024-09-10T20:39:57.871947+0000","last_clean":"2024-09-10T20:39:57.871947+0000","last_became_active":"2024-09-10T20:39:56.879041+0000","last_became_peered":"2024-09-10T20:39:56.879041+0000","last_unstale":"2024-09-10T20:39:57.871947+0000","last_undegraded":"2024-09-10T20:39:57.871947+0000","last_fullsized":"2024-09-10T20:39:57.871947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:42.040215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075444+0000","last_change":"2024-09-10T20:39:52.836545+0000","last_active":"2024-09-10T20:39:58.075444+0000","last_peered":"2024-09-10T20:39:58.075444+0000","last_clean":"2024-09-10T20:39:58.075444+0000","last_became_active":"2024-09-10T20:39:52.836266+0000","last_became_peered":"2024-09-10T20:39:52.836266+0000","last_unstale":"2024-09-10T20:39:58.075444+0000","last_undegraded":"2024-09-10T20:39:58.075444+0000","last_fullsized":"2024-09-10T20:39:58.075444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:39.345060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456157+0000","last_change":"2024-09-10T20:39:51.833755+0000","last_active":"2024-09-10T20:39:58.456157+0000","last_peered":"2024-09-10T20:39:58.456157+0000","last_clean":"2024-09-10T20:39:58.456157+0000","last_became_active":"2024-09-10T20:39:51.833384+0000","last_became_peered":"2024-09-10T20:39:51.833384+0000","last_unstale":"2024-09-10T20:39:58.456157+0000","last_undegraded":"2024-09-10T20:39:58.456157+0000","last_fullsized":"2024-09-10T20:39:58.456157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:46.310312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871522+0000","last_change":"2024-09-10T20:39:56.876669+0000","last_active":"2024-09-10T20:39:57.871522+0000","last_peered":"2024-09-10T20:39:57.871522+0000","last_clean":"2024-09-10T20:39:57.871522+0000","last_became_active":"2024-09-10T20:39:56.876230+0000","last_became_peered":"2024-09-10T20:39:56.876230+0000","last_unstale":"2024-09-10T20:39:57.871522+0000","last_undegraded":"2024-09-10T20:39:57.871522+0000","last_fullsized":"2024-09-10T20:39:57.871522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:04.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872716+0000","last_change":"2024-09-10T20:39:52.840978+0000","last_active":"2024-09-10T20:39:57.872716+0000","last_peered":"2024-09-10T20:39:57.872716+0000","last_clean":"2024-09-10T20:39:57.872716+0000","last_became_active":"2024-09-10T20:39:52.840710+0000","last_became_peered":"2024-09-10T20:39:52.840710+0000","last_unstale":"2024-09-10T20:39:57.872716+0000","last_undegraded":"2024-09-10T20:39:57.872716+0000","last_fullsized":"2024-09-10T20:39:57.872716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:17.748663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872789+0000","last_change":"2024-09-10T20:39:51.837821+0000","last_active":"2024-09-10T20:39:57.872789+0000","last_peered":"2024-09-10T20:39:57.872789+0000","last_clean":"2024-09-10T20:39:57.872789+0000","last_became_active":"2024-09-10T20:39:51.836390+0000","last_became_peered":"2024-09-10T20:39:51.836390+0000","last_unstale":"2024-09-10T20:39:57.872789+0000","last_undegraded":"2024-09-10T20:39:57.872789+0000","last_fullsized":"2024-09-10T20:39:57.872789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:47.684343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869817+0000","last_change":"2024-09-10T20:39:56.875780+0000","last_active":"2024-09-10T20:39:57.869817+0000","last_peered":"2024-09-10T20:39:57.869817+0000","last_clean":"2024-09-10T20:39:57.869817+0000","last_became_active":"2024-09-10T20:39:56.875088+0000","last_became_peered":"2024-09-10T20:39:56.875088+0000","last_unstale":"2024-09-10T20:39:57.869817+0000","last_undegraded":"2024-09-10T20:39:57.869817+0000","last_fullsized":"2024-09-10T20:39:57.869817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:01:21.298196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870634+0000","last_change":"2024-09-10T20:39:52.856029+0000","last_active":"2024-09-10T20:39:57.870634+0000","last_peered":"2024-09-10T20:39:57.870634+0000","last_clean":"2024-09-10T20:39:57.870634+0000","last_became_active":"2024-09-10T20:39:52.855776+0000","last_became_peered":"2024-09-10T20:39:52.855776+0000","last_unstale":"2024-09-10T20:39:57.870634+0000","last_undegraded":"2024-09-10T20:39:57.870634+0000","last_fullsized":"2024-09-10T20:39:57.870634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:31.338948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578682+0000","last_change":"2024-09-10T20:39:51.828785+0000","last_active":"2024-09-10T20:39:58.578682+0000","last_peered":"2024-09-10T20:39:58.578682+0000","last_clean":"2024-09-10T20:39:58.578682+0000","last_became_active":"2024-09-10T20:39:51.828496+0000","last_became_peered":"2024-09-10T20:39:51.828496+0000","last_unstale":"2024-09-10T20:39:58.578682+0000","last_undegraded":"2024-09-10T20:39:58.578682+0000","last_fullsized":"2024-09-10T20:39:58.578682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:36.547419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873081+0000","last_change":"2024-09-10T20:39:56.885656+0000","last_active":"2024-09-10T20:39:57.873081+0000","last_peered":"2024-09-10T20:39:57.873081+0000","last_clean":"2024-09-10T20:39:57.873081+0000","last_became_active":"2024-09-10T20:39:56.881762+0000","last_became_peered":"2024-09-10T20:39:56.881762+0000","last_unstale":"2024-09-10T20:39:57.873081+0000","last_undegraded":"2024-09-10T20:39:57.873081+0000","last_fullsized":"2024-09-10T20:39:57.873081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:05:42.541386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456583+0000","last_change":"2024-09-10T20:39:52.851647+0000","last_active":"2024-09-10T20:39:58.456583+0000","last_peered":"2024-09-10T20:39:58.456583+0000","last_clean":"2024-09-10T20:39:58.456583+0000","last_became_active":"2024-09-10T20:39:52.851358+0000","last_became_peered":"2024-09-10T20:39:52.851358+0000","last_unstale":"2024-09-10T20:39:58.456583+0000","last_undegraded":"2024-09-10T20:39:58.456583+0000","last_fullsized":"2024-09-10T20:39:58.456583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:43.399295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:40:04.050528+0000","last_change":"2024-09-10T20:39:51.836741+0000","last_active":"2024-09-10T20:40:04.050528+0000","last_peered":"2024-09-10T20:40:04.050528+0000","last_clean":"2024-09-10T20:40:04.050528+0000","last_became_active":"2024-09-10T20:39:51.836492+0000","last_became_peered":"2024-09-10T20:39:51.836492+0000","last_unstale":"2024-09-10T20:40:04.050528+0000","last_undegraded":"2024-09-10T20:40:04.050528+0000","last_fullsized":"2024-09-10T20:40:04.050528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:23.827648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577118+0000","last_change":"2024-09-10T20:39:56.870600+0000","last_active":"2024-09-10T20:39:58.577118+0000","last_peered":"2024-09-10T20:39:58.577118+0000","last_clean":"2024-09-10T20:39:58.577118+0000","last_became_active":"2024-09-10T20:39:56.870128+0000","last_became_peered":"2024-09-10T20:39:56.870128+0000","last_unstale":"2024-09-10T20:39:58.577118+0000","last_undegraded":"2024-09-10T20:39:58.577118+0000","last_fullsized":"2024-09-10T20:39:58.577118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:24.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872529+0000","last_change":"2024-09-10T20:39:52.867767+0000","last_active":"2024-09-10T20:39:57.872529+0000","last_peered":"2024-09-10T20:39:57.872529+0000","last_clean":"2024-09-10T20:39:57.872529+0000","last_became_active":"2024-09-10T20:39:52.867458+0000","last_became_peered":"2024-09-10T20:39:52.867458+0000","last_unstale":"2024-09-10T20:39:57.872529+0000","last_undegraded":"2024-09-10T20:39:57.872529+0000","last_fullsized":"2024-09-10T20:39:57.872529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:38.084789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578769+0000","last_change":"2024-09-10T20:39:51.836668+0000","last_active":"2024-09-10T20:39:58.578769+0000","last_peered":"2024-09-10T20:39:58.578769+0000","last_clean":"2024-09-10T20:39:58.578769+0000","last_became_active":"2024-09-10T20:39:51.835742+0000","last_became_peered":"2024-09-10T20:39:51.835742+0000","last_unstale":"2024-09-10T20:39:58.578769+0000","last_undegraded":"2024-09-10T20:39:58.578769+0000","last_fullsized":"2024-09-10T20:39:58.578769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576664+0000","last_change":"2024-09-10T20:39:56.882037+0000","last_active":"2024-09-10T20:39:58.576664+0000","last_peered":"2024-09-10T20:39:58.576664+0000","last_clean":"2024-09-10T20:39:58.576664+0000","last_became_active":"2024-09-10T20:39:56.881084+0000","last_became_peered":"2024-09-10T20:39:56.881084+0000","last_unstale":"2024-09-10T20:39:58.576664+0000","last_undegraded":"2024-09-10T20:39:58.576664+0000","last_fullsized":"2024-09-10T20:39:58.576664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:20.214697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871674+0000","last_change":"2024-09-10T20:39:52.849174+0000","last_active":"2024-09-10T20:39:57.871674+0000","last_peered":"2024-09-10T20:39:57.871674+0000","last_clean":"2024-09-10T20:39:57.871674+0000","last_became_active":"2024-09-10T20:39:52.848762+0000","last_became_peered":"2024-09-10T20:39:52.848762+0000","last_unstale":"2024-09-10T20:39:57.871674+0000","last_undegraded":"2024-09-10T20:39:57.871674+0000","last_fullsized":"2024-09-10T20:39:57.871674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:16.849067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456678+0000","last_change":"2024-09-10T20:39:51.827946+0000","last_active":"2024-09-10T20:39:58.456678+0000","last_peered":"2024-09-10T20:39:58.456678+0000","last_clean":"2024-09-10T20:39:58.456678+0000","last_became_active":"2024-09-10T20:39:51.827668+0000","last_became_peered":"2024-09-10T20:39:51.827668+0000","last_unstale":"2024-09-10T20:39:58.456678+0000","last_undegraded":"2024-09-10T20:39:58.456678+0000","last_fullsized":"2024-09-10T20:39:58.456678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576917+0000","last_change":"2024-09-10T20:39:56.890560+0000","last_active":"2024-09-10T20:39:58.576917+0000","last_peered":"2024-09-10T20:39:58.576917+0000","last_clean":"2024-09-10T20:39:58.576917+0000","last_became_active":"2024-09-10T20:39:56.890207+0000","last_became_peered":"2024-09-10T20:39:56.890207+0000","last_unstale":"2024-09-10T20:39:58.576917+0000","last_undegraded":"2024-09-10T20:39:58.576917+0000","last_fullsized":"2024-09-10T20:39:58.576917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:35.374852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577293+0000","last_change":"2024-09-10T20:39:52.865954+0000","last_active":"2024-09-10T20:39:58.577293+0000","last_peered":"2024-09-10T20:39:58.577293+0000","last_clean":"2024-09-10T20:39:58.577293+0000","last_became_active":"2024-09-10T20:39:52.865077+0000","last_became_peered":"2024-09-10T20:39:52.865077+0000","last_unstale":"2024-09-10T20:39:58.577293+0000","last_undegraded":"2024-09-10T20:39:58.577293+0000","last_fullsized":"2024-09-10T20:39:58.577293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:20.726727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076179+0000","last_change":"2024-09-10T20:39:51.822729+0000","last_active":"2024-09-10T20:39:58.076179+0000","last_peered":"2024-09-10T20:39:58.076179+0000","last_clean":"2024-09-10T20:39:58.076179+0000","last_became_active":"2024-09-10T20:39:51.822465+0000","last_became_peered":"2024-09-10T20:39:51.822465+0000","last_unstale":"2024-09-10T20:39:58.076179+0000","last_undegraded":"2024-09-10T20:39:58.076179+0000","last_fullsized":"2024-09-10T20:39:58.076179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:48:42.278682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577450+0000","last_change":"2024-09-10T20:39:56.871160+0000","last_active":"2024-09-10T20:39:58.577450+0000","last_peered":"2024-09-10T20:39:58.577450+0000","last_clean":"2024-09-10T20:39:58.577450+0000","last_became_active":"2024-09-10T20:39:56.870762+0000","last_became_peered":"2024-09-10T20:39:56.870762+0000","last_unstale":"2024-09-10T20:39:58.577450+0000","last_undegraded":"2024-09-10T20:39:58.577450+0000","last_fullsized":"2024-09-10T20:39:58.577450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:40.866667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577908+0000","last_change":"2024-09-10T20:39:56.875335+0000","last_active":"2024-09-10T20:39:58.577908+0000","last_peered":"2024-09-10T20:39:58.577908+0000","last_clean":"2024-09-10T20:39:58.577908+0000","last_became_active":"2024-09-10T20:39:56.874929+0000","last_became_peered":"2024-09-10T20:39:56.874929+0000","last_unstale":"2024-09-10T20:39:58.577908+0000","last_undegraded":"2024-09-10T20:39:58.577908+0000","last_fullsized":"2024-09-10T20:39:58.577908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:00.877805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577652+0000","last_change":"2024-09-10T20:39:52.841133+0000","last_active":"2024-09-10T20:39:58.577652+0000","last_peered":"2024-09-10T20:39:58.577652+0000","last_clean":"2024-09-10T20:39:58.577652+0000","last_became_active":"2024-09-10T20:39:52.840806+0000","last_became_peered":"2024-09-10T20:39:52.840806+0000","last_unstale":"2024-09-10T20:39:58.577652+0000","last_undegraded":"2024-09-10T20:39:58.577652+0000","last_fullsized":"2024-09-10T20:39:58.577652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:01:22.822899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872394+0000","last_change":"2024-09-10T20:39:51.834171+0000","last_active":"2024-09-10T20:39:57.872394+0000","last_peered":"2024-09-10T20:39:57.872394+0000","last_clean":"2024-09-10T20:39:57.872394+0000","last_became_active":"2024-09-10T20:39:51.833897+0000","last_became_peered":"2024-09-10T20:39:51.833897+0000","last_unstale":"2024-09-10T20:39:57.872394+0000","last_undegraded":"2024-09-10T20:39:57.872394+0000","last_fullsized":"2024-09-10T20:39:57.872394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:19.719836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872638+0000","last_change":"2024-09-10T20:39:56.872254+0000","last_active":"2024-09-10T20:39:57.872638+0000","last_peered":"2024-09-10T20:39:57.872638+0000","last_clean":"2024-09-10T20:39:57.872638+0000","last_became_active":"2024-09-10T20:39:56.871890+0000","last_became_peered":"2024-09-10T20:39:56.871890+0000","last_unstale":"2024-09-10T20:39:57.872638+0000","last_undegraded":"2024-09-10T20:39:57.872638+0000","last_fullsized":"2024-09-10T20:39:57.872638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:13.381295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869957+0000","last_change":"2024-09-10T20:39:52.851621+0000","last_active":"2024-09-10T20:39:57.869957+0000","last_peered":"2024-09-10T20:39:57.869957+0000","last_clean":"2024-09-10T20:39:57.869957+0000","last_became_active":"2024-09-10T20:39:52.851307+0000","last_became_peered":"2024-09-10T20:39:52.851307+0000","last_unstale":"2024-09-10T20:39:57.869957+0000","last_undegraded":"2024-09-10T20:39:57.869957+0000","last_fullsized":"2024-09-10T20:39:57.869957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:02.811490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869951+0000","last_change":"2024-09-10T20:39:51.832088+0000","last_active":"2024-09-10T20:39:57.869951+0000","last_peered":"2024-09-10T20:39:57.869951+0000","last_clean":"2024-09-10T20:39:57.869951+0000","last_became_active":"2024-09-10T20:39:51.831590+0000","last_became_peered":"2024-09-10T20:39:51.831590+0000","last_unstale":"2024-09-10T20:39:57.869951+0000","last_undegraded":"2024-09-10T20:39:57.869951+0000","last_fullsized":"2024-09-10T20:39:57.869951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:11.450509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872645+0000","last_change":"2024-09-10T20:39:51.841531+0000","last_active":"2024-09-10T20:39:57.872645+0000","last_peered":"2024-09-10T20:39:57.872645+0000","last_clean":"2024-09-10T20:39:57.872645+0000","last_became_active":"2024-09-10T20:39:51.841294+0000","last_became_peered":"2024-09-10T20:39:51.841294+0000","last_unstale":"2024-09-10T20:39:57.872645+0000","last_undegraded":"2024-09-10T20:39:57.872645+0000","last_fullsized":"2024-09-10T20:39:57.872645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:05.649879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.838524+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.838252+0000","last_became_peered":"2024-09-10T20:39:52.838252+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:32.234408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577531+0000","last_change":"2024-09-10T20:39:56.874073+0000","last_active":"2024-09-10T20:39:58.577531+0000","last_peered":"2024-09-10T20:39:58.577531+0000","last_clean":"2024-09-10T20:39:58.577531+0000","last_became_active":"2024-09-10T20:39:56.873456+0000","last_became_peered":"2024-09-10T20:39:56.873456+0000","last_unstale":"2024-09-10T20:39:58.577531+0000","last_undegraded":"2024-09-10T20:39:58.577531+0000","last_fullsized":"2024-09-10T20:39:58.577531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:51.097723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870967+0000","last_change":"2024-09-10T20:39:51.823981+0000","last_active":"2024-09-10T20:39:57.870967+0000","last_peered":"2024-09-10T20:39:57.870967+0000","last_clean":"2024-09-10T20:39:57.870967+0000","last_became_active":"2024-09-10T20:39:51.823667+0000","last_became_peered":"2024-09-10T20:39:51.823667+0000","last_unstale":"2024-09-10T20:39:57.870967+0000","last_undegraded":"2024-09-10T20:39:57.870967+0000","last_fullsized":"2024-09-10T20:39:57.870967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:50.794751+0000","last_clean_scrub_stamp":"2024-09-10T20:39:50.794751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:06:53.926735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075527+0000","last_change":"2024-09-10T20:39:52.842250+0000","last_active":"2024-09-10T20:39:58.075527+0000","last_peered":"2024-09-10T20:39:58.075527+0000","last_clean":"2024-09-10T20:39:58.075527+0000","last_became_active":"2024-09-10T20:39:52.842013+0000","last_became_peered":"2024-09-10T20:39:52.842013+0000","last_unstale":"2024-09-10T20:39:58.075527+0000","last_undegraded":"2024-09-10T20:39:58.075527+0000","last_fullsized":"2024-09-10T20:39:58.075527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:19.358235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578569+0000","last_change":"2024-09-10T20:39:56.873781+0000","last_active":"2024-09-10T20:39:58.578569+0000","last_peered":"2024-09-10T20:39:58.578569+0000","last_clean":"2024-09-10T20:39:58.578569+0000","last_became_active":"2024-09-10T20:39:56.871150+0000","last_became_peered":"2024-09-10T20:39:56.871150+0000","last_unstale":"2024-09-10T20:39:58.578569+0000","last_undegraded":"2024-09-10T20:39:58.578569+0000","last_fullsized":"2024-09-10T20:39:58.578569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:55.837546+0000","last_clean_scrub_stamp":"2024-09-10T20:39:55.837546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:03.889499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576369+0000","last_change":"2024-09-10T20:39:52.858032+0000","last_active":"2024-09-10T20:39:58.576369+0000","last_peered":"2024-09-10T20:39:58.576369+0000","last_clean":"2024-09-10T20:39:58.576369+0000","last_became_active":"2024-09-10T20:39:52.851049+0000","last_became_peered":"2024-09-10T20:39:52.851049+0000","last_unstale":"2024-09-10T20:39:58.576369+0000","last_undegraded":"2024-09-10T20:39:58.576369+0000","last_fullsized":"2024-09-10T20:39:58.576369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:42:06.656770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577351+0000","last_change":"2024-09-10T20:39:52.850149+0000","last_active":"2024-09-10T20:39:58.577351+0000","last_peered":"2024-09-10T20:39:58.577351+0000","last_clean":"2024-09-10T20:39:58.577351+0000","last_became_active":"2024-09-10T20:39:52.849435+0000","last_became_peered":"2024-09-10T20:39:52.849435+0000","last_unstale":"2024-09-10T20:39:58.577351+0000","last_undegraded":"2024-09-10T20:39:58.577351+0000","last_fullsized":"2024-09-10T20:39:58.577351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:13.186313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872460+0000","last_change":"2024-09-10T20:39:52.849458+0000","last_active":"2024-09-10T20:39:57.872460+0000","last_peered":"2024-09-10T20:39:57.872460+0000","last_clean":"2024-09-10T20:39:57.872460+0000","last_became_active":"2024-09-10T20:39:52.844995+0000","last_became_peered":"2024-09-10T20:39:52.844995+0000","last_unstale":"2024-09-10T20:39:57.872460+0000","last_undegraded":"2024-09-10T20:39:57.872460+0000","last_fullsized":"2024-09-10T20:39:57.872460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870856+0000","last_change":"2024-09-10T20:39:52.840179+0000","last_active":"2024-09-10T20:39:57.870856+0000","last_peered":"2024-09-10T20:39:57.870856+0000","last_clean":"2024-09-10T20:39:57.870856+0000","last_became_active":"2024-09-10T20:39:52.839890+0000","last_became_peered":"2024-09-10T20:39:52.839890+0000","last_unstale":"2024-09-10T20:39:57.870856+0000","last_undegraded":"2024-09-10T20:39:57.870856+0000","last_fullsized":"2024-09-10T20:39:57.870856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:20:47.732259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870243+0000","last_change":"2024-09-10T20:39:52.853516+0000","last_active":"2024-09-10T20:39:57.870243+0000","last_peered":"2024-09-10T20:39:57.870243+0000","last_clean":"2024-09-10T20:39:57.870243+0000","last_became_active":"2024-09-10T20:39:52.853256+0000","last_became_peered":"2024-09-10T20:39:52.853256+0000","last_unstale":"2024-09-10T20:39:57.870243+0000","last_undegraded":"2024-09-10T20:39:57.870243+0000","last_fullsized":"2024-09-10T20:39:57.870243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:59.853596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870433+0000","last_change":"2024-09-10T20:39:52.859738+0000","last_active":"2024-09-10T20:39:57.870433+0000","last_peered":"2024-09-10T20:39:57.870433+0000","last_clean":"2024-09-10T20:39:57.870433+0000","last_became_active":"2024-09-10T20:39:52.859463+0000","last_became_peered":"2024-09-10T20:39:52.859463+0000","last_unstale":"2024-09-10T20:39:57.870433+0000","last_undegraded":"2024-09-10T20:39:57.870433+0000","last_fullsized":"2024-09-10T20:39:57.870433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:45:55.113983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577211+0000","last_change":"2024-09-10T20:39:52.867039+0000","last_active":"2024-09-10T20:39:58.577211+0000","last_peered":"2024-09-10T20:39:58.577211+0000","last_clean":"2024-09-10T20:39:58.577211+0000","last_became_active":"2024-09-10T20:39:52.865884+0000","last_became_peered":"2024-09-10T20:39:52.865884+0000","last_unstale":"2024-09-10T20:39:58.577211+0000","last_undegraded":"2024-09-10T20:39:58.577211+0000","last_fullsized":"2024-09-10T20:39:58.577211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:39.994022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871253+0000","last_change":"2024-09-10T20:39:52.844959+0000","last_active":"2024-09-10T20:39:57.871253+0000","last_peered":"2024-09-10T20:39:57.871253+0000","last_clean":"2024-09-10T20:39:57.871253+0000","last_became_active":"2024-09-10T20:39:52.844642+0000","last_became_peered":"2024-09-10T20:39:52.844642+0000","last_unstale":"2024-09-10T20:39:57.871253+0000","last_undegraded":"2024-09-10T20:39:57.871253+0000","last_fullsized":"2024-09-10T20:39:57.871253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:52:36.606145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872318+0000","last_change":"2024-09-10T20:39:52.844163+0000","last_active":"2024-09-10T20:39:57.872318+0000","last_peered":"2024-09-10T20:39:57.872318+0000","last_clean":"2024-09-10T20:39:57.872318+0000","last_became_active":"2024-09-10T20:39:52.843914+0000","last_became_peered":"2024-09-10T20:39:52.843914+0000","last_unstale":"2024-09-10T20:39:57.872318+0000","last_undegraded":"2024-09-10T20:39:57.872318+0000","last_fullsized":"2024-09-10T20:39:57.872318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:42:57.293478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869918+0000","last_change":"2024-09-10T20:39:52.858267+0000","last_active":"2024-09-10T20:39:57.869918+0000","last_peered":"2024-09-10T20:39:57.869918+0000","last_clean":"2024-09-10T20:39:57.869918+0000","last_became_active":"2024-09-10T20:39:52.857994+0000","last_became_peered":"2024-09-10T20:39:52.857994+0000","last_unstale":"2024-09-10T20:39:57.869918+0000","last_undegraded":"2024-09-10T20:39:57.869918+0000","last_fullsized":"2024-09-10T20:39:57.869918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:54.050142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.075525+0000","last_change":"2024-09-10T20:39:52.839856+0000","last_active":"2024-09-10T20:39:58.075525+0000","last_peered":"2024-09-10T20:39:58.075525+0000","last_clean":"2024-09-10T20:39:58.075525+0000","last_became_active":"2024-09-10T20:39:52.839371+0000","last_became_peered":"2024-09-10T20:39:52.839371+0000","last_unstale":"2024-09-10T20:39:58.075525+0000","last_undegraded":"2024-09-10T20:39:58.075525+0000","last_fullsized":"2024-09-10T20:39:58.075525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:42:26.611475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.577919+0000","last_change":"2024-09-10T20:39:52.847903+0000","last_active":"2024-09-10T20:39:58.577919+0000","last_peered":"2024-09-10T20:39:58.577919+0000","last_clean":"2024-09-10T20:39:58.577919+0000","last_became_active":"2024-09-10T20:39:52.845560+0000","last_became_peered":"2024-09-10T20:39:52.845560+0000","last_unstale":"2024-09-10T20:39:58.577919+0000","last_undegraded":"2024-09-10T20:39:58.577919+0000","last_fullsized":"2024-09-10T20:39:58.577919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:17.131990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456492+0000","last_change":"2024-09-10T20:39:52.848817+0000","last_active":"2024-09-10T20:39:58.456492+0000","last_peered":"2024-09-10T20:39:58.456492+0000","last_clean":"2024-09-10T20:39:58.456492+0000","last_became_active":"2024-09-10T20:39:52.848189+0000","last_became_peered":"2024-09-10T20:39:52.848189+0000","last_unstale":"2024-09-10T20:39:58.456492+0000","last_undegraded":"2024-09-10T20:39:58.456492+0000","last_fullsized":"2024-09-10T20:39:58.456492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:21.966758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873355+0000","last_change":"2024-09-10T20:39:52.846495+0000","last_active":"2024-09-10T20:39:57.873355+0000","last_peered":"2024-09-10T20:39:57.873355+0000","last_clean":"2024-09-10T20:39:57.873355+0000","last_became_active":"2024-09-10T20:39:52.846187+0000","last_became_peered":"2024-09-10T20:39:52.846187+0000","last_unstale":"2024-09-10T20:39:57.873355+0000","last_undegraded":"2024-09-10T20:39:57.873355+0000","last_fullsized":"2024-09-10T20:39:57.873355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:15.910087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.578849+0000","last_change":"2024-09-10T20:39:52.862017+0000","last_active":"2024-09-10T20:39:58.578849+0000","last_peered":"2024-09-10T20:39:58.578849+0000","last_clean":"2024-09-10T20:39:58.578849+0000","last_became_active":"2024-09-10T20:39:52.861762+0000","last_became_peered":"2024-09-10T20:39:52.861762+0000","last_unstale":"2024-09-10T20:39:58.578849+0000","last_undegraded":"2024-09-10T20:39:58.578849+0000","last_fullsized":"2024-09-10T20:39:58.578849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:10.053563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.873597+0000","last_change":"2024-09-10T20:39:52.849628+0000","last_active":"2024-09-10T20:39:57.873597+0000","last_peered":"2024-09-10T20:39:57.873597+0000","last_clean":"2024-09-10T20:39:57.873597+0000","last_became_active":"2024-09-10T20:39:52.849327+0000","last_became_peered":"2024-09-10T20:39:52.849327+0000","last_unstale":"2024-09-10T20:39:57.873597+0000","last_undegraded":"2024-09-10T20:39:57.873597+0000","last_fullsized":"2024-09-10T20:39:57.873597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:13.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.872215+0000","last_change":"2024-09-10T20:39:52.859978+0000","last_active":"2024-09-10T20:39:57.872215+0000","last_peered":"2024-09-10T20:39:57.872215+0000","last_clean":"2024-09-10T20:39:57.872215+0000","last_became_active":"2024-09-10T20:39:52.859786+0000","last_became_peered":"2024-09-10T20:39:52.859786+0000","last_unstale":"2024-09-10T20:39:57.872215+0000","last_undegraded":"2024-09-10T20:39:57.872215+0000","last_fullsized":"2024-09-10T20:39:57.872215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869715+0000","last_change":"2024-09-10T20:39:52.839446+0000","last_active":"2024-09-10T20:39:57.869715+0000","last_peered":"2024-09-10T20:39:57.869715+0000","last_clean":"2024-09-10T20:39:57.869715+0000","last_became_active":"2024-09-10T20:39:52.839065+0000","last_became_peered":"2024-09-10T20:39:52.839065+0000","last_unstale":"2024-09-10T20:39:57.869715+0000","last_undegraded":"2024-09-10T20:39:57.869715+0000","last_fullsized":"2024-09-10T20:39:57.869715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:18:21.362301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.870520+0000","last_change":"2024-09-10T20:39:52.850996+0000","last_active":"2024-09-10T20:39:57.870520+0000","last_peered":"2024-09-10T20:39:57.870520+0000","last_clean":"2024-09-10T20:39:57.870520+0000","last_became_active":"2024-09-10T20:39:52.850689+0000","last_became_peered":"2024-09-10T20:39:52.850689+0000","last_unstale":"2024-09-10T20:39:57.870520+0000","last_undegraded":"2024-09-10T20:39:57.870520+0000","last_fullsized":"2024-09-10T20:39:57.870520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:41.036260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871243+0000","last_change":"2024-09-10T20:39:52.852058+0000","last_active":"2024-09-10T20:39:57.871243+0000","last_peered":"2024-09-10T20:39:57.871243+0000","last_clean":"2024-09-10T20:39:57.871243+0000","last_became_active":"2024-09-10T20:39:52.851810+0000","last_became_peered":"2024-09-10T20:39:52.851810+0000","last_unstale":"2024-09-10T20:39:57.871243+0000","last_undegraded":"2024-09-10T20:39:57.871243+0000","last_fullsized":"2024-09-10T20:39:57.871243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:53.759604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456464+0000","last_change":"2024-09-10T20:39:52.848422+0000","last_active":"2024-09-10T20:39:58.456464+0000","last_peered":"2024-09-10T20:39:58.456464+0000","last_clean":"2024-09-10T20:39:58.456464+0000","last_became_active":"2024-09-10T20:39:52.847754+0000","last_became_peered":"2024-09-10T20:39:52.847754+0000","last_unstale":"2024-09-10T20:39:58.456464+0000","last_undegraded":"2024-09-10T20:39:58.456464+0000","last_fullsized":"2024-09-10T20:39:58.456464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:20.826273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456507+0000","last_change":"2024-09-10T20:39:52.848711+0000","last_active":"2024-09-10T20:39:58.456507+0000","last_peered":"2024-09-10T20:39:58.456507+0000","last_clean":"2024-09-10T20:39:58.456507+0000","last_became_active":"2024-09-10T20:39:52.848350+0000","last_became_peered":"2024-09-10T20:39:52.848350+0000","last_unstale":"2024-09-10T20:39:58.456507+0000","last_undegraded":"2024-09-10T20:39:58.456507+0000","last_fullsized":"2024-09-10T20:39:58.456507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:57.850783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456664+0000","last_change":"2024-09-10T20:39:52.858551+0000","last_active":"2024-09-10T20:39:58.456664+0000","last_peered":"2024-09-10T20:39:58.456664+0000","last_clean":"2024-09-10T20:39:58.456664+0000","last_became_active":"2024-09-10T20:39:52.858293+0000","last_became_peered":"2024-09-10T20:39:52.858293+0000","last_unstale":"2024-09-10T20:39:58.456664+0000","last_undegraded":"2024-09-10T20:39:58.456664+0000","last_fullsized":"2024-09-10T20:39:58.456664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:16.178794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.076168+0000","last_change":"2024-09-10T20:39:52.846940+0000","last_active":"2024-09-10T20:39:58.076168+0000","last_peered":"2024-09-10T20:39:58.076168+0000","last_clean":"2024-09-10T20:39:58.076168+0000","last_became_active":"2024-09-10T20:39:52.846684+0000","last_became_peered":"2024-09-10T20:39:52.846684+0000","last_unstale":"2024-09-10T20:39:58.076168+0000","last_undegraded":"2024-09-10T20:39:58.076168+0000","last_fullsized":"2024-09-10T20:39:58.076168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.869746+0000","last_change":"2024-09-10T20:39:52.837716+0000","last_active":"2024-09-10T20:39:57.869746+0000","last_peered":"2024-09-10T20:39:57.869746+0000","last_clean":"2024-09-10T20:39:57.869746+0000","last_became_active":"2024-09-10T20:39:52.837340+0000","last_became_peered":"2024-09-10T20:39:52.837340+0000","last_unstale":"2024-09-10T20:39:57.869746+0000","last_undegraded":"2024-09-10T20:39:57.869746+0000","last_fullsized":"2024-09-10T20:39:57.869746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:24.144804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456132+0000","last_change":"2024-09-10T20:39:52.844070+0000","last_active":"2024-09-10T20:39:58.456132+0000","last_peered":"2024-09-10T20:39:58.456132+0000","last_clean":"2024-09-10T20:39:58.456132+0000","last_became_active":"2024-09-10T20:39:52.843767+0000","last_became_peered":"2024-09-10T20:39:52.843767+0000","last_unstale":"2024-09-10T20:39:58.456132+0000","last_undegraded":"2024-09-10T20:39:58.456132+0000","last_fullsized":"2024-09-10T20:39:58.456132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:25.772255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576576+0000","last_change":"2024-09-10T20:39:52.857416+0000","last_active":"2024-09-10T20:39:58.576576+0000","last_peered":"2024-09-10T20:39:58.576576+0000","last_clean":"2024-09-10T20:39:58.576576+0000","last_became_active":"2024-09-10T20:39:52.857072+0000","last_became_peered":"2024-09-10T20:39:52.857072+0000","last_unstale":"2024-09-10T20:39:58.576576+0000","last_undegraded":"2024-09-10T20:39:58.576576+0000","last_fullsized":"2024-09-10T20:39:58.576576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:55:48.691234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456292+0000","last_change":"2024-09-10T20:39:52.848949+0000","last_active":"2024-09-10T20:39:58.456292+0000","last_peered":"2024-09-10T20:39:58.456292+0000","last_clean":"2024-09-10T20:39:58.456292+0000","last_became_active":"2024-09-10T20:39:52.848651+0000","last_became_peered":"2024-09-10T20:39:52.848651+0000","last_unstale":"2024-09-10T20:39:58.456292+0000","last_undegraded":"2024-09-10T20:39:58.456292+0000","last_fullsized":"2024-09-10T20:39:58.456292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:21:15.293386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.576714+0000","last_change":"2024-09-10T20:39:52.866936+0000","last_active":"2024-09-10T20:39:58.576714+0000","last_peered":"2024-09-10T20:39:58.576714+0000","last_clean":"2024-09-10T20:39:58.576714+0000","last_became_active":"2024-09-10T20:39:52.857238+0000","last_became_peered":"2024-09-10T20:39:52.857238+0000","last_unstale":"2024-09-10T20:39:58.576714+0000","last_undegraded":"2024-09-10T20:39:58.576714+0000","last_fullsized":"2024-09-10T20:39:58.576714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:15:37.350135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871449+0000","last_change":"2024-09-10T20:39:52.847418+0000","last_active":"2024-09-10T20:39:57.871449+0000","last_peered":"2024-09-10T20:39:57.871449+0000","last_clean":"2024-09-10T20:39:57.871449+0000","last_became_active":"2024-09-10T20:39:52.847135+0000","last_became_peered":"2024-09-10T20:39:52.847135+0000","last_unstale":"2024-09-10T20:39:57.871449+0000","last_undegraded":"2024-09-10T20:39:57.871449+0000","last_fullsized":"2024-09-10T20:39:57.871449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:23:41.028633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:57.871755+0000","last_change":"2024-09-10T20:39:52.858784+0000","last_active":"2024-09-10T20:39:57.871755+0000","last_peered":"2024-09-10T20:39:57.871755+0000","last_clean":"2024-09-10T20:39:57.871755+0000","last_became_active":"2024-09-10T20:39:52.858556+0000","last_became_peered":"2024-09-10T20:39:52.858556+0000","last_unstale":"2024-09-10T20:39:57.871755+0000","last_undegraded":"2024-09-10T20:39:57.871755+0000","last_fullsized":"2024-09-10T20:39:57.871755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:04.350523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-10T20:39:58.456833+0000","last_change":"2024-09-10T20:39:52.856985+0000","last_active":"2024-09-10T20:39:58.456833+0000","last_peered":"2024-09-10T20:39:58.456833+0000","last_clean":"2024-09-10T20:39:58.456833+0000","last_became_active":"2024-09-10T20:39:52.853995+0000","last_became_peered":"2024-09-10T20:39:52.853995+0000","last_unstale":"2024-09-10T20:39:58.456833+0000","last_undegraded":"2024-09-10T20:39:58.456833+0000","last_fullsized":"2024-09-10T20:39:58.456833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:51.801642+0000","last_clean_scrub_stamp":"2024-09-10T20:39:51.801642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:55:36.830764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:40:19.366 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:40:19.366 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T20:40:19.366 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T20:40:19.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T20:40:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 -- 172.21.15.81:0/3399691355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 msgr2=0x7faf5c0d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 --2- 172.21.15.81:0/3399691355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 0x7faf5c0d2090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faf48009830 tx=0x7faf4802a490 comp rx=0 tx=0).stop 2024-09-10T20:40:19.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 -- 172.21.15.81:0/3399691355 shutdown_connections 2024-09-10T20:40:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 --2- 172.21.15.81:0/3399691355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 0x7faf5c0d2090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 --2- 172.21.15.81:0/3399691355 >> v2:172.21.15.143:3300/0 conn(0x7faf5c161140 0x7faf5c0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 -- 172.21.15.81:0/3399691355 >> 172.21.15.81:0/3399691355 conn(0x7faf5c0d3ab0 msgr2=0x7faf5c0d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 -- 172.21.15.81:0/3399691355 shutdown_connections 2024-09-10T20:40:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.555+0000 7faf61600640 1 -- 172.21.15.81:0/3399691355 wait complete. 2024-09-10T20:40:19.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.557+0000 7faf61600640 1 Processor -- start 2024-09-10T20:40:19.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.557+0000 7faf61600640 1 -- start start 2024-09-10T20:40:19.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf61600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 0x7faf5c0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf61600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c161140 0x7faf5c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf61600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c0b56b0 0x7faf5c0cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf61600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c06e770 con 0x7faf5c0b56b0 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf61600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c161730 con 0x7faf5c161140 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf61600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c06e8f0 con 0x7faf5c06e0a0 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c0b56b0 0x7faf5c0cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c0b56b0 0x7faf5c0cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52640/0 (socket says 172.21.15.81:52640) 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 -- 172.21.15.81:0/2463665071 learned_addr learned my addr 172.21.15.81:0/2463665071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf5b400640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c161140 0x7faf5c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf5be00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 0x7faf5c0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 -- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 msgr2=0x7faf5c0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 0x7faf5c0c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 -- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c161140 msgr2=0x7faf5c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c161140 0x7faf5c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf60c00640 1 -- 172.21.15.81:0/2463665071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c0c9740 con 0x7faf5c0b56b0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.558+0000 7faf5be00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 0x7faf5c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.559+0000 7faf60c00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c0b56b0 0x7faf5c0cfcb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf54007fd0 tx=0x7faf5400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.559+0000 7faf53e00640 1 -- 172.21.15.81:0/2463665071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54011790 con 0x7faf5c0b56b0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.559+0000 7faf53e00640 1 -- 172.21.15.81:0/2463665071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf54017070 con 0x7faf5c0b56b0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.559+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c0c9a20 con 0x7faf5c0b56b0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.559+0000 7faf53e00640 1 -- 172.21.15.81:0/2463665071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54011ce0 con 0x7faf5c0b56b0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.559+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c0b3500 con 0x7faf5c0b56b0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.560+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c0c9f40 con 0x7faf5c0b56b0 2024-09-10T20:40:19.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.561+0000 7faf53e00640 1 -- 172.21.15.81:0/2463665071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faf5401c460 con 0x7faf5c0b56b0 2024-09-10T20:40:19.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.562+0000 7faf53e00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf3c077f70 0x7faf3c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.562+0000 7faf53e00640 1 -- 172.21.15.81:0/2463665071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faf54099f70 con 0x7faf5c0b56b0 2024-09-10T20:40:19.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.562+0000 7faf5be00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf3c077f70 0x7faf3c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.563+0000 7faf5be00640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf3c077f70 0x7faf3c07a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf4c005fd0 tx=0x7faf4c009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.566+0000 7faf53e00640 1 -- 172.21.15.81:0/2463665071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faf5c0c9f40 con 0x7faf5c0b56b0 2024-09-10T20:40:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.788+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faf5c0cdf60 con 0x7faf5c0b56b0 2024-09-10T20:40:19.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.788+0000 7faf53e00640 1 -- 172.21.15.81:0/2463665071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7faf54062600 con 0x7faf5c0b56b0 2024-09-10T20:40:19.792 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:19.792 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T20:40:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf3c077f70 msgr2=0x7faf3c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf3c077f70 0x7faf3c07a430 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf4c005fd0 tx=0x7faf4c009500 comp rx=0 tx=0).stop 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c0b56b0 msgr2=0x7faf5c0cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c0b56b0 0x7faf5c0cfcb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf54007fd0 tx=0x7faf5400c890 comp rx=0 tx=0).stop 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 shutdown_connections 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf3c077f70 0x7faf3c07a430 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c0b56b0 0x7faf5c0cfcb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c161140 0x7faf5c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 --2- 172.21.15.81:0/2463665071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c06e0a0 0x7faf5c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 >> 172.21.15.81:0/2463665071 conn(0x7faf5c0d3ab0 msgr2=0x7faf5c1e9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 shutdown_connections 2024-09-10T20:40:19.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.790+0000 7faf61600640 1 -- 172.21.15.81:0/2463665071 wait complete. 2024-09-10T20:40:19.810 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T20:40:19.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.963+0000 7fda7d400640 1 -- 172.21.15.81:0/2096913627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 msgr2=0x7fda780b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.963+0000 7fda7d400640 1 --2- 172.21.15.81:0/2096913627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda780b7780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda70005fd0 tx=0x7fda7002aa90 comp rx=0 tx=0).stop 2024-09-10T20:40:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.964+0000 7fda7d400640 1 -- 172.21.15.81:0/2096913627 shutdown_connections 2024-09-10T20:40:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.964+0000 7fda7d400640 1 --2- 172.21.15.81:0/2096913627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda780b7780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.964+0000 7fda7d400640 1 --2- 172.21.15.81:0/2096913627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7815ded0 0x7fda780ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.964+0000 7fda7d400640 1 -- 172.21.15.81:0/2096913627 >> 172.21.15.81:0/2096913627 conn(0x7fda780d3c50 msgr2=0x7fda780d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.964+0000 7fda7d400640 1 -- 172.21.15.81:0/2096913627 shutdown_connections 2024-09-10T20:40:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.964+0000 7fda7d400640 1 -- 172.21.15.81:0/2096913627 wait complete. 2024-09-10T20:40:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.965+0000 7fda7d400640 1 Processor -- start 2024-09-10T20:40:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.965+0000 7fda7d400640 1 -- start start 2024-09-10T20:40:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.966+0000 7fda7d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda781602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.966+0000 7fda7d400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda780ceca0 0x7fda7809e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.966+0000 7fda7d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7815ded0 0x7fda7809e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.966+0000 7fda7d400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda780b7e40 con 0x7fda780b72d0 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.966+0000 7fda7d400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fda780b7cc0 con 0x7fda780ceca0 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.966+0000 7fda7d400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fda780b7fc0 con 0x7fda7815ded0 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.966+0000 7fda76800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda781602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda781602e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52654/0 (socket says 172.21.15.81:52654) 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 -- 172.21.15.81:0/1182018256 learned_addr learned my addr 172.21.15.81:0/1182018256 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda6fe00640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda780ceca0 0x7fda7809e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda77200640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7815ded0 0x7fda7809e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 -- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7815ded0 msgr2=0x7fda7809e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7815ded0 0x7fda7809e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 -- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda780ceca0 msgr2=0x7fda7809e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda780ceca0 0x7fda7809e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 -- 172.21.15.81:0/1182018256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda780c72e0 con 0x7fda780b72d0 2024-09-10T20:40:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda76800640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda781602e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda6800e790 tx=0x7fda6800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda6ea00640 1 -- 172.21.15.81:0/1182018256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6800eea0 con 0x7fda780b72d0 2024-09-10T20:40:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda6ea00640 1 -- 172.21.15.81:0/1182018256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda6800cdb0 con 0x7fda780b72d0 2024-09-10T20:40:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda6ea00640 1 -- 172.21.15.81:0/1182018256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68010690 con 0x7fda780b72d0 2024-09-10T20:40:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.967+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda780c75c0 con 0x7fda780b72d0 2024-09-10T20:40:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.968+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda780c7b80 con 0x7fda780b72d0 2024-09-10T20:40:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.969+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda780b8d10 con 0x7fda780b72d0 2024-09-10T20:40:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.970+0000 7fda6ea00640 1 -- 172.21.15.81:0/1182018256 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fda68010830 con 0x7fda780b72d0 2024-09-10T20:40:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.970+0000 7fda6ea00640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fda54077f70 0x7fda5407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.971+0000 7fda6ea00640 1 -- 172.21.15.81:0/1182018256 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fda6809ab30 con 0x7fda780b72d0 2024-09-10T20:40:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.971+0000 7fda6fe00640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fda54077f70 0x7fda5407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.972+0000 7fda6fe00640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fda54077f70 0x7fda5407a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda7806d390 tx=0x7fda60009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:19.975+0000 7fda6ea00640 1 -- 172.21.15.81:0/1182018256 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fda68062c00 con 0x7fda780b72d0 2024-09-10T20:40:20.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.193+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda780ce720 con 0x7fda780b72d0 2024-09-10T20:40:20.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.193+0000 7fda6ea00640 1 -- 172.21.15.81:0/1182018256 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fda68067630 con 0x7fda780b72d0 2024-09-10T20:40:20.197 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:20.198 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:20.198 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fda54077f70 msgr2=0x7fda5407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fda54077f70 0x7fda5407a430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda7806d390 tx=0x7fda60009040 comp rx=0 tx=0).stop 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 msgr2=0x7fda781602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda781602e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda6800e790 tx=0x7fda6800ec50 comp rx=0 tx=0).stop 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 shutdown_connections 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fda54077f70 0x7fda5407a430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fda7815ded0 0x7fda7809e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda780ceca0 0x7fda7809e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 --2- 172.21.15.81:0/1182018256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda780b72d0 0x7fda781602e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 >> 172.21.15.81:0/1182018256 conn(0x7fda780d3c50 msgr2=0x7fda7806d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:20.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 shutdown_connections 2024-09-10T20:40:20.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.196+0000 7fda7d400640 1 -- 172.21.15.81:0/1182018256 wait complete. 2024-09-10T20:40:20.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 -- 172.21.15.81:0/1977205240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 msgr2=0x7f602c0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 --2- 172.21.15.81:0/1977205240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c0cf780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f602c0cd590 tx=0x7f602402a560 comp rx=0 tx=0).stop 2024-09-10T20:40:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 -- 172.21.15.81:0/1977205240 shutdown_connections 2024-09-10T20:40:20.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 --2- 172.21.15.81:0/1977205240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c0cf780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 --2- 172.21.15.81:0/1977205240 >> v2:172.21.15.143:3300/0 conn(0x7f602c0741e0 0x7f602c15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 -- 172.21.15.81:0/1977205240 >> 172.21.15.81:0/1977205240 conn(0x7f602c06cb50 msgr2=0x7f602c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 -- 172.21.15.81:0/1977205240 shutdown_connections 2024-09-10T20:40:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.368+0000 7f6033000640 1 -- 172.21.15.81:0/1977205240 wait complete. 2024-09-10T20:40:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.370+0000 7f6033000640 1 Processor -- start 2024-09-10T20:40:20.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.370+0000 7f6033000640 1 -- start start 2024-09-10T20:40:20.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.370+0000 7f6033000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f602c0741e0 0x7f602c14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6033000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f602c15b680 0x7f602c15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6033000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6033000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0b2860 con 0x7f602c15c750 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6033000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0d00d0 con 0x7f602c0741e0 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6033000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f602c0b29e0 con 0x7f602c15b680 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c15e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52666/0 (socket says 172.21.15.81:52666) 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 -- 172.21.15.81:0/3945858376 learned_addr learned my addr 172.21.15.81:0/3945858376 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f602be00640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f602c0741e0 0x7f602c14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f602b400640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f602c15b680 0x7f602c15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 -- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f602c15b680 msgr2=0x7f602c15e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f602c15b680 0x7f602c15e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 -- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f602c0741e0 msgr2=0x7f602c14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f602c0741e0 0x7f602c14b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 -- 172.21.15.81:0/3945858376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c14b8a0 con 0x7f602c15c750 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f602b400640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f602c15b680 0x7f602c15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f602be00640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f602c0741e0 0x7f602c14b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.371+0000 7f6031000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c15e610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6024034040 tx=0x7f6024003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.372+0000 7f6023e00640 1 -- 172.21.15.81:0/3945858376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602403e030 con 0x7f602c15c750 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.372+0000 7f6023e00640 1 -- 172.21.15.81:0/3945858376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6024003e50 con 0x7f602c15c750 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.372+0000 7f6023e00640 1 -- 172.21.15.81:0/3945858376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024035040 con 0x7f602c15c750 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.372+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c0af720 con 0x7f602c15c750 2024-09-10T20:40:20.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.372+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c0afce0 con 0x7f602c15c750 2024-09-10T20:40:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.373+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c0b03a0 con 0x7f602c15c750 2024-09-10T20:40:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.374+0000 7f6023e00640 1 -- 172.21.15.81:0/3945858376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6024004a00 con 0x7f602c15c750 2024-09-10T20:40:20.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.375+0000 7f6023e00640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f600c077f70 0x7f600c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.375+0000 7f6023e00640 1 -- 172.21.15.81:0/3945858376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f60240ba9e0 con 0x7f602c15c750 2024-09-10T20:40:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.375+0000 7f602be00640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f600c077f70 0x7f600c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.376+0000 7f602be00640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f600c077f70 0x7f600c07a430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f602c15f3c0 tx=0x7f601c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:20.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.379+0000 7f6023e00640 1 -- 172.21.15.81:0/3945858376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f602c0b03a0 con 0x7f602c15c750 2024-09-10T20:40:20.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.597+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f602c0af4a0 con 0x7f602c15c750 2024-09-10T20:40:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.598+0000 7f6023e00640 1 -- 172.21.15.81:0/3945858376 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f602c0af4a0 con 0x7f602c15c750 2024-09-10T20:40:20.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:20.602 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f600c077f70 msgr2=0x7f600c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f600c077f70 0x7f600c07a430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f602c15f3c0 tx=0x7f601c009040 comp rx=0 tx=0).stop 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 msgr2=0x7f602c15e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c15e610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6024034040 tx=0x7f6024003960 comp rx=0 tx=0).stop 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 shutdown_connections 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f600c077f70 0x7f600c07a430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f602c15c750 0x7f602c15e610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f602c15b680 0x7f602c15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 --2- 172.21.15.81:0/3945858376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f602c0741e0 0x7f602c14b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.600+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 >> 172.21.15.81:0/3945858376 conn(0x7f602c06cb50 msgr2=0x7f602c0ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.601+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 shutdown_connections 2024-09-10T20:40:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.601+0000 7f6033000640 1 -- 172.21.15.81:0/3945858376 wait complete. 2024-09-10T20:40:20.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:20.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.773+0000 7fa5e7800640 1 -- 172.21.15.81:0/4205605055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c8003aa0 msgr2=0x7fa5c8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.773+0000 7fa5e7800640 1 --2- 172.21.15.81:0/4205605055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c8003aa0 0x7fa5c8003ec0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4001690 tx=0x7fa5c8005830 comp rx=0 tx=0).stop 2024-09-10T20:40:20.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.773+0000 7fa5e7800640 1 -- 172.21.15.81:0/4205605055 shutdown_connections 2024-09-10T20:40:20.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.773+0000 7fa5e7800640 1 --2- 172.21.15.81:0/4205605055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c8003aa0 0x7fa5c8003ec0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.773+0000 7fa5e7800640 1 -- 172.21.15.81:0/4205605055 >> 172.21.15.81:0/4205605055 conn(0x7fa5e00d3d10 msgr2=0x7fa5e00d4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:20.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.773+0000 7fa5e7800640 1 -- 172.21.15.81:0/4205605055 shutdown_connections 2024-09-10T20:40:20.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.773+0000 7fa5e7800640 1 -- 172.21.15.81:0/4205605055 wait complete. 2024-09-10T20:40:20.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.775+0000 7fa5e7800640 1 Processor -- start 2024-09-10T20:40:20.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.775+0000 7fa5e7800640 1 -- start start 2024-09-10T20:40:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e7800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5c8003aa0 0x7fa5e00cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e7800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5e014c0a0 0x7fa5e01f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e7800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e01f8830 0x7fa5e01f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e7800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e00d4bc0 con 0x7fa5e01f8830 2024-09-10T20:40:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e7800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e00d4a40 con 0x7fa5c8003aa0 2024-09-10T20:40:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e7800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e00d04a0 con 0x7fa5e014c0a0 2024-09-10T20:40:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e01f8830 0x7fa5e01f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e01f8830 0x7fa5e01f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52694/0 (socket says 172.21.15.81:52694) 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 -- 172.21.15.81:0/3581863235 learned_addr learned my addr 172.21.15.81:0/3581863235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e4e00640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5c8003aa0 0x7fa5e00cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5dfe00640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5e014c0a0 0x7fa5e01f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 -- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5e014c0a0 msgr2=0x7fa5e01f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5e014c0a0 0x7fa5e01f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 -- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5c8003aa0 msgr2=0x7fa5e00cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5c8003aa0 0x7fa5e00cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5e5800640 1 -- 172.21.15.81:0/3581863235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e00cc3c0 con 0x7fa5e01f8830 2024-09-10T20:40:20.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.776+0000 7fa5dfe00640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5e014c0a0 0x7fa5e01f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.777+0000 7fa5e5800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e01f8830 0x7fa5e01f8cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80015c0 tx=0x7fa5d800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.777+0000 7fa5dcc00640 1 -- 172.21.15.81:0/3581863235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800c970 con 0x7fa5e01f8830 2024-09-10T20:40:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.777+0000 7fa5dcc00640 1 -- 172.21.15.81:0/3581863235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5d8018070 con 0x7fa5e01f8830 2024-09-10T20:40:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.777+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e00cc6a0 con 0x7fa5e01f8830 2024-09-10T20:40:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.777+0000 7fa5dcc00640 1 -- 172.21.15.81:0/3581863235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800ce40 con 0x7fa5e01f8830 2024-09-10T20:40:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.777+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e00ccc60 con 0x7fa5e01f8830 2024-09-10T20:40:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.778+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e00d1d90 con 0x7fa5e01f8830 2024-09-10T20:40:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.779+0000 7fa5dcc00640 1 -- 172.21.15.81:0/3581863235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa5d801d460 con 0x7fa5e01f8830 2024-09-10T20:40:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.780+0000 7fa5dcc00640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa5c0077fa0 0x7fa5c007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.780+0000 7fa5dcc00640 1 -- 172.21.15.81:0/3581863235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa5d809a3d0 con 0x7fa5e01f8830 2024-09-10T20:40:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.780+0000 7fa5e4e00640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa5c0077fa0 0x7fa5c007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.781+0000 7fa5e4e00640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa5c0077fa0 0x7fa5c007a460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4032000 tx=0x7fa5d402c040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:20.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.784+0000 7fa5dcc00640 1 -- 172.21.15.81:0/3581863235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa5d8062af0 con 0x7fa5e01f8830 2024-09-10T20:40:20.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.974+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5e00cab00 con 0x7fa5e01f8830 2024-09-10T20:40:20.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.975+0000 7fa5dcc00640 1 -- 172.21.15.81:0/3581863235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18590 (secure 0 0 0) 0x7fa5d806b210 con 0x7fa5e01f8830 2024-09-10T20:40:20.979 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:20.979 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:39:57.279405+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:20.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.977+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa5c0077fa0 msgr2=0x7fa5c007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.977+0000 7fa5e7800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa5c0077fa0 0x7fa5c007a460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4032000 tx=0x7fa5d402c040 comp rx=0 tx=0).stop 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.977+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e01f8830 msgr2=0x7fa5e01f8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.977+0000 7fa5e7800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e01f8830 0x7fa5e01f8cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80015c0 tx=0x7fa5d800eae0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.977+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 shutdown_connections 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.978+0000 7fa5e7800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa5c0077fa0 0x7fa5c007a460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.978+0000 7fa5e7800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e01f8830 0x7fa5e01f8cb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.978+0000 7fa5e7800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5e014c0a0 0x7fa5e01f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.978+0000 7fa5e7800640 1 --2- 172.21.15.81:0/3581863235 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5c8003aa0 0x7fa5e00cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.978+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 >> 172.21.15.81:0/3581863235 conn(0x7fa5e00d3d10 msgr2=0x7fa5e00b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.978+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 shutdown_connections 2024-09-10T20:40:20.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:20.978+0000 7fa5e7800640 1 -- 172.21.15.81:0/3581863235 wait complete. 2024-09-10T20:40:20.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.151+0000 7f6893e00640 1 -- 172.21.15.81:0/1141434140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 msgr2=0x7f68940d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.151+0000 7f6893e00640 1 --2- 172.21.15.81:0/1141434140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f68940d2090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6880005fd0 tx=0x7f688002a540 comp rx=0 tx=0).stop 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.152+0000 7f6893e00640 1 -- 172.21.15.81:0/1141434140 shutdown_connections 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.152+0000 7f6893e00640 1 --2- 172.21.15.81:0/1141434140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f68940d2090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.152+0000 7f6893e00640 1 --2- 172.21.15.81:0/1141434140 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6894161140 0x7f68940b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.152+0000 7f6893e00640 1 -- 172.21.15.81:0/1141434140 >> 172.21.15.81:0/1141434140 conn(0x7f68940d3ab0 msgr2=0x7f68940d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.152+0000 7f6893e00640 1 -- 172.21.15.81:0/1141434140 shutdown_connections 2024-09-10T20:40:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.152+0000 7f6893e00640 1 -- 172.21.15.81:0/1141434140 wait complete. 2024-09-10T20:40:21.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.153+0000 7f6893e00640 1 Processor -- start 2024-09-10T20:40:21.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.153+0000 7f6893e00640 1 -- start start 2024-09-10T20:40:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.154+0000 7f6893e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f689415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.154+0000 7f6893e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6894161140 0x7f68941f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.154+0000 7f6893e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6894158ac0 0x7f6894158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.154+0000 7f6893e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f689406e770 con 0x7f689406e0a0 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.154+0000 7f6893e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6894161730 con 0x7f6894158ac0 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.154+0000 7f6893e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f689406e8f0 con 0x7f6894161140 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f689415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f689415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52712/0 (socket says 172.21.15.81:52712) 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 -- 172.21.15.81:0/3988808052 learned_addr learned my addr 172.21.15.81:0/3988808052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892000640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6894161140 0x7f68941f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6893400640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6894158ac0 0x7f6894158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 -- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6894161140 msgr2=0x7f68941f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6894161140 0x7f68941f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 -- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6894158ac0 msgr2=0x7f6894158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6894158ac0 0x7f6894158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 -- 172.21.15.81:0/3988808052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68941f49d0 con 0x7f689406e0a0 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892000640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6894161140 0x7f68941f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f6892a00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f689415aab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f688400d750 tx=0x7f688400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.155+0000 7f688aa00640 1 -- 172.21.15.81:0/3988808052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884017070 con 0x7f689406e0a0 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.156+0000 7f688aa00640 1 -- 172.21.15.81:0/3988808052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6884004310 con 0x7f689406e0a0 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.156+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68941f4cb0 con 0x7f689406e0a0 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.156+0000 7f688aa00640 1 -- 172.21.15.81:0/3988808052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688400de60 con 0x7f689406e0a0 2024-09-10T20:40:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.156+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68940cd880 con 0x7f689406e0a0 2024-09-10T20:40:21.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.157+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68940b9150 con 0x7f689406e0a0 2024-09-10T20:40:21.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.158+0000 7f688aa00640 1 -- 172.21.15.81:0/3988808052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6884009c30 con 0x7f689406e0a0 2024-09-10T20:40:21.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.159+0000 7f688aa00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6874077f70 0x7f687407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.159+0000 7f688aa00640 1 -- 172.21.15.81:0/3988808052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f688409a490 con 0x7f689406e0a0 2024-09-10T20:40:21.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.159+0000 7f6892000640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6874077f70 0x7f687407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.160+0000 7f6892000640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6874077f70 0x7f687407a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6880033000 tx=0x7f6880004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:21.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.163+0000 7f688aa00640 1 -- 172.21.15.81:0/3988808052 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6884020020 con 0x7f689406e0a0 2024-09-10T20:40:21.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.379+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68940b6d80 con 0x7f689406e0a0 2024-09-10T20:40:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.380+0000 7f688aa00640 1 -- 172.21.15.81:0/3988808052 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f6884069030 con 0x7f689406e0a0 2024-09-10T20:40:21.384 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:21.384 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:21.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6874077f70 msgr2=0x7f687407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6874077f70 0x7f687407a430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6880033000 tx=0x7f6880004730 comp rx=0 tx=0).stop 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 msgr2=0x7f689415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f689415aab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f688400d750 tx=0x7f688400dc10 comp rx=0 tx=0).stop 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 shutdown_connections 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6874077f70 0x7f687407a430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6894158ac0 0x7f6894158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6894161140 0x7f68941f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 --2- 172.21.15.81:0/3988808052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f689406e0a0 0x7f689415aab0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.382+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 >> 172.21.15.81:0/3988808052 conn(0x7f68940d3ab0 msgr2=0x7f68940b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.383+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 shutdown_connections 2024-09-10T20:40:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.383+0000 7f6893e00640 1 -- 172.21.15.81:0/3988808052 wait complete. 2024-09-10T20:40:21.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:39:52.231273+0000', 'modified': '2024-09-10T20:40:13.332760+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4381': {'gid': 4381, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/3994739210', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6835', 'nonce': 3994739210}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3994739210}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4381, 'qdb_cluster': [4381]} 2024-09-10T20:40:21.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T20:40:21.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T20:40:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.960+0000 7fd3e4c00640 1 -- 172.21.15.81:0/666677720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 msgr2=0x7fd3e015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.960+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/666677720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e015f4d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009830 tx=0x7fd3cc02a510 comp rx=0 tx=0).stop 2024-09-10T20:40:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.960+0000 7fd3e4c00640 1 -- 172.21.15.81:0/666677720 shutdown_connections 2024-09-10T20:40:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.960+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/666677720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e015f4d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.960+0000 7fd3e4c00640 1 -- 172.21.15.81:0/666677720 >> 172.21.15.81:0/666677720 conn(0x7fd3e006cb50 msgr2=0x7fd3e006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.960+0000 7fd3e4c00640 1 -- 172.21.15.81:0/666677720 shutdown_connections 2024-09-10T20:40:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.960+0000 7fd3e4c00640 1 -- 172.21.15.81:0/666677720 wait complete. 2024-09-10T20:40:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.961+0000 7fd3e4c00640 1 Processor -- start 2024-09-10T20:40:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.962+0000 7fd3e4c00640 1 -- start start 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3e4c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3e4c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3e015b680 0x7fd3e01f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3e4c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3e015c750 0x7fd3e0159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3e4c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e00b2a70 con 0x7fd3e00741e0 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3e4c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e015cf00 con 0x7fd3e015c750 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3e4c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e00b2bf0 con 0x7fd3e015b680 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e00aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52726/0 (socket says 172.21.15.81:52726) 2024-09-10T20:40:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 -- 172.21.15.81:0/4052770268 learned_addr learned my addr 172.21.15.81:0/4052770268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dd400640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3e015b680 0x7fd3e01f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3de800640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3e015c750 0x7fd3e0159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 -- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3e015b680 msgr2=0x7fd3e01f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3e015b680 0x7fd3e01f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 -- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3e015c750 msgr2=0x7fd3e0159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3e015c750 0x7fd3e0159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.963+0000 7fd3dde00640 1 -- 172.21.15.81:0/4052770268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e01f6070 con 0x7fd3e00741e0 2024-09-10T20:40:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.964+0000 7fd3dde00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e00aeeb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c500 tx=0x7fd3d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.964+0000 7fd3d6000640 1 -- 172.21.15.81:0/4052770268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0017070 con 0x7fd3e00741e0 2024-09-10T20:40:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.964+0000 7fd3d6000640 1 -- 172.21.15.81:0/4052770268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3d00035f0 con 0x7fd3e00741e0 2024-09-10T20:40:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.964+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e01f6310 con 0x7fd3e00741e0 2024-09-10T20:40:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.964+0000 7fd3d6000640 1 -- 172.21.15.81:0/4052770268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0003a40 con 0x7fd3e00741e0 2024-09-10T20:40:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.964+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e01f2070 con 0x7fd3e00741e0 2024-09-10T20:40:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.967+0000 7fd3d6000640 1 -- 172.21.15.81:0/4052770268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd3d0003be0 con 0x7fd3e00741e0 2024-09-10T20:40:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.967+0000 7fd3e7c65740 1 Processor -- start 2024-09-10T20:40:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.968+0000 7fd3e7c65740 1 -- start start 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.968+0000 7fd3d6000640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd3c0077f70 0x7fd3c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.968+0000 7fd3d6000640 1 -- 172.21.15.81:0/4052770268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd3d0099820 con 0x7fd3e00741e0 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfe38b0 0x55d9dbfe3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbf98f20 0x55d9dbfc4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98000 0x55d9dbfc4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9dbf21430 con 0x55d9dbf98000 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d9dbf115d0 con 0x55d9dbfe38b0 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d9dbf00a00 con 0x55d9dbf98f20 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd3c0077f70 0x7fd3c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98000 0x55d9dbfc4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfe38b0 0x55d9dbfe3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98000 0x55d9dbfc4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52728/0 (socket says 172.21.15.81:52728) 2024-09-10T20:40:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfe38b0 0x55d9dbfe3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:46960/0 (socket says 172.21.15.81:46960) 2024-09-10T20:40:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 -- 172.21.15.81:0/3939666516 learned_addr learned my addr 172.21.15.81:0/3939666516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3dd400640 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbf98f20 0x55d9dbfc4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 -- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbf98f20 msgr2=0x55d9dbfc4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbf98f20 0x55d9dbfc4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 -- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfe38b0 msgr2=0x55d9dbfe3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfe38b0 0x55d9dbfe3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3de800640 1 -- 172.21.15.81:0/3939666516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dbec9520 con 0x55d9dbf98000 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.969+0000 7fd3dde00640 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfe38b0 0x55d9dbfe3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.970+0000 7fd3de800640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd3c0077f70 0x7fd3c007a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800dd00 tx=0x7fd3d8009e40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.970+0000 7fd3de800640 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98000 0x55d9dbfc4b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800ac40 tx=0x7fd3d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df641fb1cf2cb516 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.970+0000 7fd3ca600640 1 -- 172.21.15.81:0/3939666516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8020070 con 0x55d9dbf98000 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.970+0000 7fd3ca600640 1 -- 172.21.15.81:0/3939666516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3d800ddf0 con 0x55d9dbf98000 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.970+0000 7fd3ca600640 1 -- 172.21.15.81:0/3939666516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8003970 con 0x55d9dbf98000 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 -- 172.21.15.81:0/3939666516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98000 msgr2=0x55d9dbfc4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98000 0x55d9dbfc4b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800ac40 tx=0x7fd3d8019000 comp rx=0 tx=0).stop 2024-09-10T20:40:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 -- 172.21.15.81:0/3939666516 shutdown_connections 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98000 0x55d9dbfc4b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbf98f20 0x55d9dbfc4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/3939666516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfe38b0 0x55d9dbfe3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 -- 172.21.15.81:0/3939666516 >> 172.21.15.81:0/3939666516 conn(0x55d9dbf99ff0 msgr2=0x55d9dbf9da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 -- 172.21.15.81:0/3939666516 shutdown_connections 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 -- 172.21.15.81:0/3939666516 wait complete. 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.971+0000 7fd3e7c65740 1 -- start start 2024-09-10T20:40:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.972+0000 7fd3e7c65740 1 Processor -- start 2024-09-10T20:40:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbf98f20 0x55d9dbfc0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfc0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbfbec50 0x55d9dbfddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9dbea7330 con 0x55d9dbfbec50 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d9dbf04810 con 0x55d9dbf98f20 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d9dbc71620 con 0x55d9dbfe38b0 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3e7c65740 10 client.0 _ll_register_callbacks cb 0x55d9dbeac420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbfbec50 0x55d9dbfddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbfbec50 0x55d9dbfddeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52734/0 (socket says 172.21.15.81:52734) 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 -- 172.21.15.81:0/4072376456 learned_addr learned my addr 172.21.15.81:0/4072376456 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3dde00640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbf98f20 0x55d9dbfc0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 -- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 msgr2=0x55d9dbfc0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3dd400640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfc0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfc0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 -- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbf98f20 msgr2=0x55d9dbfc0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbf98f20 0x55d9dbfc0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3de800640 1 -- 172.21.15.81:0/4072376456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9dbc62850 con 0x55d9dbfbec50 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3dde00640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbf98f20 0x55d9dbfc0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.973+0000 7fd3dd400640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfc0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3de800640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbfbec50 0x55d9dbfddeb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3d801cc50 tx=0x7fd3d8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6e7a660095688d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3bea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3bea00640 1 -- 172.21.15.81:0/4072376456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8020040 con 0x55d9dbfbec50 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3bea00640 1 -- 172.21.15.81:0/4072376456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd3d8004230 con 0x55d9dbfbec50 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3d800ddf0 con 0x55d9dbfbec50 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3bea00640 1 -- 172.21.15.81:0/4072376456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd3d8035050 con 0x55d9dbfbec50 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3e7c65740 10 client.4701 fetch_fsmap learned FSMap version 9 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d9dbcd96b0 con 0x55d9dbfbec50 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3bea00640 1 -- 172.21.15.81:0/4072376456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3d800ddf0 con 0x55d9dbfbec50 2024-09-10T20:40:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3bea00640 1 -- 172.21.15.81:0/4072376456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7fd3d8038020 con 0x55d9dbfbec50 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.974+0000 7fd3e7c65740 10 client.4701 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.975+0000 7fd3e7c65740 10 client.4701 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.975+0000 7fd3e7c65740 20 client.4701 populate_metadata read hostname 'smithi081' 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.975+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfde3f0 0x55d9dbfc5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.975+0000 7fd3e7c65740 4 client.4701 mds_command: new command op to 4381 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.975+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 --> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9dbf13520 con 0x55d9dbfde3f0 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.975+0000 7fd3dde00640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfde3f0 0x55d9dbfc5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.976+0000 7fd3bea00640 10 client.4701 ms_handle_connect on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.975+0000 7fd3dde00640 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfde3f0 0x55d9dbfc5c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e808e92721e61a6b server_cookie=fd32a7651c5129b2 in_seq=0 out_seq=0 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.976+0000 7fd3bea00640 1 -- 172.21.15.81:0/4072376456 <== mds.0 v2:172.21.15.143:6835/3994739210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9dbf13520 con 0x55d9dbfde3f0 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.976+0000 7fd3bea00640 10 client.4701 handle_command_reply: tid=0 2024-09-10T20:40:21.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.976+0000 7fd3e7c65740 1 client.4701 shutdown 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbfbec50 msgr2=0x55d9dbfddeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbfbec50 0x55d9dbfddeb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3d801cc50 tx=0x7fd3d8003c20 comp rx=0 tx=0).stop 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 shutdown_connections 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfde3f0 0x55d9dbfc5c40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbfbec50 0x55d9dbfddeb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfc0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/4072376456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbf98f20 0x55d9dbfc0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 >> 172.21.15.81:0/4072376456 conn(0x55d9dbf98000 msgr2=0x55d9dbfc43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3bea00640 0 client.4701 ms_handle_reset on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 shutdown_connections 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 1 -- 172.21.15.81:0/4072376456 wait complete. 2024-09-10T20:40:21.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.977+0000 7fd3e7c65740 20 client.4701 trim_cache size 0 max 16384 2024-09-10T20:40:21.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.996+0000 7fd3e7c65740 1 Processor -- start 2024-09-10T20:40:21.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.996+0000 7fd3e7c65740 1 -- start start 2024-09-10T20:40:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dbfe3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 0x55d9dbfc0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfdc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e01fce30 con 0x55d9dbf98f20 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0070010 con 0x55d9dbfbec50 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e01fc7e0 con 0x55d9dbfe38b0 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dbfe3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dbfe3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52738/0 (socket says 172.21.15.81:52738) 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 -- 172.21.15.81:0/194357967 learned_addr learned my addr 172.21.15.81:0/194357967 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 -- 172.21.15.81:0/194357967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 msgr2=0x55d9dbfdc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 --2- 172.21.15.81:0/194357967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfdc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 -- 172.21.15.81:0/194357967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 msgr2=0x55d9dbfc0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 --2- 172.21.15.81:0/194357967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 0x55d9dbfc0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 -- 172.21.15.81:0/194357967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9dbfc6250 con 0x55d9dbf98f20 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.997+0000 7fd3dde00640 1 --2- 172.21.15.81:0/194357967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dbfe3d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000cec0 tx=0x7fd3d0065040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55f6fc5a3cb1669 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3c9c00640 1 -- 172.21.15.81:0/194357967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d005dbe0 con 0x55d9dbf98f20 2024-09-10T20:40:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3c9c00640 1 -- 172.21.15.81:0/194357967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3d006a9e0 con 0x55d9dbf98f20 2024-09-10T20:40:22.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3c9c00640 1 -- 172.21.15.81:0/194357967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d005dd80 con 0x55d9dbf98f20 2024-09-10T20:40:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 -- 172.21.15.81:0/194357967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 msgr2=0x55d9dbfe3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/194357967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dbfe3d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000cec0 tx=0x7fd3d0065040 comp rx=0 tx=0).stop 2024-09-10T20:40:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 -- 172.21.15.81:0/194357967 shutdown_connections 2024-09-10T20:40:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/194357967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dbfdc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/194357967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 0x55d9dbfc0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/194357967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dbfe3d20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 -- 172.21.15.81:0/194357967 >> 172.21.15.81:0/194357967 conn(0x55d9dbf98000 msgr2=0x55d9dbfc8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 -- 172.21.15.81:0/194357967 shutdown_connections 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.998+0000 7fd3e7c65740 1 -- 172.21.15.81:0/194357967 wait complete. 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.999+0000 7fd3e7c65740 1 -- start start 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:21.999+0000 7fd3e7c65740 1 Processor -- start 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dc06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 0x55d9dbfbf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3e7c65740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dc062890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55d9dbfc7c90 con 0x55d9dbf98f20 2024-09-10T20:40:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d9dbfc7730 con 0x55d9dbfbec50 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3e7c65740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d9dbfde7f0 con 0x55d9dbfe38b0 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3e7c65740 10 client.0 _ll_register_callbacks cb 0x7fd3d8009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.000+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dc06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dc06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52756/0 (socket says 172.21.15.81:52756) 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 -- 172.21.15.81:0/1021684114 learned_addr learned my addr 172.21.15.81:0/1021684114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dd400640 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 0x55d9dbfbf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3de800640 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dc062890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 -- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 msgr2=0x55d9dc062890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dc062890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 -- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 msgr2=0x55d9dbfbf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 0x55d9dbfbf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 -- 172.21.15.81:0/1021684114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9dbfc8430 con 0x55d9dbf98f20 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3dde00640 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dc06f5d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0097af0 tx=0x7fd3d0001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d022882955abfe7b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3bea00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:40:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3bea00640 1 -- 172.21.15.81:0/1021684114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0060bd0 con 0x55d9dbf98f20 2024-09-10T20:40:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3bea00640 1 -- 172.21.15.81:0/1021684114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd3d0060d70 con 0x55d9dbf98f20 2024-09-10T20:40:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.001+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3d006a9e0 con 0x55d9dbf98f20 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3bea00640 1 -- 172.21.15.81:0/1021684114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd3d0061970 con 0x55d9dbf98f20 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 10 client.4707 fetch_fsmap learned FSMap version 9 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d9dbf9d0f0 con 0x55d9dbf98f20 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3bea00640 1 -- 172.21.15.81:0/1021684114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3d006a9e0 con 0x55d9dbf98f20 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3bea00640 1 -- 172.21.15.81:0/1021684114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7fd3d005d2c0 con 0x55d9dbf98f20 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 10 client.4707 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 10 client.4707 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 20 client.4707 populate_metadata read hostname 'smithi081' 2024-09-10T20:40:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfc6730 0x55d9dbfc6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 4 client.4707 mds_command: new command op to 4381 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.002+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 --> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] -- command(tid 0: {"prefix": "status"}) -- 0x55d9dbf0efd0 con 0x55d9dbfc6730 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.003+0000 7fd3dd400640 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfc6730 0x55d9dbfc6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.003+0000 7fd3dd400640 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfc6730 0x55d9dbfc6b10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2a7301c920a7aa server_cookie=b53a1f9420f8a3dd in_seq=0 out_seq=0 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.003+0000 7fd3bea00640 10 client.4707 ms_handle_connect on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.003+0000 7fd3bea00640 1 -- 172.21.15.81:0/1021684114 <== mds.0 v2:172.21.15.143:6835/3994739210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55d9dbf0efd0 con 0x55d9dbfc6730 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.003+0000 7fd3bea00640 10 client.4707 handle_command_reply: tid=0 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.003+0000 7fd3e7c65740 1 client.4707 shutdown 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 msgr2=0x55d9dc06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dc06f5d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0097af0 tx=0x7fd3d0001060 comp rx=0 tx=0).stop 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 shutdown_connections 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:6835/3994739210,v1:172.21.15.143:6837/3994739210] conn(0x55d9dbfc6730 0x55d9dbfc6b10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d9dbfe38b0 0x55d9dc062890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d9dbfbec50 0x55d9dbfbf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3bea00640 0 client.4707 ms_handle_reset on v2:172.21.15.143:6835/3994739210 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 --2- 172.21.15.81:0/1021684114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d9dbf98f20 0x55d9dc06f5d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 >> 172.21.15.81:0/1021684114 conn(0x55d9dbf98000 msgr2=0x55d9dbfdc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 shutdown_connections 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 1 -- 172.21.15.81:0/1021684114 wait complete. 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e7c65740 20 client.4707 trim_cache size 0 max 16384 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0ea88071-0b16-46b5-b258-7e2fd8f41721", 2024-09-10T20:40:22.012 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4381, 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 29.181431314000001, 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 26, 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 26, 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 35.212369658999997 2024-09-10T20:40:22.013 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:40:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd3c0077f70 msgr2=0x7fd3c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd3c0077f70 0x7fd3c007a430 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800dd00 tx=0x7fd3d8009e40 comp rx=0 tx=0).stop 2024-09-10T20:40:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 msgr2=0x7fd3e00aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.004+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e00aeeb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c500 tx=0x7fd3d000c9c0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 shutdown_connections 2024-09-10T20:40:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd3c0077f70 0x7fd3c007a430 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3e015c750 0x7fd3e0159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3e015b680 0x7fd3e01f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 --2- 172.21.15.81:0/4052770268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e00741e0 0x7fd3e00aeeb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 >> 172.21.15.81:0/4052770268 conn(0x7fd3e006cb50 msgr2=0x7fd3e00cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 shutdown_connections 2024-09-10T20:40:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.005+0000 7fd3e4c00640 1 -- 172.21.15.81:0/4052770268 wait complete. 2024-09-10T20:40:22.025 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-10T20:40:22.037 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-10T20:40:22.037 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T20:40:22.037 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-10T20:40:22.037 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:40:22.037 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:22.037 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-10T20:40:22.037 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:40:22.037 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:22.037 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-10T20:40:22.038 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:40:22.038 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:22.038 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-10T20:40:22.038 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T20:40:22.038 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:22.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:22.038 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-09-10T20:40:22.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:22.078 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-09-10T20:40:22.182 INFO:teuthology.orchestra.run.smithi143.stderr:Cannot find device "ceph-brx" 2024-09-10T20:40:22.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:40:22.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:22.185 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-10T20:40:22.220 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T20:40:22.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:22.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T20:40:22.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:22.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-10T20:40:22.597 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-10T20:40:22.597 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:40:22.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:40:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.750+0000 7f109b200640 1 -- 172.21.15.81:0/3300782323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 msgr2=0x7f109415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.750+0000 7f109b200640 1 --2- 172.21.15.81:0/3300782323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 0x7f109415bef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f108c009860 tx=0x7f108c02a5a0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.750+0000 7f109b200640 1 -- 172.21.15.81:0/3300782323 shutdown_connections 2024-09-10T20:40:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.750+0000 7f109b200640 1 --2- 172.21.15.81:0/3300782323 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 0x7f109415bef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.751+0000 7f109b200640 1 -- 172.21.15.81:0/3300782323 >> 172.21.15.81:0/3300782323 conn(0x7f109406cb50 msgr2=0x7f109406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.751+0000 7f109b200640 1 -- 172.21.15.81:0/3300782323 shutdown_connections 2024-09-10T20:40:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.751+0000 7f109b200640 1 -- 172.21.15.81:0/3300782323 wait complete. 2024-09-10T20:40:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.752+0000 7f109b200640 1 Processor -- start 2024-09-10T20:40:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.752+0000 7f109b200640 1 -- start start 2024-09-10T20:40:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f109b200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1094073c70 0x7f1094147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f109b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1094154cf0 0x7f1094148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f109b200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 0x7f10940b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f109b200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f109406fcc0 con 0x7f1094073c70 2024-09-10T20:40:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f109b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f109406fb40 con 0x7f1094154cf0 2024-09-10T20:40:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f109b200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f109406fe40 con 0x7f109415b590 2024-09-10T20:40:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f1093e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1094073c70 0x7f1094147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.753+0000 7f1093e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1094073c70 0x7f1094147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52766/0 (socket says 172.21.15.81:52766) 2024-09-10T20:40:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093e00640 1 -- 172.21.15.81:0/1382257813 learned_addr learned my addr 172.21.15.81:0/1382257813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1099200640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 0x7f10940b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093400640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1094154cf0 0x7f1094148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093e00640 1 -- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 msgr2=0x7f10940b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093e00640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 0x7f10940b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093e00640 1 -- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1094154cf0 msgr2=0x7f1094148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093e00640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1094154cf0 0x7f1094148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093e00640 1 -- 172.21.15.81:0/1382257813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10941f8920 con 0x7f1094073c70 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.754+0000 7f1093400640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1094154cf0 0x7f1094148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.755+0000 7f1093e00640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1094073c70 0x7f1094147e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f108400c800 tx=0x7f108400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.755+0000 7f108be00640 1 -- 172.21.15.81:0/1382257813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084003b70 con 0x7f1094073c70 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.755+0000 7f108be00640 1 -- 172.21.15.81:0/1382257813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1084003d30 con 0x7f1094073c70 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.755+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10940b0750 con 0x7f1094073c70 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.755+0000 7f108be00640 1 -- 172.21.15.81:0/1382257813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108400aab0 con 0x7f1094073c70 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.755+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10940b0d10 con 0x7f1094073c70 2024-09-10T20:40:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.756+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10940b0f10 con 0x7f1094073c70 2024-09-10T20:40:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.757+0000 7f108be00640 1 -- 172.21.15.81:0/1382257813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f108400ac50 con 0x7f1094073c70 2024-09-10T20:40:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.758+0000 7f108be00640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1074077f70 0x7f107407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.758+0000 7f108be00640 1 -- 172.21.15.81:0/1382257813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1084099e80 con 0x7f1094073c70 2024-09-10T20:40:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.759+0000 7f1093400640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1074077f70 0x7f107407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.760+0000 7f1093400640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1074077f70 0x7f107407a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1080001240 tx=0x7f1080009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.762+0000 7f108be00640 1 -- 172.21.15.81:0/1382257813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f10940b0f10 con 0x7f1094073c70 2024-09-10T20:40:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.981+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f109415c0f0 con 0x7f1094073c70 2024-09-10T20:40:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.981+0000 7f108be00640 1 -- 172.21.15.81:0/1382257813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f10840626d0 con 0x7f1094073c70 2024-09-10T20:40:22.986 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1074077f70 msgr2=0x7f107407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1074077f70 0x7f107407a430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1080001240 tx=0x7f1080009040 comp rx=0 tx=0).stop 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1094073c70 msgr2=0x7f1094147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1094073c70 0x7f1094147e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f108400c800 tx=0x7f108400ccc0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 shutdown_connections 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1074077f70 0x7f107407a430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f109415b590 0x7f10940b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1094154cf0 0x7f1094148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 --2- 172.21.15.81:0/1382257813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1094073c70 0x7f1094147e50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:22.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 >> 172.21.15.81:0/1382257813 conn(0x7f109406cb50 msgr2=0x7f109415a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:22.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 shutdown_connections 2024-09-10T20:40:22.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:22.984+0000 7f109b200640 1 -- 172.21.15.81:0/1382257813 wait complete. 2024-09-10T20:40:23.003 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:40:23.003 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:40:23.003 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-10T20:40:23.003 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T20:40:23.004 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:23.004 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:40:23.004 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:40:23.004 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:40:23.004 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:40:23.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:23.004 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-10T20:40:23.039 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:23.039 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:23.039 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:23.039 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:23.040 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:23.041 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:40:23.041 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:23.041 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:40:23.041 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42698sec preferred_lft 42698sec 2024-09-10T20:40:23.041 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-10T20:40:23.041 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:23.042 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T20:40:23.042 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:23.043 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:23.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-10T20:40:23.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-10T20:40:23.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-10T20:40:23.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T20:40:23.043 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:23.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:23.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:23.265 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:40:23.319 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-10T20:40:23.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:23.322 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-10T20:40:23.360 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-10T20:40:23.360 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:40:23.360 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:40:23.360 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:40:23.360 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:40:23.360 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:23.360 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:23.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:40:23.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:40:23.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:40:23.361 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:23.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:23.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:23.554 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-10T20:40:23.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:23.591 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-10T20:40:23.666 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:23.666 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:23.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:23.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T20:40:23.666 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:23.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:23.843 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T20:40:23.843 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:23.844 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:23.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T20:40:23.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T20:40:23.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T20:40:23.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T20:40:23.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T20:40:23.844 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:24.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:24.064 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:24.064 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:24.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-10T20:40:24.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T20:40:24.064 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:24.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:24.228 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T20:40:24.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:24.228 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:24.264 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:40:24.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:24.264 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:24.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:40:24.436 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:40:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:24.475 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:24.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:24.476 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:40:24.551 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:40:24.552 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T20:40:24.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:40:24.654 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:24.690 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:40:24.690 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:40:24.690 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:40:24.690 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:40:24.690 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:40:24.690 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:24.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:24.693 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:40:24.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-10T20:40:24.740+0000 7f5a43692480 -1 init, newargv = 0x5577cb461400 newargc=15 2024-09-10T20:40:24.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45365]: starting ceph client 2024-09-10T20:40:24.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45365]: starting fuse 2024-09-10T20:40:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-10T20:40:24.772 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-10T20:40:24.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:40:24.772 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-10T20:40:24.772 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-10T20:40:24.772 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-10T20:40:24.772 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-10T20:40:24.773 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:24.773 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-10T20:40:24.773 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T20:40:24.773 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-10T20:40:24.773 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T20:40:24.773 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-10T20:40:24.774 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-10T20:40:24.775 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-10T20:40:24.775 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:40:24.775 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:24.775 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-10T20:40:24.775 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-10T20:40:24.937 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.45365.asok 2024-09-10T20:40:24.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:24.951 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45365.asok 2024-09-10T20:40:24.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:24.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45365.asok status 2024-09-10T20:40:25.134 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "45365", 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4719, 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-10T20:40:25.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4719 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3198257466 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3198257466 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:25.136 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4719 192.168.0.1:0/3198257466", 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/3198257466", 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 9, 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 26, 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-10T20:40:25.137 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:40:25.146 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:40:25.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 -- 172.21.15.81:0/614096925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 msgr2=0x7f4d5c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 --2- 172.21.15.81:0/614096925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c15ba60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c005fd0 tx=0x7f4d4c02aa00 comp rx=0 tx=0).stop 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 -- 172.21.15.81:0/614096925 shutdown_connections 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 --2- 172.21.15.81:0/614096925 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d5c15c750 0x7f4d5c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 --2- 172.21.15.81:0/614096925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c15ba60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 -- 172.21.15.81:0/614096925 >> 172.21.15.81:0/614096925 conn(0x7f4d5c06cb50 msgr2=0x7f4d5c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 -- 172.21.15.81:0/614096925 shutdown_connections 2024-09-10T20:40:25.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.299+0000 7f4d61c00640 1 -- 172.21.15.81:0/614096925 wait complete. 2024-09-10T20:40:25.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.301+0000 7f4d61c00640 1 Processor -- start 2024-09-10T20:40:25.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.301+0000 7f4d61c00640 1 -- start start 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d61c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c0741e0 0x7f4d5c14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d61c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d61c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d5c15c750 0x7f4d5c156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d61c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c0b29e0 con 0x7f4d5c15b680 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d61c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c0b2860 con 0x7f4d5c0741e0 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d61c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5c0b2b60 con 0x7f4d5c15c750 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d5a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d5a000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42940/0 (socket says 172.21.15.81:42940) 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d5a000640 1 -- 172.21.15.81:0/633786087 learned_addr learned my addr 172.21.15.81:0/633786087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d5aa00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c0741e0 0x7f4d5c14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.302+0000 7f4d5b400640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d5c15c750 0x7f4d5c156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d5a000640 1 -- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d5c15c750 msgr2=0x7f4d5c156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d5a000640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d5c15c750 0x7f4d5c156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d5a000640 1 -- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c0741e0 msgr2=0x7f4d5c14b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d5a000640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c0741e0 0x7f4d5c14b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d5a000640 1 -- 172.21.15.81:0/633786087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c0b07f0 con 0x7f4d5c15b680 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d5b400640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d5c15c750 0x7f4d5c156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d5a000640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c0b1b70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c450 tx=0x7f4d4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d52a00640 1 -- 172.21.15.81:0/633786087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480052d0 con 0x7f4d5c15b680 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d52a00640 1 -- 172.21.15.81:0/633786087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d48005470 con 0x7f4d5c15b680 2024-09-10T20:40:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d52a00640 1 -- 172.21.15.81:0/633786087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48012870 con 0x7f4d5c15b680 2024-09-10T20:40:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5c0b0ad0 con 0x7f4d5c15b680 2024-09-10T20:40:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.303+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5c0b1090 con 0x7f4d5c15b680 2024-09-10T20:40:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.304+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5c0b3010 con 0x7f4d5c15b680 2024-09-10T20:40:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.305+0000 7f4d52a00640 1 -- 172.21.15.81:0/633786087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4d480035f0 con 0x7f4d5c15b680 2024-09-10T20:40:25.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.306+0000 7f4d52a00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d3c077f70 0x7f4d3c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:25.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.306+0000 7f4d52a00640 1 -- 172.21.15.81:0/633786087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4d48099b30 con 0x7f4d5c15b680 2024-09-10T20:40:25.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.307+0000 7f4d5aa00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d3c077f70 0x7f4d3c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:25.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.307+0000 7f4d5aa00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d3c077f70 0x7f4d3c07a430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c035000 tx=0x7f4d4c03a040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:25.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.310+0000 7f4d52a00640 1 -- 172.21.15.81:0/633786087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4d480622e0 con 0x7f4d5c15b680 2024-09-10T20:40:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.529+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4d5c0b3ad0 con 0x7f4d5c15b680 2024-09-10T20:40:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.529+0000 7f4d52a00640 1 -- 172.21.15.81:0/633786087 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f4d48061be0 con 0x7f4d5c15b680 2024-09-10T20:40:25.533 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d3c077f70 msgr2=0x7f4d3c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d3c077f70 0x7f4d3c07a430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c035000 tx=0x7f4d4c03a040 comp rx=0 tx=0).stop 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 msgr2=0x7f4d5c0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c0b1b70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c450 tx=0x7f4d4800c910 comp rx=0 tx=0).stop 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 shutdown_connections 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d3c077f70 0x7f4d3c07a430 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d5c15c750 0x7f4d5c156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d5c15b680 0x7f4d5c0b1b70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 --2- 172.21.15.81:0/633786087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d5c0741e0 0x7f4d5c14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 >> 172.21.15.81:0/633786087 conn(0x7f4d5c06cb50 msgr2=0x7f4d5c0ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 shutdown_connections 2024-09-10T20:40:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25.532+0000 7f4d61c00640 1 -- 172.21.15.81:0/633786087 wait complete. 2024-09-10T20:40:25.551 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:40:25.551 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:40:25.551 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-10T20:40:25.552 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T20:40:25.552 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:25.552 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:40:25.552 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:40:25.552 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:40:25.552 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T20:40:25.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:25.552 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-10T20:40:25.588 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:25.588 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:40:25.589 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ae:bc:12:01:8a:8b brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::b40c:4fff:fe85:a68f/64 scope link 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ae:bc:12:01:8a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::acbc:12ff:fe01:8a8b/64 scope link 2024-09-10T20:40:25.590 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:25.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:25.591 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:40:25.683 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-10T20:40:25.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:25.686 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-10T20:40:25.722 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-10T20:40:25.722 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:40:25.722 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:40:25.722 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:40:25.722 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:40:25.722 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:25.723 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:25.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:40:25.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:40:25.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:40:25.723 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:25.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:25.920 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-10T20:40:25.955 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T20:40:25.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:25.955 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-10T20:40:26.031 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T20:40:26.031 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:26.031 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:26.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:40:26.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T20:40:26.032 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:26.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:26.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:26.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T20:40:26.264 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:26.264 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:26.264 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:26.264 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.264 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:26.264 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.265 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:40:26.265 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fa:d6:18:0c:66:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:40:26.265 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:40:26.265 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.265 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f8d6:18ff:fe0c:6658/64 scope link 2024-09-10T20:40:26.265 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:26.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T20:40:26.322 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether fa:d6:18:0c:66:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::f8d6:18ff:fe0c:6658/64 scope link 2024-09-10T20:40:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:26.325 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T20:40:26.325 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:26.326 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:26.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T20:40:26.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T20:40:26.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T20:40:26.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T20:40:26.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T20:40:26.326 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:26.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:26.542 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:26.542 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:40:26.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2024-09-10T20:40:26.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T20:40:26.542 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:40:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:26.708 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-10T20:40:26.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:26.708 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:26.744 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T20:40:26.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:26.745 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:26.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:40:26.917 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:40:26.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:40:26.956 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:40:26.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:26.957 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:40:27.033 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-10T20:40:27.033 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-10T20:40:27.033 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-10T20:40:27.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:40:27.134 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:40:27.171 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:27.172 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:40:27.173 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:40:27.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:27.174 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:40:27.223 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:2024-09-10T20:40:27.220+0000 7f3b94b74480 -1 init, newargv = 0x55d8914145f0 newargc=15 2024-09-10T20:40:27.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:ceph-fuse[45863]: starting ceph client 2024-09-10T20:40:27.232 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:ceph-fuse[45863]: starting fuse 2024-09-10T20:40:27.252 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-10T20:40:27.252 INFO:teuthology.orchestra.run.smithi081.stdout:44 2024-09-10T20:40:27.253 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-10T20:40:27.253 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-10T20:40:27.254 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:40:27.255 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:40:27.255 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.2")) 2024-09-10T20:40:27.255 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-10T20:40:27.415 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.2.45863.asok 2024-09-10T20:40:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:27.429 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45863.asok 2024-09-10T20:40:27.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:27.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45863.asok status 2024-09-10T20:40:27.614 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:40:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-10T20:40:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:40:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:40:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "2", 2024-09-10T20:40:27.614 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "45863", 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4734, 2024-09-10T20:40:27.615 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-10T20:40:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-10T20:40:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-10T20:40:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4734 2024-09-10T20:40:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:40:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:40:27.616 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:40:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2504079628 2024-09-10T20:40:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:40:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:40:27.617 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:40:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2504079628 2024-09-10T20:40:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4734 192.168.0.2:0/2504079628", 2024-09-10T20:40:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.2:0/2504079628", 2024-09-10T20:40:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-10T20:40:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 9, 2024-09-10T20:40:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 26, 2024-09-10T20:40:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:40:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-10T20:40:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-10T20:40:27.619 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:40:27.626 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:40:27.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:40:27.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 -- 172.21.15.81:0/2235716803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815b590 msgr2=0x7f78280739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:27.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 --2- 172.21.15.81:0/2235716803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815b590 0x7f78280739c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7820005fd0 tx=0x7f782002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:27.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 -- 172.21.15.81:0/2235716803 shutdown_connections 2024-09-10T20:40:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 --2- 172.21.15.81:0/2235716803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f782815b590 0x7f78280739c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 --2- 172.21.15.81:0/2235716803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7828154cf0 0x7f782815bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 -- 172.21.15.81:0/2235716803 >> 172.21.15.81:0/2235716803 conn(0x7f782806cb50 msgr2=0x7f782806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 -- 172.21.15.81:0/2235716803 shutdown_connections 2024-09-10T20:40:27.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.780+0000 7f782ee00640 1 -- 172.21.15.81:0/2235716803 wait complete. 2024-09-10T20:40:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.782+0000 7f782ee00640 1 Processor -- start 2024-09-10T20:40:27.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.782+0000 7f782ee00640 1 -- start start 2024-09-10T20:40:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f782ee00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828073560 0x7f7828157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f782ee00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7828154cf0 0x7f7828155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f782ee00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f782815b590 0x7f782814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f782ee00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f782806fc40 con 0x7f7828073560 2024-09-10T20:40:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f782ee00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f782806fac0 con 0x7f7828154cf0 2024-09-10T20:40:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f782ee00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f782806fdc0 con 0x7f782815b590 2024-09-10T20:40:27.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828073560 0x7f7828157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828073560 0x7f7828157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42952/0 (socket says 172.21.15.81:42952) 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 -- 172.21.15.81:0/2053007437 learned_addr learned my addr 172.21.15.81:0/2053007437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827400640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7828154cf0 0x7f7828155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f782ce00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f782815b590 0x7f782814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 -- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f782815b590 msgr2=0x7f782814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f782815b590 0x7f782814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 -- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7828154cf0 msgr2=0x7f7828155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7828154cf0 0x7f7828155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:27.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.783+0000 7f7827e00640 1 -- 172.21.15.81:0/2053007437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7828159630 con 0x7f7828073560 2024-09-10T20:40:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.784+0000 7f7827e00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828073560 0x7f7828157ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f781800eab0 tx=0x7f781800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.784+0000 7f781fe00640 1 -- 172.21.15.81:0/2053007437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781800ce40 con 0x7f7828073560 2024-09-10T20:40:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.784+0000 7f781fe00640 1 -- 172.21.15.81:0/2053007437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7818011560 con 0x7f7828073560 2024-09-10T20:40:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.784+0000 7f781fe00640 1 -- 172.21.15.81:0/2053007437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818011930 con 0x7f7828073560 2024-09-10T20:40:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.784+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7828159910 con 0x7f7828073560 2024-09-10T20:40:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.784+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7828159ed0 con 0x7f7828073560 2024-09-10T20:40:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.785+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782806c700 con 0x7f7828073560 2024-09-10T20:40:27.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.786+0000 7f781fe00640 1 -- 172.21.15.81:0/2053007437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7818022030 con 0x7f7828073560 2024-09-10T20:40:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.787+0000 7f781fe00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7804077f70 0x7f780407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.787+0000 7f781fe00640 1 -- 172.21.15.81:0/2053007437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f781809a990 con 0x7f7828073560 2024-09-10T20:40:27.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.787+0000 7f7827400640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7804077f70 0x7f780407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:27.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.788+0000 7f7827400640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7804077f70 0x7f780407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78280b0440 tx=0x7f7810009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:27.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:27.791+0000 7f781fe00640 1 -- 172.21.15.81:0/2053007437 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f782806c700 con 0x7f7828073560 2024-09-10T20:40:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.013+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f78280b34c0 con 0x7f7828073560 2024-09-10T20:40:28.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.014+0000 7f781fe00640 1 -- 172.21.15.81:0/2053007437 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f78280b34c0 con 0x7f7828073560 2024-09-10T20:40:28.019 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T20:40:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7804077f70 msgr2=0x7f780407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7804077f70 0x7f780407a430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78280b0440 tx=0x7f7810009040 comp rx=0 tx=0).stop 2024-09-10T20:40:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828073560 msgr2=0x7f7828157ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828073560 0x7f7828157ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f781800eab0 tx=0x7f781800ef70 comp rx=0 tx=0).stop 2024-09-10T20:40:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 shutdown_connections 2024-09-10T20:40:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7804077f70 0x7f780407a430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f782815b590 0x7f782814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:28.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7828154cf0 0x7f7828155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:28.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 --2- 172.21.15.81:0/2053007437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7828073560 0x7f7828157ba0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:28.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 >> 172.21.15.81:0/2053007437 conn(0x7f782806cb50 msgr2=0x7f78280ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:28.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 shutdown_connections 2024-09-10T20:40:28.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:28.016+0000 7f782ee00640 1 -- 172.21.15.81:0/2053007437 wait complete. 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:40:28.037 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T20:40:28.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:28.038 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-09-10T20:40:28.077 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-09-10T20:40:28.078 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:28.079 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:28.079 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:40:28.079 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:28.079 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:40:28.079 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-09-10T20:40:28.079 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link noprefixroute 2024-09-10T20:40:28.079 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:28.080 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T20:40:28.080 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:28.080 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:28.080 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add name ceph-brx type bridge 2024-09-10T20:40:28.080 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr flush dev ceph-brx 2024-09-10T20:40:28.080 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set ceph-brx up 2024-09-10T20:40:28.080 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T20:40:28.080 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:28.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:28.489 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:28.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:28.498 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:40:28.555 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-09-10T20:40:28.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:28.559 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-09-10T20:40:28.610 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-09-10T20:40:28.611 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:40:28.611 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:40:28.611 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:40:28.611 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:40:28.611 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:28.611 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:28.611 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:40:28.612 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:40:28.612 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:40:28.612 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:28.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:29.267 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:29.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:29.274 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-09-10T20:40:29.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:29.310 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2024-09-10T20:40:29.386 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:29.386 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:29.386 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:29.386 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T20:40:29.386 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:29.503 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:29.554 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:29.563 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T20:40:29.564 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:29.642 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:29.800 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:29.808 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:29.808 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:29.808 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.0 up 2024-09-10T20:40:29.808 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T20:40:29.808 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:29.886 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:29.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:29.974 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-10T20:40:29.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:29.974 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:30.009 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T20:40:30.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:30.010 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:30.085 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2024-09-10T20:40:30.181 DEBUG:teuthology.orchestra.run.smithi143:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:30.218 INFO:teuthology.orchestra.run.smithi143.stdout:/proc 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/sys 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/dev 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/security 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/shm 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/pts 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/run 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/cgroup 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/pstore 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/bpf 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/ 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/selinux 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:30.219 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/hugepages 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/mqueue 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/debug 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/tracing 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/config 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/1000 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:40:30.220 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:40:30.221 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:40:30.221 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns 2024-09-10T20:40:30.221 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:30.221 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:30.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:30.222 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2024-09-10T20:40:30.297 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:40:30.297 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-10T20:40:30.343 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2024-09-10T20:40:30.400 DEBUG:teuthology.orchestra.run.smithi143:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:30.436 INFO:teuthology.orchestra.run.smithi143.stdout:/proc 2024-09-10T20:40:30.436 INFO:teuthology.orchestra.run.smithi143.stdout:/sys 2024-09-10T20:40:30.436 INFO:teuthology.orchestra.run.smithi143.stdout:/dev 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/security 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/shm 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/pts 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/run 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/cgroup 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/pstore 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/bpf 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/ 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/selinux 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/hugepages 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/mqueue 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/debug 2024-09-10T20:40:30.437 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/tracing 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/config 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/1000 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:40:30.438 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:40:30.439 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:40:30.439 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns 2024-09-10T20:40:30.439 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:30.439 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:30.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:30.440 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2024-09-10T20:40:30.536 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:2024-09-10T20:40:30.531+0000 7f5fe4d4d480 -1 init, newargv = 0x55c313a103d0 newargc=15 2024-09-10T20:40:30.536 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:ceph-fuse[41659]: starting ceph client 2024-09-10T20:40:30.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi143.stderr:ceph-fuse[41659]: starting fuse 2024-09-10T20:40:31.617 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2024-09-10T20:40:31.678 DEBUG:teuthology.orchestra.run.smithi143:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:31.715 INFO:teuthology.orchestra.run.smithi143.stdout:/proc 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/sys 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/dev 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/security 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/shm 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/pts 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/run 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/cgroup 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/pstore 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/bpf 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/ 2024-09-10T20:40:31.716 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/selinux 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/hugepages 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/mqueue 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/debug 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/tracing 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/config 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:31.717 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/1000 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:31.718 INFO:teuthology.orchestra.run.smithi143.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:31.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:31.719 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2024-09-10T20:40:31.794 INFO:teuthology.orchestra.run.smithi143.stdout:41 2024-09-10T20:40:31.795 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-10T20:40:31.795 DEBUG:teuthology.orchestra.run.smithi143:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:40:31.795 DEBUG:teuthology.orchestra.run.smithi143:> import glob 2024-09-10T20:40:31.795 DEBUG:teuthology.orchestra.run.smithi143:> import re 2024-09-10T20:40:31.795 DEBUG:teuthology.orchestra.run.smithi143:> import os 2024-09-10T20:40:31.795 DEBUG:teuthology.orchestra.run.smithi143:> import subprocess 2024-09-10T20:40:31.795 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> def _find_admin_socket(client_name): 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> files = glob.glob(asok_path) 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> # Given a non-glob path, it better be there 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> if "*" not in asok_path: 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> assert(len(files) == 1) 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> return files[0] 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> for f in files: 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:40:31.796 DEBUG:teuthology.orchestra.run.smithi143:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:40:31.797 DEBUG:teuthology.orchestra.run.smithi143:> contents = proc_f.read() 2024-09-10T20:40:31.797 DEBUG:teuthology.orchestra.run.smithi143:> if mountpoint in contents: 2024-09-10T20:40:31.797 DEBUG:teuthology.orchestra.run.smithi143:> return f 2024-09-10T20:40:31.797 DEBUG:teuthology.orchestra.run.smithi143:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:40:31.797 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:31.797 DEBUG:teuthology.orchestra.run.smithi143:> print(_find_admin_socket("client.1")) 2024-09-10T20:40:31.797 DEBUG:teuthology.orchestra.run.smithi143:> ' 2024-09-10T20:40:31.958 INFO:teuthology.orchestra.run.smithi143.stdout:/var/run/ceph/ceph-client.1.41659.asok 2024-09-10T20:40:31.961 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:31.972 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41659.asok 2024-09-10T20:40:31.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:31.972 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41659.asok status 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "metadata": { 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "entity_id": "1", 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "hostname": "smithi143", 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "pid": "41659", 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: "root": "/" 2024-09-10T20:40:32.158 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_count": 0, 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_pinned_count": 0, 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4592, 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "inst": { 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "name": { 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "client", 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "num": 4592 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 1681423917 2024-09-10T20:40:32.159 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-10T20:40:32.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:32.160 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2024-09-10T20:40:32.160 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2024-09-10T20:40:32.160 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:40:32.160 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 1681423917 2024-09-10T20:40:32.160 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "inst_str": "client.4592 192.168.0.1:0/1681423917", 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "addr_str": "192.168.0.1:0/1681423917", 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "inode_count": 1, 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_epoch": 9, 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch": 26, 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "blocklisted": false, 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs" 2024-09-10T20:40:32.161 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-10T20:40:32.169 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-10T20:40:32.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:40:32.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.331+0000 7f6221800640 1 -- 172.21.15.81:0/3792488095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c15b4d0 msgr2=0x7f621c15ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.331+0000 7f6221800640 1 --2- 172.21.15.81:0/3792488095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c15b4d0 0x7f621c15ea60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f620c009860 tx=0x7f620c02a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.332+0000 7f6221800640 1 -- 172.21.15.81:0/3792488095 shutdown_connections 2024-09-10T20:40:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.332+0000 7f6221800640 1 --2- 172.21.15.81:0/3792488095 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f621c06eb60 0x7f621c06efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.332+0000 7f6221800640 1 --2- 172.21.15.81:0/3792488095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c15b4d0 0x7f621c15ea60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.332+0000 7f6221800640 1 -- 172.21.15.81:0/3792488095 >> 172.21.15.81:0/3792488095 conn(0x7f621c06cb50 msgr2=0x7f621c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.332+0000 7f6221800640 1 -- 172.21.15.81:0/3792488095 shutdown_connections 2024-09-10T20:40:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.332+0000 7f6221800640 1 -- 172.21.15.81:0/3792488095 wait complete. 2024-09-10T20:40:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.333+0000 7f6221800640 1 Processor -- start 2024-09-10T20:40:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.333+0000 7f6221800640 1 -- start start 2024-09-10T20:40:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.334+0000 7f6221800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f621c06eb60 0x7f621c0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.334+0000 7f6221800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c0cf810 0x7f621c1f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.334+0000 7f6221800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f621c15b4d0 0x7f621c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.334+0000 7f6221800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0b2de0 con 0x7f621c0cf810 2024-09-10T20:40:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.334+0000 7f6221800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0b2c60 con 0x7f621c15b4d0 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.334+0000 7f6221800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f621c0b2f60 con 0x7f621c06eb60 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c0cf810 0x7f621c1f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c0cf810 0x7f621c1f4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42970/0 (socket says 172.21.15.81:42970) 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 -- 172.21.15.81:0/3600228024 learned_addr learned my addr 172.21.15.81:0/3600228024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f621aa00640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f621c06eb60 0x7f621c0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 -- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f621c06eb60 msgr2=0x7f621c0c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f621b400640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f621c15b4d0 0x7f621c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f621c06eb60 0x7f621c0c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 -- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f621c15b4d0 msgr2=0x7f621c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f621c15b4d0 0x7f621c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 -- 172.21.15.81:0/3600228024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c0b1220 con 0x7f621c0cf810 2024-09-10T20:40:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f621b400640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f621c15b4d0 0x7f621c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6213e00640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c0cf810 0x7f621c1f4ef0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f620400c730 tx=0x7f620400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6212a00640 1 -- 172.21.15.81:0/3600228024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204017070 con 0x7f621c0cf810 2024-09-10T20:40:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6212a00640 1 -- 172.21.15.81:0/3600228024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6204005180 con 0x7f621c0cf810 2024-09-10T20:40:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.335+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c0b06a0 con 0x7f621c0cf810 2024-09-10T20:40:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.336+0000 7f6212a00640 1 -- 172.21.15.81:0/3600228024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620400a640 con 0x7f621c0cf810 2024-09-10T20:40:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.336+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c0b0c60 con 0x7f621c0cf810 2024-09-10T20:40:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.337+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c0b3480 con 0x7f621c0cf810 2024-09-10T20:40:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.338+0000 7f6212a00640 1 -- 172.21.15.81:0/3600228024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f620400a7e0 con 0x7f621c0cf810 2024-09-10T20:40:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.339+0000 7f6212a00640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f61f8077f70 0x7f61f807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.339+0000 7f6212a00640 1 -- 172.21.15.81:0/3600228024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f6204099880 con 0x7f621c0cf810 2024-09-10T20:40:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.339+0000 7f621aa00640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f61f8077f70 0x7f61f807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.340+0000 7f621aa00640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f61f8077f70 0x7f61f807a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f620c034000 tx=0x7f620c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.343+0000 7f6212a00640 1 -- 172.21.15.81:0/3600228024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f621c15efa0 con 0x7f621c0cf810 2024-09-10T20:40:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.564+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f621c158110 con 0x7f621c0cf810 2024-09-10T20:40:32.570 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T20:40:32.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.565+0000 7f6212a00640 1 -- 172.21.15.81:0/3600228024 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f6204061f70 con 0x7f621c0cf810 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f61f8077f70 msgr2=0x7f61f807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f61f8077f70 0x7f61f807a430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f620c034000 tx=0x7f620c004730 comp rx=0 tx=0).stop 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c0cf810 msgr2=0x7f621c1f4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c0cf810 0x7f621c1f4ef0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f620400c730 tx=0x7f620400cbf0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 shutdown_connections 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f61f8077f70 0x7f61f807a430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f621c15b4d0 0x7f621c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f621c0cf810 0x7f621c1f4ef0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 --2- 172.21.15.81:0/3600228024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f621c06eb60 0x7f621c0c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 >> 172.21.15.81:0/3600228024 conn(0x7f621c06cb50 msgr2=0x7f621c072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 shutdown_connections 2024-09-10T20:40:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:32.567+0000 7f6221800640 1 -- 172.21.15.81:0/3600228024 wait complete. 2024-09-10T20:40:32.803 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi143.front.sepia.ceph.com 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:40:32.804 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T20:40:32.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:32.804 DEBUG:teuthology.orchestra.run.smithi143:> ip addr 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:94 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:32.842 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f0 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:d9:3b:95 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout: altname enp7s0f1 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:82 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether 0c:c4:7a:88:77:83 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout: inet 172.21.15.143/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft 42690sec preferred_lft 42690sec 2024-09-10T20:40:32.843 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::ec4:7aff:fe88:7783/64 scope link noprefixroute 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether f6:c5:d2:bf:ae:7b brd ff:ff:ff:ff:ff:ff 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::bc57:93ff:fea9:c5b0/64 scope link 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether f6:c5:d2:bf:ae:7b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::f4c5:d2ff:febf:ae7b/64 scope link 2024-09-10T20:40:32.845 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:32.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:32.846 DEBUG:teuthology.orchestra.run.smithi143:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:40:32.942 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-09-10T20:40:32.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:32.946 DEBUG:teuthology.orchestra.run.smithi143:> route 2024-09-10T20:40:32.982 INFO:teuthology.orchestra.run.smithi143.stdout:Kernel IP routing table 2024-09-10T20:40:32.983 INFO:teuthology.orchestra.run.smithi143.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:40:32.983 INFO:teuthology.orchestra.run.smithi143.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:40:32.983 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:40:32.983 INFO:teuthology.orchestra.run.smithi143.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:40:32.983 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:32.983 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:32.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:40:32.983 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:40:32.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:40:32.984 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:33.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:33.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:33.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:33.182 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-09-10T20:40:33.217 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T20:40:33.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:33.218 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list-id 2024-09-10T20:40:33.294 INFO:teuthology.orchestra.run.smithi143.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T20:40:33.294 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:33.294 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:33.294 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:40:33.294 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T20:40:33.294 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:33.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:33.461 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:33.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:33.469 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T20:40:33.524 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:33.524 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:33.524 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:33.524 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether e2:a0:0d:c4:5e:48 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::e0a0:dff:fec4:5e48/64 scope link 2024-09-10T20:40:33.525 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:33.527 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 ::1/128 scope host 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: link/ether e2:a0:0d:c4:5e:48 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T20:40:33.582 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.583 INFO:teuthology.orchestra.run.smithi143.stdout: inet6 fe80::e0a0:dff:fec4:5e48/64 scope link 2024-09-10T20:40:33.583 INFO:teuthology.orchestra.run.smithi143.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:40:33.585 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T20:40:33.585 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:33.585 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:33.585 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T20:40:33.585 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T20:40:33.585 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T20:40:33.585 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T20:40:33.585 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T20:40:33.586 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:33.664 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:33.799 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:33.807 DEBUG:teuthology.orchestra.run.smithi143:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:40:33.807 DEBUG:teuthology.orchestra.run.smithi143:> set -e 2024-09-10T20:40:33.807 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set brx.1 up 2024-09-10T20:40:33.807 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T20:40:33.807 DEBUG:teuthology.orchestra.run.smithi143:> ') 2024-09-10T20:40:33.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:40:33.965 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:33.973 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-10T20:40:33.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:33.974 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:34.008 INFO:teuthology.orchestra.run.smithi143.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T20:40:34.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:40:34.009 DEBUG:teuthology.orchestra.run.smithi143:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:34.083 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2024-09-10T20:40:34.179 DEBUG:teuthology.orchestra.run.smithi143:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/proc 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/sys 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/dev 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/security 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/shm 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/pts 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/run 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/cgroup 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/pstore 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/bpf 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/ 2024-09-10T20:40:34.216 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/selinux 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/hugepages 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/mqueue 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/debug 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/tracing 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/config 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/1000 2024-09-10T20:40:34.217 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:40:34.218 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:40:34.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:34.219 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2024-09-10T20:40:34.293 INFO:teuthology.orchestra.run.smithi143.stdout:41 2024-09-10T20:40:34.294 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-10T20:40:34.294 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-10T20:40:34.338 DEBUG:teuthology.orchestra.run.smithi143:> sudo modprobe fuse 2024-09-10T20:40:34.395 DEBUG:teuthology.orchestra.run.smithi143:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:40:34.431 INFO:teuthology.orchestra.run.smithi143.stdout:/proc 2024-09-10T20:40:34.431 INFO:teuthology.orchestra.run.smithi143.stdout:/sys 2024-09-10T20:40:34.431 INFO:teuthology.orchestra.run.smithi143.stdout:/dev 2024-09-10T20:40:34.431 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/security 2024-09-10T20:40:34.431 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/shm 2024-09-10T20:40:34.431 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/pts 2024-09-10T20:40:34.431 INFO:teuthology.orchestra.run.smithi143.stdout:/run 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/cgroup 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/pstore 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/bpf 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/ 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/selinux 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/hugepages 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/dev/mqueue 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/debug 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/tracing 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/fs/fuse/connections 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/sys/kernel/config 2024-09-10T20:40:34.432 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/run/user/1000 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-4 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-5 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-6 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/var/lib/ceph/osd/ceph-7 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:34.433 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:40:34.434 INFO:teuthology.orchestra.run.smithi143.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:40:34.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:34.435 DEBUG:teuthology.orchestra.run.smithi143:> ls /sys/fs/fuse/connections 2024-09-10T20:40:34.483 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi143.stderr:2024-09-10T20:40:34.479+0000 7fb514cab480 -1 init, newargv = 0x55737292a250 newargc=15 2024-09-10T20:40:34.484 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi143.stderr:ceph-fuse[42173]: starting ceph client 2024-09-10T20:40:34.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi143.stderr:ceph-fuse[42173]: starting fuse 2024-09-10T20:40:34.514 INFO:teuthology.orchestra.run.smithi143.stdout:41 2024-09-10T20:40:34.514 INFO:teuthology.orchestra.run.smithi143.stdout:44 2024-09-10T20:40:34.515 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-10T20:40:34.515 DEBUG:teuthology.orchestra.run.smithi143:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:40:34.515 DEBUG:teuthology.orchestra.run.smithi143:> import glob 2024-09-10T20:40:34.515 DEBUG:teuthology.orchestra.run.smithi143:> import re 2024-09-10T20:40:34.515 DEBUG:teuthology.orchestra.run.smithi143:> import os 2024-09-10T20:40:34.516 DEBUG:teuthology.orchestra.run.smithi143:> import subprocess 2024-09-10T20:40:34.516 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:34.516 DEBUG:teuthology.orchestra.run.smithi143:> def _find_admin_socket(client_name): 2024-09-10T20:40:34.516 DEBUG:teuthology.orchestra.run.smithi143:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-10T20:40:34.516 DEBUG:teuthology.orchestra.run.smithi143:> files = glob.glob(asok_path) 2024-09-10T20:40:34.516 DEBUG:teuthology.orchestra.run.smithi143:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-10T20:40:34.517 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:34.517 DEBUG:teuthology.orchestra.run.smithi143:> # Given a non-glob path, it better be there 2024-09-10T20:40:34.517 DEBUG:teuthology.orchestra.run.smithi143:> if "*" not in asok_path: 2024-09-10T20:40:34.517 DEBUG:teuthology.orchestra.run.smithi143:> assert(len(files) == 1) 2024-09-10T20:40:34.517 DEBUG:teuthology.orchestra.run.smithi143:> return files[0] 2024-09-10T20:40:34.517 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:34.518 DEBUG:teuthology.orchestra.run.smithi143:> for f in files: 2024-09-10T20:40:34.518 DEBUG:teuthology.orchestra.run.smithi143:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:40:34.518 DEBUG:teuthology.orchestra.run.smithi143:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:40:34.518 DEBUG:teuthology.orchestra.run.smithi143:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:40:34.519 DEBUG:teuthology.orchestra.run.smithi143:> contents = proc_f.read() 2024-09-10T20:40:34.519 DEBUG:teuthology.orchestra.run.smithi143:> if mountpoint in contents: 2024-09-10T20:40:34.519 DEBUG:teuthology.orchestra.run.smithi143:> return f 2024-09-10T20:40:34.519 DEBUG:teuthology.orchestra.run.smithi143:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:40:34.519 DEBUG:teuthology.orchestra.run.smithi143:> 2024-09-10T20:40:34.519 DEBUG:teuthology.orchestra.run.smithi143:> print(_find_admin_socket("client.3")) 2024-09-10T20:40:34.520 DEBUG:teuthology.orchestra.run.smithi143:> ' 2024-09-10T20:40:34.677 INFO:teuthology.orchestra.run.smithi143.stdout:/var/run/ceph/ceph-client.3.42173.asok 2024-09-10T20:40:34.680 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-10T20:40:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:40:34.691 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42173.asok 2024-09-10T20:40:34.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:34.692 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42173.asok status 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "metadata": { 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "entity_id": "3", 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "hostname": "smithi143", 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-10T20:40:34.875 INFO:teuthology.orchestra.run.smithi143.stdout: "pid": "42173", 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "root": "/" 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_count": 0, 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "dentry_pinned_count": 0, 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "id": 4741, 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "inst": { 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "name": { 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "client", 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "num": 4741 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2024-09-10T20:40:34.876 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 3793280570 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": { 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "type": "v1", 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "addr": "192.168.0.2:0", 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "nonce": 3793280570 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "inst_str": "client.4741 192.168.0.2:0/3793280570", 2024-09-10T20:40:34.877 INFO:teuthology.orchestra.run.smithi143.stdout: "addr_str": "192.168.0.2:0/3793280570", 2024-09-10T20:40:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "inode_count": 1, 2024-09-10T20:40:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_epoch": 9, 2024-09-10T20:40:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch": 28, 2024-09-10T20:40:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:40:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "blocklisted": false, 2024-09-10T20:40:34.878 INFO:teuthology.orchestra.run.smithi143.stdout: "fs_name": "cephfs" 2024-09-10T20:40:34.878 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-10T20:40:34.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:34.887 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-10T20:40:34.887 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:34.928 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-10T20:40:34.928 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:34.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:34.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:35.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:35.030 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-10T20:40:35.030 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-10T20:40:35.067 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:35.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:35.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:35.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:35.163 DEBUG:teuthology.orchestra.run.smithi143:> stat --file-system '--printf=%T 2024-09-10T20:40:35.163 DEBUG:teuthology.orchestra.run.smithi143:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:35.199 INFO:teuthology.orchestra.run.smithi143.stdout:fuseblk 2024-09-10T20:40:35.199 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:35.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:35.200 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:35.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:35.297 DEBUG:teuthology.orchestra.run.smithi143:> stat --file-system '--printf=%T 2024-09-10T20:40:35.297 DEBUG:teuthology.orchestra.run.smithi143:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:35.333 INFO:teuthology.orchestra.run.smithi143.stdout:fuseblk 2024-09-10T20:40:35.333 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:35.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:35.333 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:35.429 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T20:40:35.453 INFO:tasks.cephfs_test_runner:Starting test: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2024-09-10T20:40:35.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 -- 172.21.15.81:0/109196868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0add10 msgr2=0x7f3cec0aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/109196868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0add10 0x7f3cec0aced0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3cec072740 tx=0x7f3cd802a560 comp rx=0 tx=0).stop 2024-09-10T20:40:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 -- 172.21.15.81:0/109196868 shutdown_connections 2024-09-10T20:40:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/109196868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0ad410 0x7f3cec06cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/109196868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0add10 0x7f3cec0aced0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/109196868 >> v2:172.21.15.143:3300/0 conn(0x7f3cec0b4550 0x7f3cec070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 -- 172.21.15.81:0/109196868 >> 172.21.15.81:0/109196868 conn(0x7f3cec0b1bf0 msgr2=0x7f3cec0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 -- 172.21.15.81:0/109196868 shutdown_connections 2024-09-10T20:40:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.607+0000 7f3cf1a00640 1 -- 172.21.15.81:0/109196868 wait complete. 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.609+0000 7f3cf1a00640 1 Processor -- start 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.609+0000 7f3cf1a00640 1 -- start start 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3cf1a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0ad410 0x7f3cec0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3cf1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0add10 0x7f3cec09d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3cf1a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0b4550 0x7f3cec1f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3cf1a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec06d210 con 0x7f3cec0b4550 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3cf1a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3cec06d090 con 0x7f3cec0add10 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3cf1a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3cec06d390 con 0x7f3cec0ad410 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3ceaa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0ad410 0x7f3cec0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3ceb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0b4550 0x7f3cec1f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3ceaa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0ad410 0x7f3cec0c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:50806/0 (socket says 172.21.15.81:50806) 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3ceaa00640 1 -- 172.21.15.81:0/1873085046 learned_addr learned my addr 172.21.15.81:0/1873085046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.610+0000 7f3cea000640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0add10 0x7f3cec09d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ceb400640 1 -- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0ad410 msgr2=0x7f3cec0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ceb400640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0ad410 0x7f3cec0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ceb400640 1 -- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0add10 msgr2=0x7f3cec09d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ceb400640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0add10 0x7f3cec09d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ceb400640 1 -- 172.21.15.81:0/1873085046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec09d580 con 0x7f3cec0b4550 2024-09-10T20:40:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ceb400640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0b4550 0x7f3cec1f2a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400e990 tx=0x7f3ce400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ce2a00640 1 -- 172.21.15.81:0/1873085046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4004d20 con 0x7f3cec0b4550 2024-09-10T20:40:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ce2a00640 1 -- 172.21.15.81:0/1873085046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ce400caa0 con 0x7f3cec0b4550 2024-09-10T20:40:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cec1f2fb0 con 0x7f3cec0b4550 2024-09-10T20:40:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.611+0000 7f3ce2a00640 1 -- 172.21.15.81:0/1873085046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4005020 con 0x7f3cec0b4550 2024-09-10T20:40:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.612+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cec0c5c90 con 0x7f3cec0b4550 2024-09-10T20:40:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.612+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cec0aced0 con 0x7f3cec0b4550 2024-09-10T20:40:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.614+0000 7f3ce2a00640 1 -- 172.21.15.81:0/1873085046 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3ce400f040 con 0x7f3cec0b4550 2024-09-10T20:40:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.614+0000 7f3ce2a00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ccc077f70 0x7f3ccc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.615+0000 7f3ce2a00640 1 -- 172.21.15.81:0/1873085046 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f3ce409a5c0 con 0x7f3cec0b4550 2024-09-10T20:40:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.615+0000 7f3ceaa00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ccc077f70 0x7f3ccc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.615+0000 7f3ceaa00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ccc077f70 0x7f3ccc07a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0058c0 tx=0x7f3cdc00b410 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.619+0000 7f3ce2a00640 1 -- 172.21.15.81:0/1873085046 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3ce4016030 con 0x7f3cec0b4550 2024-09-10T20:40:35.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.804+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cec0c3eb0 con 0x7f3cec0b4550 2024-09-10T20:40:35.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.805+0000 7f3ce2a00640 1 -- 172.21.15.81:0/1873085046 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18686 (secure 0 0 0) 0x7f3ce40626f0 con 0x7f3cec0b4550 2024-09-10T20:40:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:40:33.003654+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:35.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ccc077f70 msgr2=0x7f3ccc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ccc077f70 0x7f3ccc07a430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0058c0 tx=0x7f3cdc00b410 comp rx=0 tx=0).stop 2024-09-10T20:40:35.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0b4550 msgr2=0x7f3cec1f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0b4550 0x7f3cec1f2a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400e990 tx=0x7f3ce400ee50 comp rx=0 tx=0).stop 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 shutdown_connections 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3ccc077f70 0x7f3ccc07a430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cec0b4550 0x7f3cec1f2a70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3cec0add10 0x7f3cec09d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 --2- 172.21.15.81:0/1873085046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3cec0ad410 0x7f3cec0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 >> 172.21.15.81:0/1873085046 conn(0x7f3cec0b1bf0 msgr2=0x7f3cec0b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 shutdown_connections 2024-09-10T20:40:35.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.807+0000 7f3cf1a00640 1 -- 172.21.15.81:0/1873085046 wait complete. 2024-09-10T20:40:35.829 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T20:39:41.868775+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T20:39:50.223187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T20:39:51.199432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T20:39:54.848190+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T20:40:35.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T20:40:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 -- 172.21.15.81:0/3227692242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac0741e0 msgr2=0x7f98ac15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 --2- 172.21.15.81:0/3227692242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac0741e0 0x7f98ac15f4d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0cc700 tx=0x7f989802a560 comp rx=0 tx=0).stop 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 -- 172.21.15.81:0/3227692242 shutdown_connections 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 --2- 172.21.15.81:0/3227692242 >> v2:172.21.15.143:3300/0 conn(0x7f98ac15c750 0x7f98ac0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 --2- 172.21.15.81:0/3227692242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac0741e0 0x7f98ac15f4d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 --2- 172.21.15.81:0/3227692242 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98ac15b680 0x7f98ac15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 -- 172.21.15.81:0/3227692242 >> 172.21.15.81:0/3227692242 conn(0x7f98ac06cb50 msgr2=0x7f98ac06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 -- 172.21.15.81:0/3227692242 shutdown_connections 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.984+0000 7f98b3e00640 1 -- 172.21.15.81:0/3227692242 wait complete. 2024-09-10T20:40:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.986+0000 7f98b3e00640 1 Processor -- start 2024-09-10T20:40:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.986+0000 7f98b3e00640 1 -- start start 2024-09-10T20:40:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b3e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac0741e0 0x7f98ac146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b3e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98ac15b680 0x7f98ac06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac15c750 0x7f98ac0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b3e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac0d0110 con 0x7f98ac15c750 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b3e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac0cff90 con 0x7f98ac0741e0 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b3e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac0b2860 con 0x7f98ac15b680 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac15c750 0x7f98ac0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b1e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac15c750 0x7f98ac0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60494/0 (socket says 172.21.15.81:60494) 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b1e00640 1 -- 172.21.15.81:0/2568397303 learned_addr learned my addr 172.21.15.81:0/2568397303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.987+0000 7f98b1400640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac0741e0 0x7f98ac146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b0a00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98ac15b680 0x7f98ac06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b1e00640 1 -- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98ac15b680 msgr2=0x7f98ac06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b1e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98ac15b680 0x7f98ac06e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b1e00640 1 -- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac0741e0 msgr2=0x7f98ac146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b1e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac0741e0 0x7f98ac146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b1e00640 1 -- 172.21.15.81:0/2568397303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac1f51e0 con 0x7f98ac15c750 2024-09-10T20:40:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b0a00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98ac15b680 0x7f98ac06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b1e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac15c750 0x7f98ac0b01c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98a400d6a0 tx=0x7f98a400daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98a9600640 1 -- 172.21.15.81:0/2568397303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4017070 con 0x7f98ac15c750 2024-09-10T20:40:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98a9600640 1 -- 172.21.15.81:0/2568397303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98a4004310 con 0x7f98ac15c750 2024-09-10T20:40:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98a9600640 1 -- 172.21.15.81:0/2568397303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4005280 con 0x7f98ac15c750 2024-09-10T20:40:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ac0ad960 con 0x7f98ac15c750 2024-09-10T20:40:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.988+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ac0adf20 con 0x7f98ac15c750 2024-09-10T20:40:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.989+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ac15ba60 con 0x7f98ac15c750 2024-09-10T20:40:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.990+0000 7f98a9600640 1 -- 172.21.15.81:0/2568397303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f98a4005420 con 0x7f98ac15c750 2024-09-10T20:40:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.991+0000 7f98a9600640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f988c077fa0 0x7f988c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.991+0000 7f98a9600640 1 -- 172.21.15.81:0/2568397303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f98a409a3e0 con 0x7f98ac15c750 2024-09-10T20:40:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.992+0000 7f98b1400640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f988c077fa0 0x7f988c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.992+0000 7f98b1400640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f988c077fa0 0x7f988c07a460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98a0005fd0 tx=0x7f98a0009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:35.995+0000 7f98a9600640 1 -- 172.21.15.81:0/2568397303 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f98a4020020 con 0x7f98ac15c750 2024-09-10T20:40:36.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.183+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98ac146750 con 0x7f98ac15c750 2024-09-10T20:40:36.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.183+0000 7f98a9600640 1 -- 172.21.15.81:0/2568397303 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f98a4062b60 con 0x7f98ac15c750 2024-09-10T20:40:36.188 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-10T20:40:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.185+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f988c077fa0 msgr2=0x7f988c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f988c077fa0 0x7f988c07a460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98a0005fd0 tx=0x7f98a0009500 comp rx=0 tx=0).stop 2024-09-10T20:40:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac15c750 msgr2=0x7f98ac0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac15c750 0x7f98ac0b01c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f98a400d6a0 tx=0x7f98a400daa0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 shutdown_connections 2024-09-10T20:40:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f988c077fa0 0x7f988c07a460 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac15c750 0x7f98ac0b01c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f98ac15b680 0x7f98ac06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 --2- 172.21.15.81:0/2568397303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98ac0741e0 0x7f98ac146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 >> 172.21.15.81:0/2568397303 conn(0x7f98ac06cb50 msgr2=0x7f98ac15d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:36.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 shutdown_connections 2024-09-10T20:40:36.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.186+0000 7f98b3e00640 1 -- 172.21.15.81:0/2568397303 wait complete. 2024-09-10T20:40:36.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.361+0000 7f224f800640 1 -- 172.21.15.81:0/58404714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 msgr2=0x7f224815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.361+0000 7f224f800640 1 --2- 172.21.15.81:0/58404714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 0x7f224815f4d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2234005fd0 tx=0x7f223402a530 comp rx=0 tx=0).stop 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.362+0000 7f224f800640 1 -- 172.21.15.81:0/58404714 shutdown_connections 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.362+0000 7f224f800640 1 --2- 172.21.15.81:0/58404714 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 0x7f22480cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.362+0000 7f224f800640 1 --2- 172.21.15.81:0/58404714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 0x7f224815f4d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.362+0000 7f224f800640 1 -- 172.21.15.81:0/58404714 >> 172.21.15.81:0/58404714 conn(0x7f224806cb50 msgr2=0x7f224806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.362+0000 7f224f800640 1 -- 172.21.15.81:0/58404714 shutdown_connections 2024-09-10T20:40:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.362+0000 7f224f800640 1 -- 172.21.15.81:0/58404714 wait complete. 2024-09-10T20:40:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.363+0000 7f224f800640 1 Processor -- start 2024-09-10T20:40:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.363+0000 7f224f800640 1 -- start start 2024-09-10T20:40:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224f800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 0x7f22480b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224f800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f224815b680 0x7f22480af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224f800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 0x7f22481f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224f800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22480b29e0 con 0x7f22480741e0 2024-09-10T20:40:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224f800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f22480b2860 con 0x7f224815b680 2024-09-10T20:40:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224f800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f22480b2b60 con 0x7f224815c750 2024-09-10T20:40:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224ce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 0x7f22480b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.364+0000 7f224d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 0x7f22481f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 0x7f22481f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.81:50848/0 (socket says 172.21.15.81:50848) 2024-09-10T20:40:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224d800640 1 -- 172.21.15.81:0/967315783 learned_addr learned my addr 172.21.15.81:0/967315783 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f2247e00640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f224815b680 0x7f22480af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224ce00640 1 -- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 msgr2=0x7f22481f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224ce00640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 0x7f22481f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224ce00640 1 -- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f224815b680 msgr2=0x7f22480af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224ce00640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f224815b680 0x7f22480af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224ce00640 1 -- 172.21.15.81:0/967315783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22480b1480 con 0x7f22480741e0 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224d800640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 0x7f22481f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f224ce00640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 0x7f22480b1f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f223800c780 tx=0x7f223800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.365+0000 7f2244c00640 1 -- 172.21.15.81:0/967315783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238016020 con 0x7f22480741e0 2024-09-10T20:40:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.366+0000 7f2244c00640 1 -- 172.21.15.81:0/967315783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f223800ab80 con 0x7f22480741e0 2024-09-10T20:40:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.366+0000 7f2244c00640 1 -- 172.21.15.81:0/967315783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800ce30 con 0x7f22480741e0 2024-09-10T20:40:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.366+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22481f4ee0 con 0x7f22480741e0 2024-09-10T20:40:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.366+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22480b1740 con 0x7f22480741e0 2024-09-10T20:40:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.367+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22480b3080 con 0x7f22480741e0 2024-09-10T20:40:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.368+0000 7f2244c00640 1 -- 172.21.15.81:0/967315783 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f223801a3b0 con 0x7f22480741e0 2024-09-10T20:40:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.369+0000 7f2244c00640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2228077f70 0x7f222807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.369+0000 7f2244c00640 1 -- 172.21.15.81:0/967315783 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f223809a210 con 0x7f22480741e0 2024-09-10T20:40:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.370+0000 7f2247e00640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2228077f70 0x7f222807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.370+0000 7f2247e00640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2228077f70 0x7f222807a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2234033000 tx=0x7f2234004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.373+0000 7f2244c00640 1 -- 172.21.15.81:0/967315783 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2238020030 con 0x7f22480741e0 2024-09-10T20:40:36.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.555+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f22480cc490 con 0x7f22480741e0 2024-09-10T20:40:36.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.556+0000 7f2244c00640 1 -- 172.21.15.81:0/967315783 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f2238062340 con 0x7f22480741e0 2024-09-10T20:40:36.561 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-10T20:40:36.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2228077f70 msgr2=0x7f222807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2228077f70 0x7f222807a430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2234033000 tx=0x7f2234004730 comp rx=0 tx=0).stop 2024-09-10T20:40:36.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 msgr2=0x7f22480b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 0x7f22480b1f40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f223800c780 tx=0x7f223800cc40 comp rx=0 tx=0).stop 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 shutdown_connections 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2228077f70 0x7f222807a430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f224815c750 0x7f22481f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f224815b680 0x7f22480af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 --2- 172.21.15.81:0/967315783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22480741e0 0x7f22480b1f40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 >> 172.21.15.81:0/967315783 conn(0x7f224806cb50 msgr2=0x7f224815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 shutdown_connections 2024-09-10T20:40:36.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.558+0000 7f224f800640 1 -- 172.21.15.81:0/967315783 wait complete. 2024-09-10T20:40:36.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T20:40:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.734+0000 7fb179000640 1 -- 172.21.15.81:0/3823968742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740b4550 msgr2=0x7fb174070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.734+0000 7fb179000640 1 --2- 172.21.15.81:0/3823968742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740b4550 0x7fb174070470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb164005fd0 tx=0x7fb16402aaa0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.734+0000 7fb179000640 1 -- 172.21.15.81:0/3823968742 shutdown_connections 2024-09-10T20:40:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.734+0000 7fb179000640 1 --2- 172.21.15.81:0/3823968742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740b4550 0x7fb174070470 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.734+0000 7fb179000640 1 -- 172.21.15.81:0/3823968742 >> 172.21.15.81:0/3823968742 conn(0x7fb1740b1bf0 msgr2=0x7fb1740b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.735+0000 7fb179000640 1 -- 172.21.15.81:0/3823968742 shutdown_connections 2024-09-10T20:40:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.735+0000 7fb179000640 1 -- 172.21.15.81:0/3823968742 wait complete. 2024-09-10T20:40:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.736+0000 7fb179000640 1 Processor -- start 2024-09-10T20:40:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.736+0000 7fb179000640 1 -- start start 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb179000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740ad5e0 0x7fb17409be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb179000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1740add10 0x7fb174157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb179000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1740b4550 0x7fb174159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb179000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb174165e90 con 0x7fb1740ad5e0 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb179000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb174070b50 con 0x7fb1740b4550 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb179000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb174166010 con 0x7fb1740add10 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb171e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740ad5e0 0x7fb17409be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb171e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740ad5e0 0x7fb17409be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60524/0 (socket says 172.21.15.81:60524) 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.737+0000 7fb171e00640 1 -- 172.21.15.81:0/2206596065 learned_addr learned my addr 172.21.15.81:0/2206596065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb172800640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1740b4550 0x7fb174159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171400640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1740add10 0x7fb174157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171e00640 1 -- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1740add10 msgr2=0x7fb174157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171e00640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1740add10 0x7fb174157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171e00640 1 -- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1740b4550 msgr2=0x7fb174159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171e00640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1740b4550 0x7fb174159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171e00640 1 -- 172.21.15.81:0/2206596065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1741584c0 con 0x7fb1740ad5e0 2024-09-10T20:40:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171400640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1740add10 0x7fb174157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:36.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb171e00640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740ad5e0 0x7fb17409be00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f80 tx=0x7fb164003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb16a000640 1 -- 172.21.15.81:0/2206596065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164044070 con 0x7fb1740ad5e0 2024-09-10T20:40:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb16a000640 1 -- 172.21.15.81:0/2206596065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb164004250 con 0x7fb1740ad5e0 2024-09-10T20:40:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb16a000640 1 -- 172.21.15.81:0/2206596065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164004680 con 0x7fb1740ad5e0 2024-09-10T20:40:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.738+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17409c3e0 con 0x7fb1740ad5e0 2024-09-10T20:40:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.739+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17409c9a0 con 0x7fb1740ad5e0 2024-09-10T20:40:36.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.739+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb174073ce0 con 0x7fb1740ad5e0 2024-09-10T20:40:36.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.741+0000 7fb16a000640 1 -- 172.21.15.81:0/2206596065 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb16402e970 con 0x7fb1740ad5e0 2024-09-10T20:40:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.741+0000 7fb16a000640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb154077f70 0x7fb15407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.742+0000 7fb16a000640 1 -- 172.21.15.81:0/2206596065 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fb1640bb280 con 0x7fb1740ad5e0 2024-09-10T20:40:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.742+0000 7fb171400640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb154077f70 0x7fb15407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:36.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.743+0000 7fb171400640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb154077f70 0x7fb15407a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb160007fd0 tx=0x7fb160009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:36.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.746+0000 7fb16a000640 1 -- 172.21.15.81:0/2206596065 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb164032030 con 0x7fb1740ad5e0 2024-09-10T20:40:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.936+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb174070450 con 0x7fb1740ad5e0 2024-09-10T20:40:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.936+0000 7fb16a000640 1 -- 172.21.15.81:0/2206596065 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fb164004820 con 0x7fb1740ad5e0 2024-09-10T20:40:36.941 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-10T20:40:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb154077f70 msgr2=0x7fb15407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb154077f70 0x7fb15407a430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb160007fd0 tx=0x7fb160009040 comp rx=0 tx=0).stop 2024-09-10T20:40:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740ad5e0 msgr2=0x7fb17409be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740ad5e0 0x7fb17409be00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb164000f80 tx=0x7fb164003f10 comp rx=0 tx=0).stop 2024-09-10T20:40:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 shutdown_connections 2024-09-10T20:40:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb154077f70 0x7fb15407a430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb1740b4550 0x7fb174159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb1740add10 0x7fb174157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 --2- 172.21.15.81:0/2206596065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1740ad5e0 0x7fb17409be00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 >> 172.21.15.81:0/2206596065 conn(0x7fb1740b1bf0 msgr2=0x7fb1740cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 shutdown_connections 2024-09-10T20:40:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:36.939+0000 7fb179000640 1 -- 172.21.15.81:0/2206596065 wait complete. 2024-09-10T20:40:36.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T20:40:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.116+0000 7f7c3ca00640 1 -- 172.21.15.81:0/736771527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3815db30 msgr2=0x7f7c380cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.116+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/736771527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3815db30 0x7f7c380cf4f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c380cf1e0 tx=0x7f7c2802a5c0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.116+0000 7f7c3ca00640 1 -- 172.21.15.81:0/736771527 shutdown_connections 2024-09-10T20:40:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.116+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/736771527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c3815db30 0x7f7c380cf4f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.116+0000 7f7c3ca00640 1 -- 172.21.15.81:0/736771527 >> 172.21.15.81:0/736771527 conn(0x7f7c380d3a40 msgr2=0x7f7c380d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.116+0000 7f7c3ca00640 1 -- 172.21.15.81:0/736771527 shutdown_connections 2024-09-10T20:40:37.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.116+0000 7f7c3ca00640 1 -- 172.21.15.81:0/736771527 wait complete. 2024-09-10T20:40:37.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.117+0000 7f7c3ca00640 1 Processor -- start 2024-09-10T20:40:37.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.117+0000 7f7c3ca00640 1 -- start start 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.118+0000 7f7c3ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c380d0900 0x7f7c38150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.118+0000 7f7c3ca00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c3815db30 0x7f7c3814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.118+0000 7f7c3ca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c381f7c60 0x7f7c380b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.118+0000 7f7c3ca00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c380d46e0 con 0x7f7c380d0900 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.118+0000 7f7c3ca00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7c380d4560 con 0x7f7c381f7c60 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.118+0000 7f7c3ca00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7c380d4860 con 0x7f7c3815db30 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c380d0900 0x7f7c38150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c380d0900 0x7f7c38150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60542/0 (socket says 172.21.15.81:60542) 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 -- 172.21.15.81:0/3241260836 learned_addr learned my addr 172.21.15.81:0/3241260836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37e00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c381f7c60 0x7f7c380b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c36a00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c3815db30 0x7f7c3814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 -- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c3815db30 msgr2=0x7f7c3814fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c3815db30 0x7f7c3814fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 -- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c381f7c60 msgr2=0x7f7c380b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c381f7c60 0x7f7c380b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 -- 172.21.15.81:0/3241260836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c380cc5a0 con 0x7f7c380d0900 2024-09-10T20:40:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.119+0000 7f7c37400640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c380d0900 0x7f7c38150140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c2802abb0 tx=0x7f7c28033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.120+0000 7f7c2f400640 1 -- 172.21.15.81:0/3241260836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28031d60 con 0x7f7c380d0900 2024-09-10T20:40:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.120+0000 7f7c2f400640 1 -- 172.21.15.81:0/3241260836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c28005020 con 0x7f7c380d0900 2024-09-10T20:40:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.120+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c380c7d00 con 0x7f7c380d0900 2024-09-10T20:40:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.120+0000 7f7c2f400640 1 -- 172.21.15.81:0/3241260836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28005430 con 0x7f7c380d0900 2024-09-10T20:40:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.120+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c380c82c0 con 0x7f7c380d0900 2024-09-10T20:40:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.121+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c380b3e80 con 0x7f7c380d0900 2024-09-10T20:40:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.122+0000 7f7c2f400640 1 -- 172.21.15.81:0/3241260836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7c280047a0 con 0x7f7c380d0900 2024-09-10T20:40:37.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.123+0000 7f7c2f400640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7c18077f70 0x7f7c1807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.123+0000 7f7c2f400640 1 -- 172.21.15.81:0/3241260836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f7c280bb1e0 con 0x7f7c380d0900 2024-09-10T20:40:37.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.123+0000 7f7c36a00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7c18077f70 0x7f7c1807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.124+0000 7f7c36a00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7c18077f70 0x7f7c1807a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c24007fd0 tx=0x7f7c24009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.127+0000 7f7c2f400640 1 -- 172.21.15.81:0/3241260836 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7c2803f030 con 0x7f7c380d0900 2024-09-10T20:40:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.309+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7c3806cd70 con 0x7f7c380d0900 2024-09-10T20:40:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.310+0000 7f7c2f400640 1 -- 172.21.15.81:0/3241260836 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f7c28031770 con 0x7f7c380d0900 2024-09-10T20:40:37.315 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-10T20:40:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7c18077f70 msgr2=0x7f7c1807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7c18077f70 0x7f7c1807a430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c24007fd0 tx=0x7f7c24009040 comp rx=0 tx=0).stop 2024-09-10T20:40:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c380d0900 msgr2=0x7f7c38150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c380d0900 0x7f7c38150140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c2802abb0 tx=0x7f7c28033c20 comp rx=0 tx=0).stop 2024-09-10T20:40:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 shutdown_connections 2024-09-10T20:40:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7c18077f70 0x7f7c1807a430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c381f7c60 0x7f7c380b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c3815db30 0x7f7c3814fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 --2- 172.21.15.81:0/3241260836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c380d0900 0x7f7c38150140 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 >> 172.21.15.81:0/3241260836 conn(0x7f7c380d3a40 msgr2=0x7f7c3806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 shutdown_connections 2024-09-10T20:40:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.312+0000 7f7c3ca00640 1 -- 172.21.15.81:0/3241260836 wait complete. 2024-09-10T20:40:37.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2024-09-10T20:40:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.486+0000 7f4a1cc00640 1 -- 172.21.15.81:0/1426699990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49fc005340 msgr2=0x7f49fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.486+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/1426699990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49fc005340 0x7f49fc00b9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009ed0 tx=0x7f49fc005830 comp rx=0 tx=0).stop 2024-09-10T20:40:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.486+0000 7f4a1cc00640 1 -- 172.21.15.81:0/1426699990 shutdown_connections 2024-09-10T20:40:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.486+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/1426699990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49fc005340 0x7f49fc00b9c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.486+0000 7f4a1cc00640 1 -- 172.21.15.81:0/1426699990 >> 172.21.15.81:0/1426699990 conn(0x7f4a180d3ab0 msgr2=0x7f4a180d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.486+0000 7f4a1cc00640 1 -- 172.21.15.81:0/1426699990 shutdown_connections 2024-09-10T20:40:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.486+0000 7f4a1cc00640 1 -- 172.21.15.81:0/1426699990 wait complete. 2024-09-10T20:40:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.488+0000 7f4a1cc00640 1 Processor -- start 2024-09-10T20:40:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.488+0000 7f4a1cc00640 1 -- start start 2024-09-10T20:40:37.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a1cc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49fc005340 0x7f4a180b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a1cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a181f4c60 0x7f4a181f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a1cc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1814ac90 0x7f4a1814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a1cc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181616a0 con 0x7f4a181f4c60 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a1cc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18161520 con 0x7f4a1814ac90 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a1cc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1806e770 con 0x7f49fc005340 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a181f4c60 0x7f4a181f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a181f4c60 0x7f4a181f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60560/0 (socket says 172.21.15.81:60560) 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 -- 172.21.15.81:0/757599420 learned_addr learned my addr 172.21.15.81:0/757599420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 -- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49fc005340 msgr2=0x7f4a180b8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49fc005340 0x7f4a180b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 -- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1814ac90 msgr2=0x7f4a1814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1814ac90 0x7f4a1814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.489+0000 7f4a16a00640 1 -- 172.21.15.81:0/757599420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a18157fe0 con 0x7f4a181f4c60 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.490+0000 7f4a16a00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a181f4c60 0x7f4a181f50e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a04003db0 tx=0x7f4a04001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.490+0000 7f4a0f400640 1 -- 172.21.15.81:0/757599420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04011430 con 0x7f4a181f4c60 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.490+0000 7f4a0f400640 1 -- 172.21.15.81:0/757599420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a04016020 con 0x7f4a181f4c60 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.490+0000 7f4a0f400640 1 -- 172.21.15.81:0/757599420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04011890 con 0x7f4a181f4c60 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.490+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a18158250 con 0x7f4a181f4c60 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.490+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a18158810 con 0x7f4a181f4c60 2024-09-10T20:40:37.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.491+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a18158a10 con 0x7f4a181f4c60 2024-09-10T20:40:37.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.492+0000 7f4a0f400640 1 -- 172.21.15.81:0/757599420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a04011a30 con 0x7f4a181f4c60 2024-09-10T20:40:37.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.493+0000 7f4a0f400640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f49f8077fa0 0x7f49f807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:37.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.494+0000 7f4a0f400640 1 -- 172.21.15.81:0/757599420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f4a0409acd0 con 0x7f4a181f4c60 2024-09-10T20:40:37.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.494+0000 7f4a17400640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f49f8077fa0 0x7f49f807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:37.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.495+0000 7f4a17400640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f49f8077fa0 0x7f49f807a460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4a08001160 tx=0x7f4a08000f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.498+0000 7f4a0f400640 1 -- 172.21.15.81:0/757599420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4a18158a10 con 0x7f4a181f4c60 2024-09-10T20:40:37.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:37.750+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) -- 0x7f4a180b31a0 con 0x7f4a181f4c60 2024-09-10T20:40:38.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.031+0000 7f4a0f400640 1 -- 172.21.15.81:0/757599420 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v66) ==== 150+0+0 (secure 0 0 0) 0x7f4a04020020 con 0x7f4a181f4c60 2024-09-10T20:40:38.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f49f8077fa0 msgr2=0x7f49f807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f49f8077fa0 0x7f49f807a460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4a08001160 tx=0x7f4a08000f90 comp rx=0 tx=0).stop 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a181f4c60 msgr2=0x7f4a181f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a181f4c60 0x7f4a181f50e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a04003db0 tx=0x7f4a04001800 comp rx=0 tx=0).stop 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 shutdown_connections 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f49f8077fa0 0x7f49f807a460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a1814ac90 0x7f4a1814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a181f4c60 0x7f4a181f50e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 --2- 172.21.15.81:0/757599420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f49fc005340 0x7f4a180b8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 >> 172.21.15.81:0/757599420 conn(0x7f4a180d3ab0 msgr2=0x7f4a180b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.033+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 shutdown_connections 2024-09-10T20:40:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.034+0000 7f4a1cc00640 1 -- 172.21.15.81:0/757599420 wait complete. 2024-09-10T20:40:38.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-10T20:40:38.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.208+0000 7f8dfae00640 1 -- 172.21.15.81:0/2457209444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dd8003c10 msgr2=0x7f8dd8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.208+0000 7f8dfae00640 1 --2- 172.21.15.81:0/2457209444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dd8003c10 0x7f8dd8004010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8de4001830 tx=0x7f8dd8005830 comp rx=0 tx=0).stop 2024-09-10T20:40:38.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.208+0000 7f8df8e00640 1 -- 172.21.15.81:0/2457209444 reap_dead start 2024-09-10T20:40:38.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.208+0000 7f8dfae00640 1 -- 172.21.15.81:0/2457209444 shutdown_connections 2024-09-10T20:40:38.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.208+0000 7f8dfae00640 1 -- 172.21.15.81:0/2457209444 >> 172.21.15.81:0/2457209444 conn(0x7f8df406cb50 msgr2=0x7f8df406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:38.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.208+0000 7f8dfae00640 1 -- 172.21.15.81:0/2457209444 shutdown_connections 2024-09-10T20:40:38.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.208+0000 7f8dfae00640 1 -- 172.21.15.81:0/2457209444 wait complete. 2024-09-10T20:40:38.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.209+0000 7f8dfae00640 1 Processor -- start 2024-09-10T20:40:38.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.210+0000 7f8dfae00640 1 -- start start 2024-09-10T20:40:38.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.210+0000 7f8dfae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8003c10 0x7f8df4158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.210+0000 7f8dfae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8df4153360 0x7f8df414c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.210+0000 7f8dfae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8df41f88c0 0x7f8df406f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.210+0000 7f8dfae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8df40cfef0 con 0x7f8df4153360 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.210+0000 7f8dfae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8df40cfd70 con 0x7f8df41f88c0 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.210+0000 7f8dfae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8df40d0070 con 0x7f8dd8003c10 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8df4153360 0x7f8df414c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8df4153360 0x7f8df414c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60588/0 (socket says 172.21.15.81:60588) 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 -- 172.21.15.81:0/2888496935 learned_addr learned my addr 172.21.15.81:0/2888496935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8df3e00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8003c10 0x7f8df4158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8df8e00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8df41f88c0 0x7f8df406f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 -- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8003c10 msgr2=0x7f8df4158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8003c10 0x7f8df4158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 -- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8df41f88c0 msgr2=0x7f8df406f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8df41f88c0 0x7f8df406f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 -- 172.21.15.81:0/2888496935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df415ac80 con 0x7f8df4153360 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8df8e00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8df41f88c0 0x7f8df406f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8df3e00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8003c10 0x7f8df4158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.211+0000 7f8debe00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8df4153360 0x7f8df414c1b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc006600 tx=0x7f8ddc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.212+0000 7f8df0c00640 1 -- 172.21.15.81:0/2888496935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc015070 con 0x7f8df4153360 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.212+0000 7f8df0c00640 1 -- 172.21.15.81:0/2888496935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ddc011920 con 0x7f8df4153360 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.212+0000 7f8df0c00640 1 -- 172.21.15.81:0/2888496935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc011d70 con 0x7f8df4153360 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.212+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df41f7de0 con 0x7f8df4153360 2024-09-10T20:40:38.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.212+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df41f83a0 con 0x7f8df4153360 2024-09-10T20:40:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.213+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df40ccd60 con 0x7f8df4153360 2024-09-10T20:40:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.214+0000 7f8df0c00640 1 -- 172.21.15.81:0/2888496935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8ddc0103c0 con 0x7f8df4153360 2024-09-10T20:40:38.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.215+0000 7f8df0c00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8dd0077fa0 0x7f8dd007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.215+0000 7f8df0c00640 1 -- 172.21.15.81:0/2888496935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f8ddc09b1a0 con 0x7f8df4153360 2024-09-10T20:40:38.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.215+0000 7f8df3e00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8dd0077fa0 0x7f8dd007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.216+0000 7f8df3e00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8dd0077fa0 0x7f8dd007a460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8de4001830 tx=0x7f8de4001360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:38.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.219+0000 7f8df0c00640 1 -- 172.21.15.81:0/2888496935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8df40ccd60 con 0x7f8df4153360 2024-09-10T20:40:38.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.402+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8df41f85a0 con 0x7f8df4153360 2024-09-10T20:40:38.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.403+0000 7f8df0c00640 1 -- 172.21.15.81:0/2888496935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f8df41f85a0 con 0x7f8df4153360 2024-09-10T20:40:38.408 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-10T20:40:38.408 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-10T20:40:38.408 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-10T20:40:38.408 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-10T20:40:38.408 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3632.868755 2024-09-10T20:40:38.408 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3457.954813 2024-09-10T20:40:38.408 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3808.832334 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3931.718129 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4529.416068 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7661.696386 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4319.737171 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4859.987896 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-10T20:40:38.409 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-10T20:40:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-10T20:40:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-10T20:40:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-10T20:40:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-10T20:40:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-10T20:40:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-10T20:40:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-10T20:40:38.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8dd0077fa0 msgr2=0x7f8dd007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8dd0077fa0 0x7f8dd007a460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8de4001830 tx=0x7f8de4001360 comp rx=0 tx=0).stop 2024-09-10T20:40:38.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8df4153360 msgr2=0x7f8df414c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8df4153360 0x7f8df414c1b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc006600 tx=0x7f8ddc0039c0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 shutdown_connections 2024-09-10T20:40:38.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8dd0077fa0 0x7f8dd007a460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8df41f88c0 0x7f8df406f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8df4153360 0x7f8df414c1b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 --2- 172.21.15.81:0/2888496935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8dd8003c10 0x7f8df4158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 >> 172.21.15.81:0/2888496935 conn(0x7f8df406cb50 msgr2=0x7f8df40b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 shutdown_connections 2024-09-10T20:40:38.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.405+0000 7f8dfae00640 1 -- 172.21.15.81:0/2888496935 wait complete. 2024-09-10T20:40:38.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T20:40:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.581+0000 7fc08de00640 1 -- 172.21.15.81:0/3422008976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 msgr2=0x7fc088166c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.581+0000 7fc08de00640 1 --2- 172.21.15.81:0/3422008976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc088166c70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc080005fd0 tx=0x7fc08002a940 comp rx=0 tx=0).stop 2024-09-10T20:40:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.581+0000 7fc08de00640 1 -- 172.21.15.81:0/3422008976 shutdown_connections 2024-09-10T20:40:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.581+0000 7fc08de00640 1 --2- 172.21.15.81:0/3422008976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc088166c70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.581+0000 7fc08de00640 1 -- 172.21.15.81:0/3422008976 >> 172.21.15.81:0/3422008976 conn(0x7fc08809a9e0 msgr2=0x7fc0880d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.581+0000 7fc08de00640 1 -- 172.21.15.81:0/3422008976 shutdown_connections 2024-09-10T20:40:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.581+0000 7fc08de00640 1 -- 172.21.15.81:0/3422008976 wait complete. 2024-09-10T20:40:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.583+0000 7fc08de00640 1 Processor -- start 2024-09-10T20:40:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.583+0000 7fc08de00640 1 -- start start 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08de00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc08809adf0 0x7fc0881669f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08de00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc08815ff50 0x7fc0880b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc0880b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08de00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0880cedc0 con 0x7fc088164880 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08de00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc0880cec40 con 0x7fc08809adf0 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08de00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc0881671b0 con 0x7fc08815ff50 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc0880b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc0880b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60598/0 (socket says 172.21.15.81:60598) 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 -- 172.21.15.81:0/3902649564 learned_addr learned my addr 172.21.15.81:0/3902649564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc087e00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc08815ff50 0x7fc0880b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08ca00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc08809adf0 0x7fc0881669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 -- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc08815ff50 msgr2=0x7fc0880b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc08815ff50 0x7fc0880b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 -- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc08809adf0 msgr2=0x7fc0881669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc08809adf0 0x7fc0881669f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08d400640 1 -- 172.21.15.81:0/3902649564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0880b3f70 con 0x7fc088164880 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc087e00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc08815ff50 0x7fc0880b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.584+0000 7fc08ca00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc08809adf0 0x7fc0881669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.585+0000 7fc08d400640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc0880b33d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc080009cd0 tx=0x7fc080031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.585+0000 7fc084c00640 1 -- 172.21.15.81:0/3902649564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08003e070 con 0x7fc088164880 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.585+0000 7fc084c00640 1 -- 172.21.15.81:0/3902649564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc080004540 con 0x7fc088164880 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.585+0000 7fc084c00640 1 -- 172.21.15.81:0/3902649564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080030430 con 0x7fc088164880 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.585+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc088165f10 con 0x7fc088164880 2024-09-10T20:40:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.585+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc088157030 con 0x7fc088164880 2024-09-10T20:40:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.586+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0880cf4a0 con 0x7fc088164880 2024-09-10T20:40:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.587+0000 7fc084c00640 1 -- 172.21.15.81:0/3902649564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc08002f070 con 0x7fc088164880 2024-09-10T20:40:38.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.588+0000 7fc084c00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc068077fa0 0x7fc06807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:38.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.588+0000 7fc084c00640 1 -- 172.21.15.81:0/3902649564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fc0800bb770 con 0x7fc088164880 2024-09-10T20:40:38.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.589+0000 7fc08ca00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc068077fa0 0x7fc06807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:38.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.589+0000 7fc08ca00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc068077fa0 0x7fc06807a460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc078007a50 tx=0x7fc078009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:38.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.592+0000 7fc084c00640 1 -- 172.21.15.81:0/3902649564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc080083ef0 con 0x7fc088164880 2024-09-10T20:40:38.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.773+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc0880d27c0 con 0x7fc088164880 2024-09-10T20:40:38.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.776+0000 7fc084c00640 1 -- 172.21.15.81:0/3902649564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fc0800837f0 con 0x7fc088164880 2024-09-10T20:40:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc068077fa0 msgr2=0x7fc06807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc068077fa0 0x7fc06807a460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc078007a50 tx=0x7fc078009040 comp rx=0 tx=0).stop 2024-09-10T20:40:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 msgr2=0x7fc0880b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc0880b33d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc080009cd0 tx=0x7fc080031ea0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 shutdown_connections 2024-09-10T20:40:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc068077fa0 0x7fc06807a460 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc088164880 0x7fc0880b33d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc08815ff50 0x7fc0880b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 --2- 172.21.15.81:0/3902649564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc08809adf0 0x7fc0881669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 >> 172.21.15.81:0/3902649564 conn(0x7fc08809a9e0 msgr2=0x7fc0880af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 shutdown_connections 2024-09-10T20:40:38.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:38.779+0000 7fc08de00640 1 -- 172.21.15.81:0/3902649564 wait complete. 2024-09-10T20:40:38.800 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T20:40:38.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:40:38.898 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:40:39.000 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T20:40:39.001 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:39.001 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:39.036 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:39.036 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:39.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 -- 172.21.15.81:0/4000584413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61700741e0 msgr2=0x7f617015f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 --2- 172.21.15.81:0/4000584413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61700741e0 0x7f617015f4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6158005fd0 tx=0x7f615802a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 -- 172.21.15.81:0/4000584413 shutdown_connections 2024-09-10T20:40:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 --2- 172.21.15.81:0/4000584413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f617015c750 0x7f61700cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 --2- 172.21.15.81:0/4000584413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61700741e0 0x7f617015f4d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 -- 172.21.15.81:0/4000584413 >> 172.21.15.81:0/4000584413 conn(0x7f617006cb50 msgr2=0x7f617006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 -- 172.21.15.81:0/4000584413 shutdown_connections 2024-09-10T20:40:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.304+0000 7f6175e00640 1 -- 172.21.15.81:0/4000584413 wait complete. 2024-09-10T20:40:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.306+0000 7f6175e00640 1 Processor -- start 2024-09-10T20:40:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.306+0000 7f6175e00640 1 -- start start 2024-09-10T20:40:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6175e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61700741e0 0x7f6170152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6175e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f617015b680 0x7f617014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6175e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f617015c750 0x7f6170150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6175e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61700b29e0 con 0x7f617015b680 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6175e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f61700b2860 con 0x7f61700741e0 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6175e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f61700b2b60 con 0x7f617015c750 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6167e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f617015b680 0x7f617014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6167e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f617015b680 0x7f617014f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60620/0 (socket says 172.21.15.81:60620) 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f6167e00640 1 -- 172.21.15.81:0/2188743354 learned_addr learned my addr 172.21.15.81:0/2188743354 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f616ea00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61700741e0 0x7f6170152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.307+0000 7f616f400640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f617015c750 0x7f6170150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167e00640 1 -- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f617015c750 msgr2=0x7f6170150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f617015c750 0x7f6170150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167e00640 1 -- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61700741e0 msgr2=0x7f6170152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61700741e0 0x7f6170152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167e00640 1 -- 172.21.15.81:0/2188743354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61701f26b0 con 0x7f617015b680 2024-09-10T20:40:39.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f617015b680 0x7f617014f710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6158000c00 tx=0x7f61580038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:39.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167400640 1 -- 172.21.15.81:0/2188743354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615803f070 con 0x7f617015b680 2024-09-10T20:40:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167400640 1 -- 172.21.15.81:0/2188743354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6158005600 con 0x7f617015b680 2024-09-10T20:40:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6167400640 1 -- 172.21.15.81:0/2188743354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6158035030 con 0x7f617015b680 2024-09-10T20:40:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61701f2990 con 0x7f617015b680 2024-09-10T20:40:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.308+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61701f2f50 con 0x7f617015b680 2024-09-10T20:40:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.310+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61700b3080 con 0x7f617015b680 2024-09-10T20:40:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.311+0000 7f6167400640 1 -- 172.21.15.81:0/2188743354 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6158004a00 con 0x7f617015b680 2024-09-10T20:40:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.311+0000 7f6167400640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f614c077fa0 0x7f614c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.312+0000 7f6167400640 1 -- 172.21.15.81:0/2188743354 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f61580baee0 con 0x7f617015b680 2024-09-10T20:40:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.312+0000 7f616ea00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f614c077fa0 0x7f614c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.313+0000 7f616ea00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f614c077fa0 0x7f614c07a460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f61600017c0 tx=0x7f6160009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.315+0000 7f6167400640 1 -- 172.21.15.81:0/2188743354 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6158083020 con 0x7f617015b680 2024-09-10T20:40:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.510+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61700cc490 con 0x7f617015b680 2024-09-10T20:40:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.510+0000 7f6167400640 1 -- 172.21.15.81:0/2188743354 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f6158087a50 con 0x7f617015b680 2024-09-10T20:40:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.512+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f614c077fa0 msgr2=0x7f614c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.512+0000 7f6175e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f614c077fa0 0x7f614c07a460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f61600017c0 tx=0x7f6160009040 comp rx=0 tx=0).stop 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f617015b680 msgr2=0x7f617014f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f617015b680 0x7f617014f710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6158000c00 tx=0x7f61580038a0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 shutdown_connections 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f614c077fa0 0x7f614c07a460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f617015c750 0x7f6170150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f617015b680 0x7f617014f710 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 --2- 172.21.15.81:0/2188743354 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f61700741e0 0x7f6170152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 >> 172.21.15.81:0/2188743354 conn(0x7f617006cb50 msgr2=0x7f617015ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 shutdown_connections 2024-09-10T20:40:39.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.513+0000 7f6175e00640 1 -- 172.21.15.81:0/2188743354 wait complete. 2024-09-10T20:40:39.533 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:39.533 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:39.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 -- 172.21.15.81:0/1292576752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 msgr2=0x7fad5815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1292576752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 0x7fad5815ba60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad48005fd0 tx=0x7fad4802a8b0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 -- 172.21.15.81:0/1292576752 shutdown_connections 2024-09-10T20:40:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1292576752 >> v2:172.21.15.143:3300/0 conn(0x7fad5815c750 0x7fad580cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1292576752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 0x7fad5815ba60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 -- 172.21.15.81:0/1292576752 >> 172.21.15.81:0/1292576752 conn(0x7fad5806cb50 msgr2=0x7fad5806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 -- 172.21.15.81:0/1292576752 shutdown_connections 2024-09-10T20:40:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.763+0000 7fad5ea00640 1 -- 172.21.15.81:0/1292576752 wait complete. 2024-09-10T20:40:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.764+0000 7fad5ea00640 1 Processor -- start 2024-09-10T20:40:39.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.765+0000 7fad5ea00640 1 -- start start 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.765+0000 7fad5ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad580741e0 0x7fad5814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.765+0000 7fad5ea00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 0x7fad5815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.765+0000 7fad5ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5815c750 0x7fad5815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.765+0000 7fad5ea00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad580b2860 con 0x7fad5815c750 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.765+0000 7fad5ea00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fad580b29e0 con 0x7fad580741e0 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.765+0000 7fad5ea00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fad580b2b60 con 0x7fad5815b680 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5815c750 0x7fad5815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5815c750 0x7fad5815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60624/0 (socket says 172.21.15.81:60624) 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 -- 172.21.15.81:0/1338177868 learned_addr learned my addr 172.21.15.81:0/1338177868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad57400640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 0x7fad5815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad57e00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad580741e0 0x7fad5814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 -- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 msgr2=0x7fad5815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 0x7fad5815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 -- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad580741e0 msgr2=0x7fad5814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad580741e0 0x7fad5814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 -- 172.21.15.81:0/1338177868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad581e60c0 con 0x7fad5815c750 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad57e00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad580741e0 0x7fad5814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.766+0000 7fad5ca00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5815c750 0x7fad5815d5c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad5000e740 tx=0x7fad5000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.767+0000 7fad4fe00640 1 -- 172.21.15.81:0/1338177868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5000ccc0 con 0x7fad5815c750 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.767+0000 7fad4fe00640 1 -- 172.21.15.81:0/1338177868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad5000ce80 con 0x7fad5815c750 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.767+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad580b0060 con 0x7fad5815c750 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.767+0000 7fad4fe00640 1 -- 172.21.15.81:0/1338177868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50005280 con 0x7fad5815c750 2024-09-10T20:40:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.767+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5814b880 con 0x7fad5815c750 2024-09-10T20:40:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.768+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad580b3010 con 0x7fad5815c750 2024-09-10T20:40:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.769+0000 7fad4fe00640 1 -- 172.21.15.81:0/1338177868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fad50005420 con 0x7fad5815c750 2024-09-10T20:40:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.770+0000 7fad4fe00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fad38077f70 0x7fad3807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.770+0000 7fad4fe00640 1 -- 172.21.15.81:0/1338177868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fad5009aa00 con 0x7fad5815c750 2024-09-10T20:40:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.770+0000 7fad57e00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fad38077f70 0x7fad3807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.771+0000 7fad57e00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fad38077f70 0x7fad3807a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad48034000 tx=0x7fad48004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.774+0000 7fad4fe00640 1 -- 172.21.15.81:0/1338177868 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fad500630f0 con 0x7fad5815c750 2024-09-10T20:40:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.971+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fad580cbe70 con 0x7fad5815c750 2024-09-10T20:40:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.972+0000 7fad4fe00640 1 -- 172.21.15.81:0/1338177868 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fad500629f0 con 0x7fad5815c750 2024-09-10T20:40:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fad38077f70 msgr2=0x7fad3807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fad38077f70 0x7fad3807a430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fad48034000 tx=0x7fad48004ab0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5815c750 msgr2=0x7fad5815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5815c750 0x7fad5815d5c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad5000e740 tx=0x7fad5000ec00 comp rx=0 tx=0).stop 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 shutdown_connections 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fad38077f70 0x7fad3807a430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5815c750 0x7fad5815d5c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad5815b680 0x7fad5815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 --2- 172.21.15.81:0/1338177868 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad580741e0 0x7fad5814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 >> 172.21.15.81:0/1338177868 conn(0x7fad5806cb50 msgr2=0x7fad580b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 shutdown_connections 2024-09-10T20:40:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:39.974+0000 7fad5ea00640 1 -- 172.21.15.81:0/1338177868 wait complete. 2024-09-10T20:40:39.995 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-10T20:40:39.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:39.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T20:40:40.055 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:40.055 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:40:40.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:40.055 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T20:40:40.091 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:40:40.092 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:40.131 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:40:40.132 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:40.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:40.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.362+0000 7fe0c9a00640 1 -- 172.21.15.81:0/3649533096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a8003a00 msgr2=0x7fe0a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.362+0000 7fe0c9a00640 1 --2- 172.21.15.81:0/3649533096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0a8003a00 0x7fe0a8003e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009b50 tx=0x7fe0a8005830 comp rx=0 tx=0).stop 2024-09-10T20:40:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.362+0000 7fe0c3400640 1 -- 172.21.15.81:0/3649533096 reap_dead start 2024-09-10T20:40:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.362+0000 7fe0c9a00640 1 -- 172.21.15.81:0/3649533096 shutdown_connections 2024-09-10T20:40:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.362+0000 7fe0c9a00640 1 -- 172.21.15.81:0/3649533096 >> 172.21.15.81:0/3649533096 conn(0x7fe0c406cb50 msgr2=0x7fe0c406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.362+0000 7fe0c9a00640 1 -- 172.21.15.81:0/3649533096 shutdown_connections 2024-09-10T20:40:40.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.362+0000 7fe0c9a00640 1 -- 172.21.15.81:0/3649533096 wait complete. 2024-09-10T20:40:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.364+0000 7fe0c9a00640 1 Processor -- start 2024-09-10T20:40:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.364+0000 7fe0c9a00640 1 -- start start 2024-09-10T20:40:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c9a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a8003a00 0x7fe0c41f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0c415a870 0x7fe0c414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c9a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0c4154030 0x7fe0c40b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c9a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c40cfe40 con 0x7fe0c415a870 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c9a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c40cfcc0 con 0x7fe0a8003a00 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c9a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c40cffc0 con 0x7fe0c4154030 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0c415a870 0x7fe0c414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0c415a870 0x7fe0c414f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60640/0 (socket says 172.21.15.81:60640) 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.365+0000 7fe0c2000640 1 -- 172.21.15.81:0/1235404132 learned_addr learned my addr 172.21.15.81:0/1235404132 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c3400640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0c4154030 0x7fe0c40b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c2a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a8003a00 0x7fe0c41f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c2000640 1 -- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0c4154030 msgr2=0x7fe0c40b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c2000640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0c4154030 0x7fe0c40b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c2000640 1 -- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a8003a00 msgr2=0x7fe0c41f5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c2000640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a8003a00 0x7fe0c41f5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c2000640 1 -- 172.21.15.81:0/1235404132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c414f690 con 0x7fe0c415a870 2024-09-10T20:40:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c2000640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0c415a870 0x7fe0c414f150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000e680 tx=0x7fe0b000eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0baa00640 1 -- 172.21.15.81:0/1235404132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0015020 con 0x7fe0c415a870 2024-09-10T20:40:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0baa00640 1 -- 172.21.15.81:0/1235404132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0b000ee50 con 0x7fe0c415a870 2024-09-10T20:40:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0baa00640 1 -- 172.21.15.81:0/1235404132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000caa0 con 0x7fe0c415a870 2024-09-10T20:40:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c41f4f60 con 0x7fe0c415a870 2024-09-10T20:40:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.366+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c41f5200 con 0x7fe0c415a870 2024-09-10T20:40:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.368+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c40cc490 con 0x7fe0c415a870 2024-09-10T20:40:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.369+0000 7fe0baa00640 1 -- 172.21.15.81:0/1235404132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe0b000cc40 con 0x7fe0c415a870 2024-09-10T20:40:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.370+0000 7fe0baa00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0a4077f70 0x7fe0a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.370+0000 7fe0baa00640 1 -- 172.21.15.81:0/1235404132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fe0b009a850 con 0x7fe0c415a870 2024-09-10T20:40:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.371+0000 7fe0c2a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0a4077f70 0x7fe0a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.371+0000 7fe0c2a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0a4077f70 0x7fe0a407a430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4035000 tx=0x7fe0b402d040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.375+0000 7fe0baa00640 1 -- 172.21.15.81:0/1235404132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe0b001f030 con 0x7fe0c415a870 2024-09-10T20:40:40.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.568+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe0c406d3e0 con 0x7fe0c415a870 2024-09-10T20:40:40.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.569+0000 7fe0baa00640 1 -- 172.21.15.81:0/1235404132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fe0b0062f40 con 0x7fe0c415a870 2024-09-10T20:40:40.574 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:40.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0a4077f70 msgr2=0x7fe0a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0a4077f70 0x7fe0a407a430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4035000 tx=0x7fe0b402d040 comp rx=0 tx=0).stop 2024-09-10T20:40:40.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0c415a870 msgr2=0x7fe0c414f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0c415a870 0x7fe0c414f150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000e680 tx=0x7fe0b000eb40 comp rx=0 tx=0).stop 2024-09-10T20:40:40.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 shutdown_connections 2024-09-10T20:40:40.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0a4077f70 0x7fe0a407a430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0c4154030 0x7fe0c40b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0c415a870 0x7fe0c414f150 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 --2- 172.21.15.81:0/1235404132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0a8003a00 0x7fe0c41f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 >> 172.21.15.81:0/1235404132 conn(0x7fe0c406cb50 msgr2=0x7fe0c406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:40.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 shutdown_connections 2024-09-10T20:40:40.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.571+0000 7fe0c9a00640 1 -- 172.21.15.81:0/1235404132 wait complete. 2024-09-10T20:40:40.592 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:40:40.593 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:40.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.784+0000 7ff2a4e00640 1 -- 172.21.15.81:0/3978492585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015c750 msgr2=0x7ff2a00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.784+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/3978492585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015c750 0x7ff2a00cf780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0070960 tx=0x7ff29802aa30 comp rx=0 tx=0).stop 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.784+0000 7ff2a4e00640 1 -- 172.21.15.81:0/3978492585 shutdown_connections 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.784+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/3978492585 >> v2:172.21.15.143:3300/0 conn(0x7ff2a00741e0 0x7ff2a015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.784+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/3978492585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015c750 0x7ff2a00cf780 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.784+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/3978492585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2a015b680 0x7ff2a015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.784+0000 7ff2a4e00640 1 -- 172.21.15.81:0/3978492585 >> 172.21.15.81:0/3978492585 conn(0x7ff2a006cb50 msgr2=0x7ff2a006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.785+0000 7ff2a4e00640 1 -- 172.21.15.81:0/3978492585 shutdown_connections 2024-09-10T20:40:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.785+0000 7ff2a4e00640 1 -- 172.21.15.81:0/3978492585 wait complete. 2024-09-10T20:40:40.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.786+0000 7ff2a4e00640 1 Processor -- start 2024-09-10T20:40:40.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.786+0000 7ff2a4e00640 1 -- start start 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff2a4e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2a00741e0 0x7ff2a01566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff2a4e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015b680 0x7ff2a014f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff2a4e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2a015c750 0x7ff2a015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff2a4e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a00d00d0 con 0x7ff2a015b680 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff2a4e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a00cff50 con 0x7ff2a00741e0 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff2a4e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a00b2860 con 0x7ff2a015c750 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff29d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015b680 0x7ff2a014f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff29d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015b680 0x7ff2a014f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60660/0 (socket says 172.21.15.81:60660) 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.787+0000 7ff29d400640 1 -- 172.21.15.81:0/2588567741 learned_addr learned my addr 172.21.15.81:0/2588567741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29e800640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2a015c750 0x7ff2a015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29de00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2a00741e0 0x7ff2a01566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29d400640 1 -- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2a015c750 msgr2=0x7ff2a015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29d400640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2a015c750 0x7ff2a015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29d400640 1 -- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2a00741e0 msgr2=0x7ff2a01566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29d400640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2a00741e0 0x7ff2a01566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29d400640 1 -- 172.21.15.81:0/2588567741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a00b07d0 con 0x7ff2a015b680 2024-09-10T20:40:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29e800640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2a015c750 0x7ff2a015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff29d400640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015b680 0x7ff2a014f280 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e9f0 tx=0x7ff28c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff296000640 1 -- 172.21.15.81:0/2588567741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00ccc0 con 0x7ff2a015b680 2024-09-10T20:40:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff296000640 1 -- 172.21.15.81:0/2588567741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff28c010430 con 0x7ff2a015b680 2024-09-10T20:40:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff296000640 1 -- 172.21.15.81:0/2588567741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c010840 con 0x7ff2a015b680 2024-09-10T20:40:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.788+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a01f81e0 con 0x7ff2a015b680 2024-09-10T20:40:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.789+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a01f87a0 con 0x7ff2a015b680 2024-09-10T20:40:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.789+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a015ba60 con 0x7ff2a015b680 2024-09-10T20:40:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.791+0000 7ff296000640 1 -- 172.21.15.81:0/2588567741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff28c0109e0 con 0x7ff2a015b680 2024-09-10T20:40:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.792+0000 7ff296000640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff280077f70 0x7ff28007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.792+0000 7ff296000640 1 -- 172.21.15.81:0/2588567741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7ff28c09ac00 con 0x7ff2a015b680 2024-09-10T20:40:40.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.792+0000 7ff29de00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff280077f70 0x7ff28007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:40.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.793+0000 7ff29de00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff280077f70 0x7ff28007a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff290009b60 tx=0x7ff290005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:40.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.796+0000 7ff296000640 1 -- 172.21.15.81:0/2588567741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff28c063380 con 0x7ff2a015b680 2024-09-10T20:40:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.996+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff2a00b3650 con 0x7ff2a015b680 2024-09-10T20:40:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.996+0000 7ff296000640 1 -- 172.21.15.81:0/2588567741 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7ff28c062c80 con 0x7ff2a015b680 2024-09-10T20:40:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:41.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.998+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff280077f70 msgr2=0x7ff28007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.998+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff280077f70 0x7ff28007a430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff290009b60 tx=0x7ff290005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:41.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.998+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015b680 msgr2=0x7ff2a014f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.998+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015b680 0x7ff2a014f280 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e9f0 tx=0x7ff28c00eeb0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 shutdown_connections 2024-09-10T20:40:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff280077f70 0x7ff28007a430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff2a015c750 0x7ff2a015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2a015b680 0x7ff2a014f280 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 --2- 172.21.15.81:0/2588567741 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2a00741e0 0x7ff2a01566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 >> 172.21.15.81:0/2588567741 conn(0x7ff2a006cb50 msgr2=0x7ff2a00aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 shutdown_connections 2024-09-10T20:40:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:40.999+0000 7ff2a4e00640 1 -- 172.21.15.81:0/2588567741 wait complete. 2024-09-10T20:40:41.019 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi143.front.sepia.ceph.com... 2024-09-10T20:40:41.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:41.020 DEBUG:teuthology.orchestra.run.smithi143:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-10T20:40:41.083 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:41.083 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:40:41.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:41.084 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T20:40:41.134 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:41.134 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:41.170 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:41.170 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:41.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.438+0000 7faed7200640 1 -- 172.21.15.81:0/1350503030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8074280 msgr2=0x7faed80730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.438+0000 7faed7200640 1 --2- 172.21.15.81:0/1350503030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8074280 0x7faed80730d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faec0005fd0 tx=0x7faec002a540 comp rx=0 tx=0).stop 2024-09-10T20:40:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.439+0000 7faed7200640 1 -- 172.21.15.81:0/1350503030 shutdown_connections 2024-09-10T20:40:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.439+0000 7faed7200640 1 --2- 172.21.15.81:0/1350503030 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faed815c6c0 0x7faed80ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.439+0000 7faed7200640 1 --2- 172.21.15.81:0/1350503030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8074280 0x7faed80730d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.439+0000 7faed7200640 1 -- 172.21.15.81:0/1350503030 >> 172.21.15.81:0/1350503030 conn(0x7faed80b1480 msgr2=0x7faed80b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.439+0000 7faed7200640 1 -- 172.21.15.81:0/1350503030 shutdown_connections 2024-09-10T20:40:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.439+0000 7faed7200640 1 -- 172.21.15.81:0/1350503030 wait complete. 2024-09-10T20:40:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.440+0000 7faed7200640 1 Processor -- start 2024-09-10T20:40:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.440+0000 7faed7200640 1 -- start start 2024-09-10T20:40:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.441+0000 7faed7200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faed8074280 0x7faed81f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.441+0000 7faed7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8155df0 0x7faed814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.441+0000 7faed7200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faed815c6c0 0x7faed81533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.441+0000 7faed7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faed80cbed0 con 0x7faed8155df0 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.441+0000 7faed7200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faed80cbd50 con 0x7faed815c6c0 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.441+0000 7faed7200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faed80ae9d0 con 0x7faed8074280 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8155df0 0x7faed814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8155df0 0x7faed814cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60666/0 (socket says 172.21.15.81:60666) 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 -- 172.21.15.81:0/1711244001 learned_addr learned my addr 172.21.15.81:0/1711244001 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faed6800640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faed815c6c0 0x7faed81533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faed5e00640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faed8074280 0x7faed81f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 -- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faed8074280 msgr2=0x7faed81f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faed8074280 0x7faed81f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 -- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faed815c6c0 msgr2=0x7faed81533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faed815c6c0 0x7faed81533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 -- 172.21.15.81:0/1711244001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed814e140 con 0x7faed8155df0 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecd400640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8155df0 0x7faed814cef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faec0009850 tx=0x7faec00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.442+0000 7faecea00640 1 -- 172.21.15.81:0/1711244001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec003f070 con 0x7faed8155df0 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.443+0000 7faecea00640 1 -- 172.21.15.81:0/1711244001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faec00047a0 con 0x7faed8155df0 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.443+0000 7faecea00640 1 -- 172.21.15.81:0/1711244001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0035030 con 0x7faed8155df0 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.443+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed814e420 con 0x7faed8155df0 2024-09-10T20:40:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.443+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed814e9e0 con 0x7faed8155df0 2024-09-10T20:40:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.444+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed80aee80 con 0x7faed8155df0 2024-09-10T20:40:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.445+0000 7faecea00640 1 -- 172.21.15.81:0/1711244001 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faec0004b90 con 0x7faed8155df0 2024-09-10T20:40:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.446+0000 7faecea00640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faeb4077f70 0x7faeb407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.446+0000 7faecea00640 1 -- 172.21.15.81:0/1711244001 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7faec00bb1f0 con 0x7faed8155df0 2024-09-10T20:40:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.446+0000 7faed5e00640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faeb4077f70 0x7faeb407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.447+0000 7faed5e00640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faeb4077f70 0x7faeb407a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faec8001ec0 tx=0x7faec8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.450+0000 7faecea00640 1 -- 172.21.15.81:0/1711244001 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faec0083290 con 0x7faed8155df0 2024-09-10T20:40:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.645+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faed80704a0 con 0x7faed8155df0 2024-09-10T20:40:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.645+0000 7faecea00640 1 -- 172.21.15.81:0/1711244001 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7faec0087cc0 con 0x7faed8155df0 2024-09-10T20:40:41.650 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.647+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faeb4077f70 msgr2=0x7faeb407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.647+0000 7faed7200640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faeb4077f70 0x7faeb407a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faec8001ec0 tx=0x7faec8009040 comp rx=0 tx=0).stop 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.647+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8155df0 msgr2=0x7faed814cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.647+0000 7faed7200640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8155df0 0x7faed814cef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faec0009850 tx=0x7faec00038a0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 shutdown_connections 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faeb4077f70 0x7faeb407a430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faed815c6c0 0x7faed81533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faed8155df0 0x7faed814cef0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 --2- 172.21.15.81:0/1711244001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faed8074280 0x7faed81f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 >> 172.21.15.81:0/1711244001 conn(0x7faed80b1480 msgr2=0x7faed80af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 shutdown_connections 2024-09-10T20:40:41.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.648+0000 7faed7200640 1 -- 172.21.15.81:0/1711244001 wait complete. 2024-09-10T20:40:41.668 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:40:41.668 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:41.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:41.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 -- 172.21.15.81:0/2845364788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415b680 msgr2=0x7f1d7415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 --2- 172.21.15.81:0/2845364788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415b680 0x7f1d7415ba60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005fd0 tx=0x7f1d6402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 -- 172.21.15.81:0/2845364788 shutdown_connections 2024-09-10T20:40:41.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 --2- 172.21.15.81:0/2845364788 >> v2:172.21.15.143:3300/0 conn(0x7f1d740741e0 0x7f1d7415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 --2- 172.21.15.81:0/2845364788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415b680 0x7f1d7415ba60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 -- 172.21.15.81:0/2845364788 >> 172.21.15.81:0/2845364788 conn(0x7f1d7406cb50 msgr2=0x7f1d7406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:41.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 -- 172.21.15.81:0/2845364788 shutdown_connections 2024-09-10T20:40:41.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.899+0000 7f1d7a400640 1 -- 172.21.15.81:0/2845364788 wait complete. 2024-09-10T20:40:41.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.901+0000 7f1d7a400640 1 Processor -- start 2024-09-10T20:40:41.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.901+0000 7f1d7a400640 1 -- start start 2024-09-10T20:40:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d7a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d740741e0 0x7f1d741f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d7a400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d7415b680 0x7f1d7406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d7a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415c750 0x7f1d74154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d7a400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d740b29e0 con 0x7f1d740741e0 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d7a400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1d740b2860 con 0x7f1d7415b680 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d7a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1d740b2b60 con 0x7f1d7415c750 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d740741e0 0x7f1d741f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d740741e0 0x7f1d741f4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60674/0 (socket says 172.21.15.81:60674) 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 -- 172.21.15.81:0/236019531 learned_addr learned my addr 172.21.15.81:0/236019531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73e00640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415c750 0x7f1d74154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d72a00640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d7415b680 0x7f1d7406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 -- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415c750 msgr2=0x7f1d74154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415c750 0x7f1d74154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 -- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d7415b680 msgr2=0x7f1d7406e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d7415b680 0x7f1d7406e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.902+0000 7f1d73400640 1 -- 172.21.15.81:0/236019531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d740ad8f0 con 0x7f1d740741e0 2024-09-10T20:40:41.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.903+0000 7f1d73400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d740741e0 0x7f1d741f4360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000c00 tx=0x7f1d64003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:41.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.903+0000 7f1d6b400640 1 -- 172.21.15.81:0/236019531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6403f070 con 0x7f1d740741e0 2024-09-10T20:40:41.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.903+0000 7f1d6b400640 1 -- 172.21.15.81:0/236019531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d64005600 con 0x7f1d740741e0 2024-09-10T20:40:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.903+0000 7f1d6b400640 1 -- 172.21.15.81:0/236019531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64035030 con 0x7f1d740741e0 2024-09-10T20:40:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.903+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7406eb00 con 0x7f1d740741e0 2024-09-10T20:40:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.903+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d741f4c30 con 0x7f1d740741e0 2024-09-10T20:40:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.904+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d740b3010 con 0x7f1d740741e0 2024-09-10T20:40:41.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.905+0000 7f1d6b400640 1 -- 172.21.15.81:0/236019531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1d64004a00 con 0x7f1d740741e0 2024-09-10T20:40:41.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.906+0000 7f1d6b400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1d54077f70 0x7f1d5407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:41.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.906+0000 7f1d6b400640 1 -- 172.21.15.81:0/236019531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f1d640baf90 con 0x7f1d740741e0 2024-09-10T20:40:41.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.907+0000 7f1d72a00640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1d54077f70 0x7f1d5407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:41.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.907+0000 7f1d72a00640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1d54077f70 0x7f1d5407a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d7415aad0 tx=0x7f1d60005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:41.910+0000 7f1d6b400640 1 -- 172.21.15.81:0/236019531 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1d64083030 con 0x7f1d740741e0 2024-09-10T20:40:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.107+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1d740cc490 con 0x7f1d740741e0 2024-09-10T20:40:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.107+0000 7f1d6b400640 1 -- 172.21.15.81:0/236019531 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f1d64087a60 con 0x7f1d740741e0 2024-09-10T20:40:42.111 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1d54077f70 msgr2=0x7f1d5407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1d54077f70 0x7f1d5407a430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d7415aad0 tx=0x7f1d60005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d740741e0 msgr2=0x7f1d741f4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d740741e0 0x7f1d741f4360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000c00 tx=0x7f1d64003820 comp rx=0 tx=0).stop 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 shutdown_connections 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1d54077f70 0x7f1d5407a430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1d7415c750 0x7f1d74154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d7415b680 0x7f1d7406e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.109+0000 7f1d7a400640 1 --2- 172.21.15.81:0/236019531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d740741e0 0x7f1d741f4360 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.110+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 >> 172.21.15.81:0/236019531 conn(0x7f1d7406cb50 msgr2=0x7f1d7415e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.110+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 shutdown_connections 2024-09-10T20:40:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.110+0000 7f1d7a400640 1 -- 172.21.15.81:0/236019531 wait complete. 2024-09-10T20:40:42.130 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-10T20:40:42.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:42.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-10T20:40:42.187 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:42.187 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:40:42.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:42.187 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T20:40:42.223 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:40:42.224 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:42.263 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:40:42.264 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:42.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:42.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.496+0000 7fdd3de00640 1 -- 172.21.15.81:0/3629688924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 msgr2=0x7fdd1c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.496+0000 7fdd3de00640 1 --2- 172.21.15.81:0/3629688924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd1c003ec0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdd28001eb0 tx=0x7fdd1c005830 comp rx=0 tx=0).stop 2024-09-10T20:40:42.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.496+0000 7fdd3de00640 1 -- 172.21.15.81:0/3629688924 shutdown_connections 2024-09-10T20:40:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.496+0000 7fdd3de00640 1 --2- 172.21.15.81:0/3629688924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd1c003ec0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.496+0000 7fdd3de00640 1 -- 172.21.15.81:0/3629688924 >> 172.21.15.81:0/3629688924 conn(0x7fdd3806cb50 msgr2=0x7fdd3806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.496+0000 7fdd3de00640 1 -- 172.21.15.81:0/3629688924 shutdown_connections 2024-09-10T20:40:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.496+0000 7fdd3de00640 1 -- 172.21.15.81:0/3629688924 wait complete. 2024-09-10T20:40:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.498+0000 7fdd3de00640 1 Processor -- start 2024-09-10T20:40:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.498+0000 7fdd3de00640 1 -- start start 2024-09-10T20:40:42.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd3de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd381f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd3de00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd381e52b0 0x7fdd3814b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd3de00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd381595d0 0x7fdd38159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd3de00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3815ba60 con 0x7fdd1c003aa0 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd3de00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3815fa60 con 0x7fdd381e52b0 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd3de00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3815bbe0 con 0x7fdd381595d0 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd381f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd381f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60692/0 (socket says 172.21.15.81:60692) 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 -- 172.21.15.81:0/806493559 learned_addr learned my addr 172.21.15.81:0/806493559 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 -- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd381595d0 msgr2=0x7fdd38159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd381595d0 0x7fdd38159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 -- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd381e52b0 msgr2=0x7fdd3814b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd381e52b0 0x7fdd3814b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 -- 172.21.15.81:0/806493559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd38156c70 con 0x7fdd1c003aa0 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.499+0000 7fdd36a00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd381f4ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd2802aff0 tx=0x7fdd280017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.500+0000 7fdd2f400640 1 -- 172.21.15.81:0/806493559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28001bf0 con 0x7fdd1c003aa0 2024-09-10T20:40:42.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.500+0000 7fdd2f400640 1 -- 172.21.15.81:0/806493559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd28003af0 con 0x7fdd1c003aa0 2024-09-10T20:40:42.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.500+0000 7fdd2f400640 1 -- 172.21.15.81:0/806493559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2802f470 con 0x7fdd1c003aa0 2024-09-10T20:40:42.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.500+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3814b8a0 con 0x7fdd1c003aa0 2024-09-10T20:40:42.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.500+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd381f5530 con 0x7fdd1c003aa0 2024-09-10T20:40:42.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.501+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd380cd020 con 0x7fdd1c003aa0 2024-09-10T20:40:42.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.502+0000 7fdd2f400640 1 -- 172.21.15.81:0/806493559 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdd2802f610 con 0x7fdd1c003aa0 2024-09-10T20:40:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.503+0000 7fdd2f400640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdd18077f70 0x7fdd1807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.503+0000 7fdd2f400640 1 -- 172.21.15.81:0/806493559 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fdd280bafd0 con 0x7fdd1c003aa0 2024-09-10T20:40:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.503+0000 7fdd36000640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdd18077f70 0x7fdd1807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.504+0000 7fdd36000640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdd18077f70 0x7fdd1807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd24000c00 tx=0x7fdd240060e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:42.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.507+0000 7fdd2f400640 1 -- 172.21.15.81:0/806493559 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdd28049030 con 0x7fdd1c003aa0 2024-09-10T20:40:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.701+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdd38073db0 con 0x7fdd1c003aa0 2024-09-10T20:40:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.702+0000 7fdd2f400640 1 -- 172.21.15.81:0/806493559 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fdd3814b8a0 con 0x7fdd1c003aa0 2024-09-10T20:40:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdd18077f70 msgr2=0x7fdd1807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdd18077f70 0x7fdd1807a430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd24000c00 tx=0x7fdd240060e0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 msgr2=0x7fdd381f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd381f4ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd2802aff0 tx=0x7fdd280017a0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 shutdown_connections 2024-09-10T20:40:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdd18077f70 0x7fdd1807a430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd381595d0 0x7fdd38159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd381e52b0 0x7fdd3814b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 --2- 172.21.15.81:0/806493559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd1c003aa0 0x7fdd381f4ad0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 >> 172.21.15.81:0/806493559 conn(0x7fdd3806cb50 msgr2=0x7fdd38072450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 shutdown_connections 2024-09-10T20:40:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.704+0000 7fdd3de00640 1 -- 172.21.15.81:0/806493559 wait complete. 2024-09-10T20:40:42.724 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:40:42.724 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:40:42.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.917+0000 7f9b85a00640 1 -- 172.21.15.81:0/1925938773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8015c750 msgr2=0x7f9b800cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.917+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1925938773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8015c750 0x7f9b800cf780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009830 tx=0x7f9b7802a510 comp rx=0 tx=0).stop 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.917+0000 7f9b85a00640 1 -- 172.21.15.81:0/1925938773 shutdown_connections 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.917+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1925938773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b8015c750 0x7f9b800cf780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.917+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1925938773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b800741e0 0x7f9b8015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.917+0000 7f9b85a00640 1 -- 172.21.15.81:0/1925938773 >> 172.21.15.81:0/1925938773 conn(0x7f9b8006cb50 msgr2=0x7f9b8006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.918+0000 7f9b85a00640 1 -- 172.21.15.81:0/1925938773 shutdown_connections 2024-09-10T20:40:42.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.918+0000 7f9b85a00640 1 -- 172.21.15.81:0/1925938773 wait complete. 2024-09-10T20:40:42.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.919+0000 7f9b85a00640 1 Processor -- start 2024-09-10T20:40:42.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.919+0000 7f9b85a00640 1 -- start start 2024-09-10T20:40:42.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.920+0000 7f9b85a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800741e0 0x7f9b800ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.920+0000 7f9b85a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8015b680 0x7f9b80145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.920+0000 7f9b85a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8015c750 0x7f9b801463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.920+0000 7f9b85a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b800b29e0 con 0x7f9b800741e0 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.920+0000 7f9b85a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9b800b2860 con 0x7f9b8015b680 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.920+0000 7f9b85a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9b800b2b60 con 0x7f9b8015c750 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.920+0000 7f9b7ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800741e0 0x7f9b800ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800741e0 0x7f9b800ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60712/0 (socket says 172.21.15.81:60712) 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 -- 172.21.15.81:0/1265643802 learned_addr learned my addr 172.21.15.81:0/1265643802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7f400640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8015c750 0x7f9b801463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7e000640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8015b680 0x7f9b80145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 -- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8015c750 msgr2=0x7f9b801463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8015c750 0x7f9b801463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 -- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8015b680 msgr2=0x7f9b80145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8015b680 0x7f9b80145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 -- 172.21.15.81:0/1265643802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b80146920 con 0x7f9b800741e0 2024-09-10T20:40:42.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b7ea00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800741e0 0x7f9b800ae9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000cbe0 tx=0x7f9b7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b76a00640 1 -- 172.21.15.81:0/1265643802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70016020 con 0x7f9b800741e0 2024-09-10T20:40:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b76a00640 1 -- 172.21.15.81:0/1265643802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b7000ae50 con 0x7f9b800741e0 2024-09-10T20:40:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.921+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b80146bc0 con 0x7f9b800741e0 2024-09-10T20:40:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.922+0000 7f9b76a00640 1 -- 172.21.15.81:0/1265643802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70012680 con 0x7f9b800741e0 2024-09-10T20:40:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.922+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b80147180 con 0x7f9b800741e0 2024-09-10T20:40:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.923+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b800b3080 con 0x7f9b800741e0 2024-09-10T20:40:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.924+0000 7f9b76a00640 1 -- 172.21.15.81:0/1265643802 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9b70012820 con 0x7f9b800741e0 2024-09-10T20:40:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.925+0000 7f9b76a00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b60077f70 0x7f9b6007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:42.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.925+0000 7f9b76a00640 1 -- 172.21.15.81:0/1265643802 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f9b7009a9b0 con 0x7f9b800741e0 2024-09-10T20:40:42.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.925+0000 7f9b7e000640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b60077f70 0x7f9b6007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:42.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.926+0000 7f9b7e000640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b60077f70 0x7f9b6007a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9b800cba90 tx=0x7f9b6c00b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:42.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:42.929+0000 7f9b76a00640 1 -- 172.21.15.81:0/1265643802 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9b70020020 con 0x7f9b800741e0 2024-09-10T20:40:43.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.125+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9b800b4240 con 0x7f9b800741e0 2024-09-10T20:40:43.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.125+0000 7f9b76a00640 1 -- 172.21.15.81:0/1265643802 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f9b70062a50 con 0x7f9b800741e0 2024-09-10T20:40:43.129 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b60077f70 msgr2=0x7f9b6007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b60077f70 0x7f9b6007a430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9b800cba90 tx=0x7f9b6c00b390 comp rx=0 tx=0).stop 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800741e0 msgr2=0x7f9b800ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800741e0 0x7f9b800ae9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000cbe0 tx=0x7f9b7000a430 comp rx=0 tx=0).stop 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 shutdown_connections 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9b60077f70 0x7f9b6007a430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b8015c750 0x7f9b801463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b8015b680 0x7f9b80145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 --2- 172.21.15.81:0/1265643802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b800741e0 0x7f9b800ae9c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 >> 172.21.15.81:0/1265643802 conn(0x7f9b8006cb50 msgr2=0x7f9b8015ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 shutdown_connections 2024-09-10T20:40:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.128+0000 7f9b85a00640 1 -- 172.21.15.81:0/1265643802 wait complete. 2024-09-10T20:40:43.147 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi143.front.sepia.ceph.com... 2024-09-10T20:40:43.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:43.148 DEBUG:teuthology.orchestra.run.smithi143:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-10T20:40:43.210 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:43.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:40:43.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:40:43.210 DEBUG:teuthology.orchestra.run.smithi143:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T20:40:43.247 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T20:40:43.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.401+0000 7fca28c00640 1 -- 172.21.15.81:0/3627410297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 msgr2=0x7fca08003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.401+0000 7fca28c00640 1 --2- 172.21.15.81:0/3627410297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 0x7fca08003e20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fca240d0890 tx=0x7fca08005830 comp rx=0 tx=0).stop 2024-09-10T20:40:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.401+0000 7fca22800640 1 -- 172.21.15.81:0/3627410297 reap_dead start 2024-09-10T20:40:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.401+0000 7fca28c00640 1 -- 172.21.15.81:0/3627410297 shutdown_connections 2024-09-10T20:40:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.401+0000 7fca28c00640 1 -- 172.21.15.81:0/3627410297 >> 172.21.15.81:0/3627410297 conn(0x7fca2406cb50 msgr2=0x7fca2406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.401+0000 7fca28c00640 1 -- 172.21.15.81:0/3627410297 shutdown_connections 2024-09-10T20:40:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.401+0000 7fca28c00640 1 -- 172.21.15.81:0/3627410297 wait complete. 2024-09-10T20:40:43.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.403+0000 7fca28c00640 1 Processor -- start 2024-09-10T20:40:43.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.403+0000 7fca28c00640 1 -- start start 2024-09-10T20:40:43.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca28c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 0x7fca2406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca28c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca240ce700 0x7fca24158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca28c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca24159130 0x7fca2415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca28c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca2415ba60 con 0x7fca08003a00 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca28c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fca2415cf00 con 0x7fca24159130 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca28c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fca2415bbe0 con 0x7fca240ce700 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca21e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 0x7fca2406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca21e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 0x7fca2406ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60724/0 (socket says 172.21.15.81:60724) 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca21e00640 1 -- 172.21.15.81:0/4099608385 learned_addr learned my addr 172.21.15.81:0/4099608385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca21400640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca240ce700 0x7fca24158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.404+0000 7fca22800640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca24159130 0x7fca2415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca21e00640 1 -- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca240ce700 msgr2=0x7fca24158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca21e00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca240ce700 0x7fca24158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca21e00640 1 -- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca24159130 msgr2=0x7fca2415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca21e00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca24159130 0x7fca2415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca21e00640 1 -- 172.21.15.81:0/4099608385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca241f8140 con 0x7fca08003a00 2024-09-10T20:40:43.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca21e00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 0x7fca2406ff00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca14001eb0 tx=0x7fca14033c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:43.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca1a000640 1 -- 172.21.15.81:0/4099608385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14038040 con 0x7fca08003a00 2024-09-10T20:40:43.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca1a000640 1 -- 172.21.15.81:0/4099608385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca14033e40 con 0x7fca08003a00 2024-09-10T20:40:43.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca1a000640 1 -- 172.21.15.81:0/4099608385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14009860 con 0x7fca08003a00 2024-09-10T20:40:43.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca241f8420 con 0x7fca08003a00 2024-09-10T20:40:43.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.405+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca241f89e0 con 0x7fca08003a00 2024-09-10T20:40:43.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.407+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca240b4880 con 0x7fca08003a00 2024-09-10T20:40:43.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.408+0000 7fca1a000640 1 -- 172.21.15.81:0/4099608385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fca1403b030 con 0x7fca08003a00 2024-09-10T20:40:43.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.408+0000 7fca1a000640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fca04077f70 0x7fca0407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.409+0000 7fca1a000640 1 -- 172.21.15.81:0/4099608385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fca140baaa0 con 0x7fca08003a00 2024-09-10T20:40:43.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.409+0000 7fca21400640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fca04077f70 0x7fca0407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.410+0000 7fca21400640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fca04077f70 0x7fca0407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca240cf100 tx=0x7fca10005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.412+0000 7fca1a000640 1 -- 172.21.15.81:0/4099608385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fca1404c020 con 0x7fca08003a00 2024-09-10T20:40:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.630+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca240cbe70 con 0x7fca08003a00 2024-09-10T20:40:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.631+0000 7fca1a000640 1 -- 172.21.15.81:0/4099608385 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fca14082be0 con 0x7fca08003a00 2024-09-10T20:40:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:43.635 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fca04077f70 msgr2=0x7fca0407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fca04077f70 0x7fca0407a430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fca240cf100 tx=0x7fca10005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 msgr2=0x7fca2406ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 0x7fca2406ff00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca14001eb0 tx=0x7fca14033c50 comp rx=0 tx=0).stop 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 shutdown_connections 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fca04077f70 0x7fca0407a430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca24159130 0x7fca2415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca240ce700 0x7fca24158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 --2- 172.21.15.81:0/4099608385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca08003a00 0x7fca2406ff00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 >> 172.21.15.81:0/4099608385 conn(0x7fca2406cb50 msgr2=0x7fca240cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 shutdown_connections 2024-09-10T20:40:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.633+0000 7fca28c00640 1 -- 172.21.15.81:0/4099608385 wait complete. 2024-09-10T20:40:43.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.806+0000 7f12bf200640 1 -- 172.21.15.81:0/2939395759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b80741e0 msgr2=0x7f12b815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.806+0000 7f12bf200640 1 --2- 172.21.15.81:0/2939395759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b80741e0 0x7f12b815f4d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009830 tx=0x7f12a402a5c0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.806+0000 7f12bf200640 1 -- 172.21.15.81:0/2939395759 shutdown_connections 2024-09-10T20:40:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.806+0000 7f12bf200640 1 --2- 172.21.15.81:0/2939395759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b80741e0 0x7f12b815f4d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.806+0000 7f12bf200640 1 -- 172.21.15.81:0/2939395759 >> 172.21.15.81:0/2939395759 conn(0x7f12b806cb50 msgr2=0x7f12b806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.806+0000 7f12bf200640 1 -- 172.21.15.81:0/2939395759 shutdown_connections 2024-09-10T20:40:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.806+0000 7f12bf200640 1 -- 172.21.15.81:0/2939395759 wait complete. 2024-09-10T20:40:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.807+0000 7f12bf200640 1 Processor -- start 2024-09-10T20:40:43.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.808+0000 7f12bf200640 1 -- start start 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.808+0000 7f12bf200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80741e0 0x7f12b8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12bf200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b815b680 0x7f12b815e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12bf200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b815c750 0x7f12b814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12bf200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80b2bf0 con 0x7f12b815b680 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12bf200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80b2a70 con 0x7f12b815c750 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12bf200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f12b80b2d70 con 0x7f12b80741e0 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b815b680 0x7f12b815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b815b680 0x7f12b815e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60748/0 (socket says 172.21.15.81:60748) 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 -- 172.21.15.81:0/2729652018 learned_addr learned my addr 172.21.15.81:0/2729652018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7e00640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80741e0 0x7f12b8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12bd200640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b815c750 0x7f12b814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 -- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80741e0 msgr2=0x7f12b8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80741e0 0x7f12b8156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 -- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b815c750 msgr2=0x7f12b814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b815c750 0x7f12b814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.809+0000 7f12b7400640 1 -- 172.21.15.81:0/2729652018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b81f8130 con 0x7f12b815b680 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.810+0000 7f12b7400640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b815b680 0x7f12b815e200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009950 tx=0x7f12a4032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.810+0000 7f12afe00640 1 -- 172.21.15.81:0/2729652018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4040070 con 0x7f12b815b680 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.810+0000 7f12afe00640 1 -- 172.21.15.81:0/2729652018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12a4005310 con 0x7f12b815b680 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.810+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b81f8410 con 0x7f12b815b680 2024-09-10T20:40:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.810+0000 7f12afe00640 1 -- 172.21.15.81:0/2729652018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40047a0 con 0x7f12b815b680 2024-09-10T20:40:43.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.810+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b81f89d0 con 0x7f12b815b680 2024-09-10T20:40:43.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.811+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b815f4d0 con 0x7f12b815b680 2024-09-10T20:40:43.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.812+0000 7f12afe00640 1 -- 172.21.15.81:0/2729652018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f12a404c030 con 0x7f12b815b680 2024-09-10T20:40:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.813+0000 7f12afe00640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1298077f70 0x7f129807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.813+0000 7f12afe00640 1 -- 172.21.15.81:0/2729652018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f12a40bb1d0 con 0x7f12b815b680 2024-09-10T20:40:43.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.814+0000 7f12b7e00640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1298077f70 0x7f129807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:43.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.814+0000 7f12b7e00640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1298077f70 0x7f129807a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12a8007fd0 tx=0x7f12a8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:43.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:43.817+0000 7f12afe00640 1 -- 172.21.15.81:0/2729652018 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f12a4083340 con 0x7f12b815b680 2024-09-10T20:40:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.037+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12b80cc490 con 0x7f12b815b680 2024-09-10T20:40:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.037+0000 7f12afe00640 1 -- 172.21.15.81:0/2729652018 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f12a4087d70 con 0x7f12b815b680 2024-09-10T20:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:44.042 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.040+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1298077f70 msgr2=0x7f129807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.040+0000 7f12bf200640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1298077f70 0x7f129807a430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f12a8007fd0 tx=0x7f12a8009040 comp rx=0 tx=0).stop 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.040+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b815b680 msgr2=0x7f12b815e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.040+0000 7f12bf200640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b815b680 0x7f12b815e200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009950 tx=0x7f12a4032c00 comp rx=0 tx=0).stop 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 shutdown_connections 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1298077f70 0x7f129807a430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b815c750 0x7f12b814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b815b680 0x7f12b815e200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 --2- 172.21.15.81:0/2729652018 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80741e0 0x7f12b8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 >> 172.21.15.81:0/2729652018 conn(0x7f12b806cb50 msgr2=0x7f12b815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 shutdown_connections 2024-09-10T20:40:44.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.041+0000 7f12bf200640 1 -- 172.21.15.81:0/2729652018 wait complete. 2024-09-10T20:40:44.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 -- 172.21.15.81:0/864578438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 msgr2=0x7fd8f015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 --2- 172.21.15.81:0/864578438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f015ba60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00cd2b0 tx=0x7fd8e402a4a0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 -- 172.21.15.81:0/864578438 shutdown_connections 2024-09-10T20:40:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 --2- 172.21.15.81:0/864578438 >> v2:172.21.15.143:3300/0 conn(0x7fd8f015c750 0x7fd8f00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 --2- 172.21.15.81:0/864578438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f015ba60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 -- 172.21.15.81:0/864578438 >> 172.21.15.81:0/864578438 conn(0x7fd8f006cb50 msgr2=0x7fd8f006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 -- 172.21.15.81:0/864578438 shutdown_connections 2024-09-10T20:40:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.213+0000 7fd8f8600640 1 -- 172.21.15.81:0/864578438 wait complete. 2024-09-10T20:40:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.215+0000 7fd8f8600640 1 Processor -- start 2024-09-10T20:40:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.215+0000 7fd8f8600640 1 -- start start 2024-09-10T20:40:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f8600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8f00741e0 0x7fd8f01482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f8600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f00b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f8600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8f015c750 0x7fd8f00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f8600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00b2860 con 0x7fd8f015b680 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f8600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00b29e0 con 0x7fd8f00741e0 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f8600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f00b2b60 con 0x7fd8f015c750 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f00b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f00b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60764/0 (socket says 172.21.15.81:60764) 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 -- 172.21.15.81:0/1496061486 learned_addr learned my addr 172.21.15.81:0/1496061486 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5c00640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8f00741e0 0x7fd8f01482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f6600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8f015c750 0x7fd8f00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 -- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8f015c750 msgr2=0x7fd8f00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8f015c750 0x7fd8f00b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 -- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8f00741e0 msgr2=0x7fd8f01482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8f00741e0 0x7fd8f01482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5200640 1 -- 172.21.15.81:0/1496061486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f01487e0 con 0x7fd8f015b680 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.216+0000 7fd8f5c00640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8f00741e0 0x7fd8f01482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.217+0000 7fd8f5200640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f00b1100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00c530 tx=0x7fd8dc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.217+0000 7fd8ed600640 1 -- 172.21.15.81:0/1496061486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc017070 con 0x7fd8f015b680 2024-09-10T20:40:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.217+0000 7fd8ed600640 1 -- 172.21.15.81:0/1496061486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8dc0035f0 con 0x7fd8f015b680 2024-09-10T20:40:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.217+0000 7fd8ed600640 1 -- 172.21.15.81:0/1496061486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc003a40 con 0x7fd8f015b680 2024-09-10T20:40:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.217+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f01f54c0 con 0x7fd8f015b680 2024-09-10T20:40:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.217+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f01f7f00 con 0x7fd8f015b680 2024-09-10T20:40:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.218+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f00b3080 con 0x7fd8f015b680 2024-09-10T20:40:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.219+0000 7fd8ed600640 1 -- 172.21.15.81:0/1496061486 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd8dc003be0 con 0x7fd8f015b680 2024-09-10T20:40:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.220+0000 7fd8ed600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8d0077fa0 0x7fd8d007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.220+0000 7fd8ed600640 1 -- 172.21.15.81:0/1496061486 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fd8dc099800 con 0x7fd8f015b680 2024-09-10T20:40:44.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.221+0000 7fd8f5c00640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8d0077fa0 0x7fd8d007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.221+0000 7fd8f5c00640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8d0077fa0 0x7fd8d007a460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4034000 tx=0x7fd8e4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.224+0000 7fd8ed600640 1 -- 172.21.15.81:0/1496061486 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd8f01487e0 con 0x7fd8f015b680 2024-09-10T20:40:44.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.407+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8f00cc490 con 0x7fd8f015b680 2024-09-10T20:40:44.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.408+0000 7fd8ed600640 1 -- 172.21.15.81:0/1496061486 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18686 (secure 0 0 0) 0x7fd8dc061f80 con 0x7fd8f015b680 2024-09-10T20:40:44.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:44.413 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:40:33.003654+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8d0077fa0 msgr2=0x7fd8d007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8d0077fa0 0x7fd8d007a460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4034000 tx=0x7fd8e4004730 comp rx=0 tx=0).stop 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 msgr2=0x7fd8f00b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f00b1100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00c530 tx=0x7fd8dc00c9f0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 shutdown_connections 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8d0077fa0 0x7fd8d007a460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd8f015c750 0x7fd8f00b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8f015b680 0x7fd8f00b1100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 --2- 172.21.15.81:0/1496061486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8f00741e0 0x7fd8f01482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 >> 172.21.15.81:0/1496061486 conn(0x7fd8f006cb50 msgr2=0x7fd8f015ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 shutdown_connections 2024-09-10T20:40:44.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.411+0000 7fd8f8600640 1 -- 172.21.15.81:0/1496061486 wait complete. 2024-09-10T20:40:44.431 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T20:40:44.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.583+0000 7f6562800640 1 -- 172.21.15.81:0/2055339925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 msgr2=0x7f655c06efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.583+0000 7f6562800640 1 --2- 172.21.15.81:0/2055339925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c06efd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6554009ca0 tx=0x7f655402ab10 comp rx=0 tx=0).stop 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.584+0000 7f6562800640 1 -- 172.21.15.81:0/2055339925 shutdown_connections 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.584+0000 7f6562800640 1 --2- 172.21.15.81:0/2055339925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c06efd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.584+0000 7f6562800640 1 --2- 172.21.15.81:0/2055339925 >> v2:172.21.15.143:3300/0 conn(0x7f655c15b4d0 0x7f655c15ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.584+0000 7f6562800640 1 -- 172.21.15.81:0/2055339925 >> 172.21.15.81:0/2055339925 conn(0x7f655c06cb50 msgr2=0x7f655c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.584+0000 7f6562800640 1 -- 172.21.15.81:0/2055339925 shutdown_connections 2024-09-10T20:40:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.584+0000 7f6562800640 1 -- 172.21.15.81:0/2055339925 wait complete. 2024-09-10T20:40:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.585+0000 7f6562800640 1 Processor -- start 2024-09-10T20:40:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.586+0000 7f6562800640 1 -- start start 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.586+0000 7f6562800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.586+0000 7f6562800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655c0cf810 0x7f655c143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f6562800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f655c15b4d0 0x7f655c157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f6562800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f655c0b2da0 con 0x7f655c06eb60 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f6562800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f655c0b2c20 con 0x7f655c15b4d0 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f6562800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f655c0b2f20 con 0x7f655c0cf810 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c1448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60782/0 (socket says 172.21.15.81:60782) 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 -- 172.21.15.81:0/3733893786 learned_addr learned my addr 172.21.15.81:0/3733893786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655aa00640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655c0cf810 0x7f655c143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655be00640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f655c15b4d0 0x7f655c157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 -- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655c0cf810 msgr2=0x7f655c143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655c0cf810 0x7f655c143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 -- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f655c15b4d0 msgr2=0x7f655c157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f655c15b4d0 0x7f655c157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655b400640 1 -- 172.21.15.81:0/3733893786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655c0b04a0 con 0x7f655c06eb60 2024-09-10T20:40:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.587+0000 7f655aa00640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655c0cf810 0x7f655c143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.588+0000 7f655b400640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c1448f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f654c00c970 tx=0x7f654c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.588+0000 7f6553400640 1 -- 172.21.15.81:0/3733893786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c007bb0 con 0x7f655c06eb60 2024-09-10T20:40:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.588+0000 7f6553400640 1 -- 172.21.15.81:0/3733893786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f654c007e40 con 0x7f655c06eb60 2024-09-10T20:40:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.588+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655c0b0780 con 0x7f655c06eb60 2024-09-10T20:40:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.588+0000 7f6553400640 1 -- 172.21.15.81:0/3733893786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c00f690 con 0x7f655c06eb60 2024-09-10T20:40:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.588+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655c1444e0 con 0x7f655c06eb60 2024-09-10T20:40:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.589+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655c0b3440 con 0x7f655c06eb60 2024-09-10T20:40:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.590+0000 7f6553400640 1 -- 172.21.15.81:0/3733893786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f654c020030 con 0x7f655c06eb60 2024-09-10T20:40:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.591+0000 7f6553400640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f653c077f70 0x7f653c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.591+0000 7f6553400640 1 -- 172.21.15.81:0/3733893786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f654c09a580 con 0x7f655c06eb60 2024-09-10T20:40:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.591+0000 7f655aa00640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f653c077f70 0x7f653c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.592+0000 7f655aa00640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f653c077f70 0x7f653c07a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f655c06e980 tx=0x7f6548009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.595+0000 7f6553400640 1 -- 172.21.15.81:0/3733893786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f654c014030 con 0x7f655c06eb60 2024-09-10T20:40:44.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.812+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f655c0741f0 con 0x7f655c06eb60 2024-09-10T20:40:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.813+0000 7f6553400640 1 -- 172.21.15.81:0/3733893786 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f654c062d00 con 0x7f655c06eb60 2024-09-10T20:40:44.817 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:44.817 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:44.817 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f653c077f70 msgr2=0x7f653c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f653c077f70 0x7f653c07a430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f655c06e980 tx=0x7f6548009040 comp rx=0 tx=0).stop 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 msgr2=0x7f655c1448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c1448f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f654c00c970 tx=0x7f654c00ce30 comp rx=0 tx=0).stop 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 shutdown_connections 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f653c077f70 0x7f653c07a430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f655c15b4d0 0x7f655c157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f655c0cf810 0x7f655c143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 --2- 172.21.15.81:0/3733893786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f655c06eb60 0x7f655c1448f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.815+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 >> 172.21.15.81:0/3733893786 conn(0x7f655c06cb50 msgr2=0x7f655c073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.816+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 shutdown_connections 2024-09-10T20:40:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.816+0000 7f6562800640 1 -- 172.21.15.81:0/3733893786 wait complete. 2024-09-10T20:40:44.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:40:44.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.991+0000 7fac9f000640 1 -- 172.21.15.81:0/944858071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815b680 msgr2=0x7fac9815ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.991+0000 7fac9f000640 1 --2- 172.21.15.81:0/944858071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815b680 0x7fac9815ba60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac88005fd0 tx=0x7fac8802a8b0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.991+0000 7fac9f000640 1 -- 172.21.15.81:0/944858071 shutdown_connections 2024-09-10T20:40:44.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.991+0000 7fac9f000640 1 --2- 172.21.15.81:0/944858071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815b680 0x7fac9815ba60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.991+0000 7fac9f000640 1 -- 172.21.15.81:0/944858071 >> 172.21.15.81:0/944858071 conn(0x7fac9806cb50 msgr2=0x7fac9806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:44.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.991+0000 7fac9f000640 1 -- 172.21.15.81:0/944858071 shutdown_connections 2024-09-10T20:40:44.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.991+0000 7fac9f000640 1 -- 172.21.15.81:0/944858071 wait complete. 2024-09-10T20:40:44.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.993+0000 7fac9f000640 1 Processor -- start 2024-09-10T20:40:44.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.993+0000 7fac9f000640 1 -- start start 2024-09-10T20:40:44.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9f000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac980741e0 0x7fac981f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9f000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac9815b680 0x7fac980ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9f000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815c750 0x7fac981543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9f000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac980b2bf0 con 0x7fac9815c750 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9f000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fac980b2a70 con 0x7fac9815b680 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9f000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fac980b2d70 con 0x7fac980741e0 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815c750 0x7fac981543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815c750 0x7fac981543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51152/0 (socket says 172.21.15.81:51152) 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac9d000640 1 -- 172.21.15.81:0/1883977371 learned_addr learned my addr 172.21.15.81:0/1883977371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac97e00640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac980741e0 0x7fac981f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.994+0000 7fac97400640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac9815b680 0x7fac980ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9d000640 1 -- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac980741e0 msgr2=0x7fac981f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9d000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac980741e0 0x7fac981f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9d000640 1 -- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac9815b680 msgr2=0x7fac980ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9d000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac9815b680 0x7fac980ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9d000640 1 -- 172.21.15.81:0/1883977371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac980add90 con 0x7fac9815c750 2024-09-10T20:40:45.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9d000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815c750 0x7fac981543d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c390 tx=0x7fac9000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:45.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac8fe00640 1 -- 172.21.15.81:0/1883977371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90011790 con 0x7fac9815c750 2024-09-10T20:40:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac8fe00640 1 -- 172.21.15.81:0/1883977371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac90017070 con 0x7fac9815c750 2024-09-10T20:40:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac98159780 con 0x7fac9815c750 2024-09-10T20:40:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac8fe00640 1 -- 172.21.15.81:0/1883977371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90011ce0 con 0x7fac9815c750 2024-09-10T20:40:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.995+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac98157e60 con 0x7fac9815c750 2024-09-10T20:40:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.997+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9815f4d0 con 0x7fac9815c750 2024-09-10T20:40:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.998+0000 7fac8fe00640 1 -- 172.21.15.81:0/1883977371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fac9001c460 con 0x7fac9815c750 2024-09-10T20:40:45.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.998+0000 7fac8fe00640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fac78077f70 0x7fac7807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.999+0000 7fac8fe00640 1 -- 172.21.15.81:0/1883977371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fac90099c10 con 0x7fac9815c750 2024-09-10T20:40:45.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:44.999+0000 7fac97e00640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fac78077f70 0x7fac7807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:45.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.000+0000 7fac97e00640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fac78077f70 0x7fac7807a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac88034000 tx=0x7fac88004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.003+0000 7fac8fe00640 1 -- 172.21.15.81:0/1883977371 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fac90061de0 con 0x7fac9815c750 2024-09-10T20:40:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.222+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac980cc490 con 0x7fac9815c750 2024-09-10T20:40:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.223+0000 7fac8fe00640 1 -- 172.21.15.81:0/1883977371 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fac90066810 con 0x7fac9815c750 2024-09-10T20:40:45.227 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:45.227 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-10T20:40:13:915591+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4316,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1457251366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1457251366},{"type":"v1","addr":"172.21.15.81:6835","nonce":1457251366}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4325,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/2574339485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":2574339485},{"type":"v1","addr":"172.21.15.143:6836","nonce":2574339485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3788987782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3788987782},{"type":"v1","addr":"172.21.15.81:6834","nonce":3788987782}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:39:52.231273+0000","modified":"2024-09-10T20:40:13.332760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4381":{"gid":4381,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3994739210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3994739210},{"type":"v1","addr":"172.21.15.143:6837","nonce":3994739210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4381,"qdb_cluster":[4381]},"id":1}]} 2024-09-10T20:40:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-10T20:40:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.225+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fac78077f70 msgr2=0x7fac7807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.225+0000 7fac9f000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fac78077f70 0x7fac7807a430 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac88034000 tx=0x7fac88004ab0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.225+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815c750 msgr2=0x7fac981543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.225+0000 7fac9f000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815c750 0x7fac981543d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c390 tx=0x7fac9000c850 comp rx=0 tx=0).stop 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 shutdown_connections 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fac78077f70 0x7fac7807a430 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac9815c750 0x7fac981543d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac9815b680 0x7fac980ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 --2- 172.21.15.81:0/1883977371 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fac980741e0 0x7fac981f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 >> 172.21.15.81:0/1883977371 conn(0x7fac9806cb50 msgr2=0x7fac98154d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 shutdown_connections 2024-09-10T20:40:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.226+0000 7fac9f000640 1 -- 172.21.15.81:0/1883977371 wait complete. 2024-09-10T20:40:45.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 -- 172.21.15.81:0/1803391700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815c750 msgr2=0x7f4e580cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 --2- 172.21.15.81:0/1803391700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815c750 0x7f4e580cf780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4e50005fd0 tx=0x7f4e5002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 -- 172.21.15.81:0/1803391700 shutdown_connections 2024-09-10T20:40:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 --2- 172.21.15.81:0/1803391700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815c750 0x7f4e580cf780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 --2- 172.21.15.81:0/1803391700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e580741e0 0x7f4e5815f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 -- 172.21.15.81:0/1803391700 >> 172.21.15.81:0/1803391700 conn(0x7f4e5806cb50 msgr2=0x7f4e5806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 -- 172.21.15.81:0/1803391700 shutdown_connections 2024-09-10T20:40:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.399+0000 7f4e5d800640 1 -- 172.21.15.81:0/1803391700 wait complete. 2024-09-10T20:40:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.401+0000 7f4e5d800640 1 Processor -- start 2024-09-10T20:40:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.401+0000 7f4e5d800640 1 -- start start 2024-09-10T20:40:45.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.401+0000 7f4e5d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e580741e0 0x7f4e580b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e5d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815b680 0x7f4e580b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e5d800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e5815c750 0x7f4e58159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e5d800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e580b29e0 con 0x7f4e5815b680 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e5d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4e580b2860 con 0x7f4e580741e0 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e5d800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4e580b2b60 con 0x7f4e5815c750 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815b680 0x7f4e580b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815b680 0x7f4e580b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51164/0 (socket says 172.21.15.81:51164) 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 -- 172.21.15.81:0/23918800 learned_addr learned my addr 172.21.15.81:0/23918800 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56a00640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e580741e0 0x7f4e580b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e57400640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e5815c750 0x7f4e58159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 -- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e5815c750 msgr2=0x7f4e58159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e5815c750 0x7f4e58159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 -- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e580741e0 msgr2=0x7f4e580b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e580741e0 0x7f4e580b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.402+0000 7f4e56000640 1 -- 172.21.15.81:0/23918800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e581f8c20 con 0x7f4e5815b680 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.403+0000 7f4e56000640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815b680 0x7f4e580b1da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400d770 tx=0x7f4e4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.403+0000 7f4e4ea00640 1 -- 172.21.15.81:0/23918800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44017070 con 0x7f4e5815b680 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.403+0000 7f4e4ea00640 1 -- 172.21.15.81:0/23918800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e44009d20 con 0x7f4e5815b680 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.403+0000 7f4e4ea00640 1 -- 172.21.15.81:0/23918800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44005280 con 0x7f4e5815b680 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.403+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e581f8ea0 con 0x7f4e5815b680 2024-09-10T20:40:45.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.403+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e581f9460 con 0x7f4e5815b680 2024-09-10T20:40:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.404+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e580b3080 con 0x7f4e5815b680 2024-09-10T20:40:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.405+0000 7f4e4ea00640 1 -- 172.21.15.81:0/23918800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4e44005420 con 0x7f4e5815b680 2024-09-10T20:40:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.406+0000 7f4e4ea00640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4e38077fa0 0x7f4e3807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.406+0000 7f4e4ea00640 1 -- 172.21.15.81:0/23918800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f4e4409a180 con 0x7f4e5815b680 2024-09-10T20:40:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.407+0000 7f4e56a00640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4e38077fa0 0x7f4e3807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.407+0000 7f4e56a00640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4e38077fa0 0x7f4e3807a460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e48001ec0 tx=0x7f4e48009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.410+0000 7f4e4ea00640 1 -- 172.21.15.81:0/23918800 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4e581f8c20 con 0x7f4e5815b680 2024-09-10T20:40:45.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.593+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e580cfaa0 con 0x7f4e5815b680 2024-09-10T20:40:45.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.594+0000 7f4e4ea00640 1 -- 172.21.15.81:0/23918800 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18686 (secure 0 0 0) 0x7f4e440622c0 con 0x7f4e5815b680 2024-09-10T20:40:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:45.599 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:40:33.003654+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:39:50.223187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T20:39:51.199432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T20:39:54.848190+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4e38077fa0 msgr2=0x7f4e3807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4e38077fa0 0x7f4e3807a460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e48001ec0 tx=0x7f4e48009040 comp rx=0 tx=0).stop 2024-09-10T20:40:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815b680 msgr2=0x7f4e580b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815b680 0x7f4e580b1da0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400d770 tx=0x7f4e4400dc30 comp rx=0 tx=0).stop 2024-09-10T20:40:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 shutdown_connections 2024-09-10T20:40:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4e38077fa0 0x7f4e3807a460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e5815c750 0x7f4e58159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e5815b680 0x7f4e580b1da0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 --2- 172.21.15.81:0/23918800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e580741e0 0x7f4e580b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 >> 172.21.15.81:0/23918800 conn(0x7f4e5806cb50 msgr2=0x7f4e580ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 shutdown_connections 2024-09-10T20:40:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.597+0000 7f4e5d800640 1 -- 172.21.15.81:0/23918800 wait complete. 2024-09-10T20:40:45.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T20:40:45.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 -- 172.21.15.81:0/3986087524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c15b270 msgr2=0x7faf5c06f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 --2- 172.21.15.81:0/3986087524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c15b270 0x7faf5c06f840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0d0710 tx=0x7faf5402a8b0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 -- 172.21.15.81:0/3986087524 shutdown_connections 2024-09-10T20:40:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 --2- 172.21.15.81:0/3986087524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c15b270 0x7faf5c06f840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 --2- 172.21.15.81:0/3986087524 >> v2:172.21.15.143:3300/0 conn(0x7faf5c154bb0 0x7faf5c15bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 -- 172.21.15.81:0/3986087524 >> 172.21.15.81:0/3986087524 conn(0x7faf5c06cb50 msgr2=0x7faf5c06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 -- 172.21.15.81:0/3986087524 shutdown_connections 2024-09-10T20:40:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.771+0000 7faf5be00640 1 -- 172.21.15.81:0/3986087524 wait complete. 2024-09-10T20:40:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.773+0000 7faf5be00640 1 Processor -- start 2024-09-10T20:40:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.773+0000 7faf5be00640 1 -- start start 2024-09-10T20:40:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c06f3e0 0x7faf5c14cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5be00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c154bb0 0x7faf5c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c15b270 0x7faf5c14c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5be00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0b3850 con 0x7faf5c06f3e0 2024-09-10T20:40:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0b36d0 con 0x7faf5c15b270 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5be00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0b39d0 con 0x7faf5c154bb0 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c06f3e0 0x7faf5c14cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c06f3e0 0x7faf5c14cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51186/0 (socket says 172.21.15.81:51186) 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 -- 172.21.15.81:0/1771200855 learned_addr learned my addr 172.21.15.81:0/1771200855 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 -- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c154bb0 msgr2=0x7faf5c15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c154bb0 0x7faf5c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 -- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c15b270 msgr2=0x7faf5c14c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c15b270 0x7faf5c14c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.774+0000 7faf5aa00640 1 -- 172.21.15.81:0/1771200855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c14cba0 con 0x7faf5c06f3e0 2024-09-10T20:40:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.775+0000 7faf5aa00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c06f3e0 0x7faf5c14cdd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00d950 tx=0x7faf4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.775+0000 7faf52a00640 1 -- 172.21.15.81:0/1771200855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c017070 con 0x7faf5c06f3e0 2024-09-10T20:40:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.775+0000 7faf52a00640 1 -- 172.21.15.81:0/1771200855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf4c009d20 con 0x7faf5c06f3e0 2024-09-10T20:40:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.775+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c159260 con 0x7faf5c06f3e0 2024-09-10T20:40:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.775+0000 7faf52a00640 1 -- 172.21.15.81:0/1771200855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0106c0 con 0x7faf5c06f3e0 2024-09-10T20:40:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.775+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c159aa0 con 0x7faf5c06f3e0 2024-09-10T20:40:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.776+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf5c0b2810 con 0x7faf5c06f3e0 2024-09-10T20:40:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.777+0000 7faf52a00640 1 -- 172.21.15.81:0/1771200855 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faf4c010860 con 0x7faf5c06f3e0 2024-09-10T20:40:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.778+0000 7faf52a00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf38077f70 0x7faf3807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.778+0000 7faf52a00640 1 -- 172.21.15.81:0/1771200855 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7faf4c09a590 con 0x7faf5c06f3e0 2024-09-10T20:40:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.779+0000 7faf53e00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf38077f70 0x7faf3807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.779+0000 7faf53e00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf38077f70 0x7faf3807a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf5c153400 tx=0x7faf440079f0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:45.782+0000 7faf52a00640 1 -- 172.21.15.81:0/1771200855 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faf5c0b2810 con 0x7faf5c06f3e0 2024-09-10T20:40:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.000+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faf5c0cbde0 con 0x7faf5c06f3e0 2024-09-10T20:40:46.004 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T20:40:46.001+0000 7f54aae00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T20:40:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.003+0000 7faf52a00640 1 -- 172.21.15.81:0/1771200855 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7faf5c159260 con 0x7faf5c06f3e0 2024-09-10T20:40:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf38077f70 msgr2=0x7faf3807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf38077f70 0x7faf3807a430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf5c153400 tx=0x7faf440079f0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c06f3e0 msgr2=0x7faf5c14cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c06f3e0 0x7faf5c14cdd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00d950 tx=0x7faf4c00de10 comp rx=0 tx=0).stop 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 shutdown_connections 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faf38077f70 0x7faf3807a430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c15b270 0x7faf5c14c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf5c154bb0 0x7faf5c15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 --2- 172.21.15.81:0/1771200855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf5c06f3e0 0x7faf5c14cdd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 >> 172.21.15.81:0/1771200855 conn(0x7faf5c06cb50 msgr2=0x7faf5c1551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:46.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 shutdown_connections 2024-09-10T20:40:46.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.006+0000 7faf5be00640 1 -- 172.21.15.81:0/1771200855 wait complete. 2024-09-10T20:40:46.019 INFO:tasks.ceph.mds.b.smithi143.stderr: -3807> 2024-09-10T20:39:57.791+0000 7f6102000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:40:46.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T20:40:46.072 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-09-10T20:40:46.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.183+0000 7f859fa00640 1 -- 172.21.15.81:0/3883792653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859815b4d0 msgr2=0x7f859815ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:46.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.183+0000 7f859fa00640 1 --2- 172.21.15.81:0/3883792653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859815b4d0 0x7f859815ea60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8588005fd0 tx=0x7f858802ab40 comp rx=0 tx=0).stop 2024-09-10T20:40:46.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.183+0000 7f859fa00640 1 -- 172.21.15.81:0/3883792653 shutdown_connections 2024-09-10T20:40:46.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.183+0000 7f859fa00640 1 --2- 172.21.15.81:0/3883792653 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f85980cf810 0x7f8598161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.183+0000 7f859fa00640 1 --2- 172.21.15.81:0/3883792653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859815b4d0 0x7f859815ea60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.183+0000 7f859fa00640 1 -- 172.21.15.81:0/3883792653 >> 172.21.15.81:0/3883792653 conn(0x7f859806cb50 msgr2=0x7f859806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:46.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.183+0000 7f859fa00640 1 -- 172.21.15.81:0/3883792653 shutdown_connections 2024-09-10T20:40:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.184+0000 7f859fa00640 1 -- 172.21.15.81:0/3883792653 wait complete. 2024-09-10T20:40:46.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.185+0000 7f859fa00640 1 Processor -- start 2024-09-10T20:40:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.185+0000 7f859fa00640 1 -- start start 2024-09-10T20:40:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859fa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859806eb60 0x7f85980afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859fa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85980cf810 0x7f8598147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859fa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f859815b4d0 0x7f85981f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859fa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f859806f380 con 0x7f859806eb60 2024-09-10T20:40:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859fa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f859806f200 con 0x7f85980cf810 2024-09-10T20:40:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859fa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8598148160 con 0x7f859815b4d0 2024-09-10T20:40:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859806eb60 0x7f85980afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859806eb60 0x7f85980afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51194/0 (socket says 172.21.15.81:51194) 2024-09-10T20:40:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859d000640 1 -- 172.21.15.81:0/1855265468 learned_addr learned my addr 172.21.15.81:0/1855265468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f8597e00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85980cf810 0x7f8598147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.186+0000 7f859da00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f859815b4d0 0x7f85981f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859d000640 1 -- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f859815b4d0 msgr2=0x7f85981f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859d000640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f859815b4d0 0x7f85981f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859d000640 1 -- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85980cf810 msgr2=0x7f8598147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859d000640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85980cf810 0x7f8598147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859d000640 1 -- 172.21.15.81:0/1855265468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85980b02b0 con 0x7f859806eb60 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859d000640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859806eb60 0x7f85980afbf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8588009bf0 tx=0x7f858802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f8594c00640 1 -- 172.21.15.81:0/1855265468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588044070 con 0x7f859806eb60 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f8594c00640 1 -- 172.21.15.81:0/1855265468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8588004250 con 0x7f859806eb60 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85980b0590 con 0x7f859806eb60 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f8594c00640 1 -- 172.21.15.81:0/1855265468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588004640 con 0x7f859806eb60 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.187+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85980b0b50 con 0x7f859806eb60 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.188+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85980b34f0 con 0x7f859806eb60 2024-09-10T20:40:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.189+0000 7f8594c00640 1 -- 172.21.15.81:0/1855265468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8588036400 con 0x7f859806eb60 2024-09-10T20:40:46.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.190+0000 7f8594c00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8578077f70 0x7f857807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:46.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.191+0000 7f8594c00640 1 -- 172.21.15.81:0/1855265468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7f85880ba880 con 0x7f859806eb60 2024-09-10T20:40:46.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.191+0000 7f8597e00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8578077f70 0x7f857807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:46.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.192+0000 7f8597e00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8578077f70 0x7f857807a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85981f7e50 tx=0x7f858400b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:46.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.194+0000 7f8594c00640 1 -- 172.21.15.81:0/1855265468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8588032030 con 0x7f859806eb60 2024-09-10T20:40:46.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:46.414+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f859815acf0 con 0x7f859806eb60 2024-09-10T20:40:47.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.068+0000 7f8594c00640 1 -- 172.21.15.81:0/1855265468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f8588082950 con 0x7f859806eb60 2024-09-10T20:40:47.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8578077f70 msgr2=0x7f857807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:47.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8578077f70 0x7f857807a430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85981f7e50 tx=0x7f858400b390 comp rx=0 tx=0).stop 2024-09-10T20:40:47.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859806eb60 msgr2=0x7f85980afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:47.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859806eb60 0x7f85980afbf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8588009bf0 tx=0x7f858802c8b0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 shutdown_connections 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8578077f70 0x7f857807a430 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f859815b4d0 0x7f85981f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f85980cf810 0x7f8598147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 --2- 172.21.15.81:0/1855265468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859806eb60 0x7f85980afbf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 >> 172.21.15.81:0/1855265468 conn(0x7f859806cb50 msgr2=0x7f859815bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 shutdown_connections 2024-09-10T20:40:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.071+0000 7f859fa00640 1 -- 172.21.15.81:0/1855265468 wait complete. 2024-09-10T20:40:47.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T20:40:47.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 -- 172.21.15.81:0/882391778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89006eb60 msgr2=0x7fe89006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 --2- 172.21.15.81:0/882391778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89006eb60 0x7fe89006efd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe888005fd0 tx=0x7fe88802a990 comp rx=0 tx=0).stop 2024-09-10T20:40:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 -- 172.21.15.81:0/882391778 shutdown_connections 2024-09-10T20:40:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 --2- 172.21.15.81:0/882391778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89006eb60 0x7fe89006efd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 --2- 172.21.15.81:0/882391778 >> v2:172.21.15.143:3300/0 conn(0x7fe8900cf810 0x7fe890161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 -- 172.21.15.81:0/882391778 >> 172.21.15.81:0/882391778 conn(0x7fe89006cb50 msgr2=0x7fe89006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 -- 172.21.15.81:0/882391778 shutdown_connections 2024-09-10T20:40:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.252+0000 7fe897a00640 1 -- 172.21.15.81:0/882391778 wait complete. 2024-09-10T20:40:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.254+0000 7fe897a00640 1 Processor -- start 2024-09-10T20:40:47.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.254+0000 7fe897a00640 1 -- start start 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe897a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe89006eb60 0x7fe8900c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe897a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900cf810 0x7fe8900c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe897a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe89015b4d0 0x7fe8900b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe897a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8900b2da0 con 0x7fe8900cf810 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe897a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe8900b2c20 con 0x7fe89006eb60 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe897a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe8900b2f20 con 0x7fe89015b4d0 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900cf810 0x7fe8900c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900cf810 0x7fe8900c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51218/0 (socket says 172.21.15.81:51218) 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 -- 172.21.15.81:0/2446979718 learned_addr learned my addr 172.21.15.81:0/2446979718 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe895a00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe89015b4d0 0x7fe8900b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe895000640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe89006eb60 0x7fe8900c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 -- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe89015b4d0 msgr2=0x7fe8900b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe89015b4d0 0x7fe8900b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 -- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe89006eb60 msgr2=0x7fe8900c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe89006eb60 0x7fe8900c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.255+0000 7fe88fe00640 1 -- 172.21.15.81:0/2446979718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8900c6fa0 con 0x7fe8900cf810 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.256+0000 7fe88fe00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900cf810 0x7fe8900c5a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c920 tx=0x7fe87c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.256+0000 7fe88cc00640 1 -- 172.21.15.81:0/2446979718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c007c70 con 0x7fe8900cf810 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.256+0000 7fe88cc00640 1 -- 172.21.15.81:0/2446979718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe87c00f450 con 0x7fe8900cf810 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.256+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8900c4970 con 0x7fe8900cf810 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.256+0000 7fe88cc00640 1 -- 172.21.15.81:0/2446979718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00f8a0 con 0x7fe8900cf810 2024-09-10T20:40:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.256+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8900c4f30 con 0x7fe8900cf810 2024-09-10T20:40:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.257+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8900b33d0 con 0x7fe8900cf810 2024-09-10T20:40:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.258+0000 7fe88cc00640 1 -- 172.21.15.81:0/2446979718 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe87c020030 con 0x7fe8900cf810 2024-09-10T20:40:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.259+0000 7fe88cc00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe870077f70 0x7fe87007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.259+0000 7fe88cc00640 1 -- 172.21.15.81:0/2446979718 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7fe87c09a6c0 con 0x7fe8900cf810 2024-09-10T20:40:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.260+0000 7fe895000640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe870077f70 0x7fe87007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.260+0000 7fe895000640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe870077f70 0x7fe87007a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe880000f60 tx=0x7fe880009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:47.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.263+0000 7fe88cc00640 1 -- 172.21.15.81:0/2446979718 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe87c014030 con 0x7fe8900cf810 2024-09-10T20:40:47.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:40:47.432 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:40:47.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:47.451+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8900c5f50 con 0x7fe8900cf810 2024-09-10T20:40:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.074+0000 7fe88cc00640 1 -- 172.21.15.81:0/2446979718 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fe87c062de0 con 0x7fe8900cf810 2024-09-10T20:40:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-10T20:40:48.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.076+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe870077f70 msgr2=0x7fe87007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.076+0000 7fe897a00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe870077f70 0x7fe87007a430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe880000f60 tx=0x7fe880009040 comp rx=0 tx=0).stop 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.076+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900cf810 msgr2=0x7fe8900c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.076+0000 7fe897a00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900cf810 0x7fe8900c5a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c920 tx=0x7fe87c00cde0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.076+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 shutdown_connections 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.076+0000 7fe897a00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe870077f70 0x7fe87007a430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.077+0000 7fe897a00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe89015b4d0 0x7fe8900b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.077+0000 7fe897a00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900cf810 0x7fe8900c5a10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.077+0000 7fe897a00640 1 --2- 172.21.15.81:0/2446979718 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe89006eb60 0x7fe8900c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.077+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 >> 172.21.15.81:0/2446979718 conn(0x7fe89006cb50 msgr2=0x7fe890072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.077+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 shutdown_connections 2024-09-10T20:40:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.077+0000 7fe897a00640 1 -- 172.21.15.81:0/2446979718 wait complete. 2024-09-10T20:40:48.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T20:40:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.260+0000 7fc42d000640 1 -- 172.21.15.81:0/301603506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 msgr2=0x7fc42815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.260+0000 7fc42d000640 1 --2- 172.21.15.81:0/301603506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc42815b020 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc418009860 tx=0x7fc41802a4b0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.261+0000 7fc42d000640 1 -- 172.21.15.81:0/301603506 shutdown_connections 2024-09-10T20:40:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.261+0000 7fc42d000640 1 --2- 172.21.15.81:0/301603506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc428072450 0x7fc4280b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.261+0000 7fc42d000640 1 --2- 172.21.15.81:0/301603506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc42815b020 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.261+0000 7fc42d000640 1 -- 172.21.15.81:0/301603506 >> 172.21.15.81:0/301603506 conn(0x7fc42806cb50 msgr2=0x7fc42806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.261+0000 7fc42d000640 1 -- 172.21.15.81:0/301603506 shutdown_connections 2024-09-10T20:40:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.261+0000 7fc42d000640 1 -- 172.21.15.81:0/301603506 wait complete. 2024-09-10T20:40:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.262+0000 7fc42d000640 1 Processor -- start 2024-09-10T20:40:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.262+0000 7fc42d000640 1 -- start start 2024-09-10T20:40:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.263+0000 7fc42d000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc428072450 0x7fc428154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.263+0000 7fc42d000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4280ae8c0 0x7fc4281f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.263+0000 7fc42d000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc4280ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.263+0000 7fc42d000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280af190 con 0x7fc428150ec0 2024-09-10T20:40:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.263+0000 7fc42d000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc4280af010 con 0x7fc4280ae8c0 2024-09-10T20:40:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.263+0000 7fc42d000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc42806fce0 con 0x7fc428072450 2024-09-10T20:40:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc4280ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc4280ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51246/0 (socket says 172.21.15.81:51246) 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 -- 172.21.15.81:0/3753387233 learned_addr learned my addr 172.21.15.81:0/3753387233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc41fe00640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4280ae8c0 0x7fc4281f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc425e00640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc428072450 0x7fc428154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 -- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc428072450 msgr2=0x7fc428154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc428072450 0x7fc428154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 -- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4280ae8c0 msgr2=0x7fc4281f5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4280ae8c0 0x7fc4281f5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 -- 172.21.15.81:0/3753387233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4281f5ca0 con 0x7fc428150ec0 2024-09-10T20:40:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc425e00640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc428072450 0x7fc428154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.264+0000 7fc426800640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc4280ac310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c770 tx=0x7fc42000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.265+0000 7fc41e000640 1 -- 172.21.15.81:0/3753387233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420017070 con 0x7fc428150ec0 2024-09-10T20:40:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.265+0000 7fc41e000640 1 -- 172.21.15.81:0/3753387233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc420005070 con 0x7fc428150ec0 2024-09-10T20:40:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.265+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4281f5f60 con 0x7fc428150ec0 2024-09-10T20:40:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.265+0000 7fc41e000640 1 -- 172.21.15.81:0/3753387233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4200054c0 con 0x7fc428150ec0 2024-09-10T20:40:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.265+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc428147e10 con 0x7fc428150ec0 2024-09-10T20:40:48.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.266+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc428148010 con 0x7fc428150ec0 2024-09-10T20:40:48.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.268+0000 7fc41e000640 1 -- 172.21.15.81:0/3753387233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc420005660 con 0x7fc428150ec0 2024-09-10T20:40:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.269+0000 7fc41e000640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc404077f70 0x7fc40407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.269+0000 7fc41e000640 1 -- 172.21.15.81:0/3753387233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6238+0+0 (secure 0 0 0) 0x7fc420099880 con 0x7fc428150ec0 2024-09-10T20:40:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.270+0000 7fc425e00640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc404077f70 0x7fc40407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.270+0000 7fc425e00640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc404077f70 0x7fc40407a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc418034000 tx=0x7fc418004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.273+0000 7fc41e000640 1 -- 172.21.15.81:0/3753387233 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc428148010 con 0x7fc428150ec0 2024-09-10T20:40:48.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:48.473+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc4280b2b80 con 0x7fc428150ec0 2024-09-10T20:40:49.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.080+0000 7fc41e000640 1 -- 172.21.15.81:0/3753387233 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7fc420061b00 con 0x7fc428150ec0 2024-09-10T20:40:49.084 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-10T20:40:49.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc404077f70 msgr2=0x7fc40407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc404077f70 0x7fc40407a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc418034000 tx=0x7fc418004730 comp rx=0 tx=0).stop 2024-09-10T20:40:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 msgr2=0x7fc4280ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc4280ac310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c770 tx=0x7fc42000cc30 comp rx=0 tx=0).stop 2024-09-10T20:40:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 shutdown_connections 2024-09-10T20:40:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc404077f70 0x7fc40407a430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc428150ec0 0x7fc4280ac310 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4280ae8c0 0x7fc4281f5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 --2- 172.21.15.81:0/3753387233 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc428072450 0x7fc428154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 >> 172.21.15.81:0/3753387233 conn(0x7fc42806cb50 msgr2=0x7fc428152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 shutdown_connections 2024-09-10T20:40:49.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.082+0000 7fc42d000640 1 -- 172.21.15.81:0/3753387233 wait complete. 2024-09-10T20:40:49.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-10T20:40:49.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.263+0000 7f2ee9000640 1 -- 172.21.15.81:0/2685157884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec8003a50 msgr2=0x7f2ec8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.263+0000 7f2ee9000640 1 --2- 172.21.15.81:0/2685157884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec8003a50 0x7f2ec8003e70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4009cd0 tx=0x7f2ec8005830 comp rx=0 tx=0).stop 2024-09-10T20:40:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.263+0000 7f2ee9000640 1 -- 172.21.15.81:0/2685157884 shutdown_connections 2024-09-10T20:40:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.263+0000 7f2ee9000640 1 --2- 172.21.15.81:0/2685157884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ec8003a50 0x7f2ec8003e70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.263+0000 7f2ee9000640 1 -- 172.21.15.81:0/2685157884 >> 172.21.15.81:0/2685157884 conn(0x7f2ee406cb50 msgr2=0x7f2ee406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.263+0000 7f2ee9000640 1 -- 172.21.15.81:0/2685157884 shutdown_connections 2024-09-10T20:40:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.263+0000 7f2ee9000640 1 -- 172.21.15.81:0/2685157884 wait complete. 2024-09-10T20:40:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.265+0000 7f2ee9000640 1 Processor -- start 2024-09-10T20:40:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.265+0000 7f2ee9000640 1 -- start start 2024-09-10T20:40:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee9000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ec8003a50 0x7f2ee414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee9000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee40b1d90 0x7f2ee41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee9000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4148070 0x7f2ee406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee9000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee415f650 con 0x7f2ee4148070 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee9000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee415f4d0 con 0x7f2ee40b1d90 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee9000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee415f7d0 con 0x7f2ec8003a50 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4148070 0x7f2ee406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee2800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4148070 0x7f2ee406f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51260/0 (socket says 172.21.15.81:51260) 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee2800640 1 -- 172.21.15.81:0/3758684414 learned_addr learned my addr 172.21.15.81:0/3758684414 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2ee1e00640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ec8003a50 0x7f2ee414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.266+0000 7f2edbe00640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee40b1d90 0x7f2ee41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee2800640 1 -- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ec8003a50 msgr2=0x7f2ee414f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee2800640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ec8003a50 0x7f2ee414f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee2800640 1 -- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee40b1d90 msgr2=0x7f2ee41530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee2800640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee40b1d90 0x7f2ee41530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee2800640 1 -- 172.21.15.81:0/3758684414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee41504c0 con 0x7f2ee4148070 2024-09-10T20:40:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee1e00640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ec8003a50 0x7f2ee414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee2800640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4148070 0x7f2ee406f7f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ee415fbe0 tx=0x7f2edc006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2eda000640 1 -- 172.21.15.81:0/3758684414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00fa20 con 0x7f2ee4148070 2024-09-10T20:40:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2eda000640 1 -- 172.21.15.81:0/3758684414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2edc00fbc0 con 0x7f2ee4148070 2024-09-10T20:40:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee41507a0 con 0x7f2ee4148070 2024-09-10T20:40:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2eda000640 1 -- 172.21.15.81:0/3758684414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc011430 con 0x7f2ee4148070 2024-09-10T20:40:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.267+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee41535f0 con 0x7f2ee4148070 2024-09-10T20:40:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.268+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee4073db0 con 0x7f2ee4148070 2024-09-10T20:40:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.269+0000 7f2eda000640 1 -- 172.21.15.81:0/3758684414 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2edc0115d0 con 0x7f2ee4148070 2024-09-10T20:40:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.270+0000 7f2eda000640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2ec0077fa0 0x7f2ec007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.270+0000 7f2eda000640 1 -- 172.21.15.81:0/3758684414 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7f2edc09a620 con 0x7f2ee4148070 2024-09-10T20:40:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.270+0000 7f2ee1e00640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2ec0077fa0 0x7f2ec007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.271+0000 7f2ee1e00640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2ec0077fa0 0x7f2ec007a460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4035000 tx=0x7f2ed40046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.274+0000 7f2eda000640 1 -- 172.21.15.81:0/3758684414 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2edc063020 con 0x7f2ee4148070 2024-09-10T20:40:49.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:49.461+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ee40cc490 con 0x7f2ee4148070 2024-09-10T20:40:50.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.087+0000 7f2eda000640 1 -- 172.21.15.81:0/3758684414 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f2edc062920 con 0x7f2ee4148070 2024-09-10T20:40:50.091 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.089+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2ec0077fa0 msgr2=0x7f2ec007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.089+0000 7f2ee9000640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2ec0077fa0 0x7f2ec007a460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4035000 tx=0x7f2ed40046c0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.089+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4148070 msgr2=0x7f2ee406f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.089+0000 7f2ee9000640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4148070 0x7f2ee406f7f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ee415fbe0 tx=0x7f2edc006660 comp rx=0 tx=0).stop 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 shutdown_connections 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2ec0077fa0 0x7f2ec007a460 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4148070 0x7f2ee406f7f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee40b1d90 0x7f2ee41530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 --2- 172.21.15.81:0/3758684414 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ec8003a50 0x7f2ee414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 >> 172.21.15.81:0/3758684414 conn(0x7f2ee406cb50 msgr2=0x7f2ee406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:50.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 shutdown_connections 2024-09-10T20:40:50.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.090+0000 7f2ee9000640 1 -- 172.21.15.81:0/3758684414 wait complete. 2024-09-10T20:40:50.113 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T20:40:50.113 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T20:40:50.114 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T20:40:50.114 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:50.114 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T20:40:50.114 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T20:40:50.115 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T20:40:50.115 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:50.115 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T20:40:50.115 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T20:40:50.115 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T20:40:50.115 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:50.116 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T20:40:50.116 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T20:40:50.116 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T20:40:50.116 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:40:50.129 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T20:40:50.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T20:40:50.130 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T20:40:50.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T20:40:50.131 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T20:40:50.131 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T20:40:50.134 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T20:40:50.134 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T20:40:50.173 INFO:tasks.ceph.mds.c:Started 2024-09-10T20:40:50.173 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:50.175 INFO:tasks.ceph.mds.a:Started 2024-09-10T20:40:50.176 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:50.177 INFO:tasks.ceph.mds.b:Started 2024-09-10T20:40:50.178 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:50.180 INFO:tasks.ceph.mds.d:Started 2024-09-10T20:40:50.181 DEBUG:teuthology.parallel:result is None 2024-09-10T20:40:50.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T20:40:50.302 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-10T20:40:50.302 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-10T20:40:50.309 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-09-10T20:40:50.309 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-09-10T20:40:50.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 -- 172.21.15.81:0/554004697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 msgr2=0x7fe7e815fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:50.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 --2- 172.21.15.81:0/554004697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815fcc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4005fd0 tx=0x7fe7d402a540 comp rx=0 tx=0).stop 2024-09-10T20:40:50.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 -- 172.21.15.81:0/554004697 shutdown_connections 2024-09-10T20:40:50.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 --2- 172.21.15.81:0/554004697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815fcc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 --2- 172.21.15.81:0/554004697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7e80cfbf0 0x7fe7e80cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 -- 172.21.15.81:0/554004697 >> 172.21.15.81:0/554004697 conn(0x7fe7e80d1a10 msgr2=0x7fe7e80d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:50.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 -- 172.21.15.81:0/554004697 shutdown_connections 2024-09-10T20:40:50.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.343+0000 7fe7ee600640 1 -- 172.21.15.81:0/554004697 wait complete. 2024-09-10T20:40:50.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.345+0000 7fe7ee600640 1 Processor -- start 2024-09-10T20:40:50.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.345+0000 7fe7ee600640 1 -- start start 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7ee600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7e80cfbf0 0x7fe7e81f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7ee600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7ee600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7e8160200 0x7fe7e80cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7ee600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80b06f0 con 0x7fe7e80d0510 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7ee600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80b0570 con 0x7fe7e80cfbf0 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7ee600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e80b0870 con 0x7fe7e8160200 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7e6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7e6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51322/0 (socket says 172.21.15.81:51322) 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7e6a00640 1 -- 172.21.15.81:0/2186553983 learned_addr learned my addr 172.21.15.81:0/2186553983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7e7400640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7e80cfbf0 0x7fe7e81f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.346+0000 7fe7e7e00640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7e8160200 0x7fe7e80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:50.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7e6a00640 1 -- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7e8160200 msgr2=0x7fe7e80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:50.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7e6a00640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7e8160200 0x7fe7e80cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7e6a00640 1 -- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7e80cfbf0 msgr2=0x7fe7e81f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:50.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7e6a00640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7e80cfbf0 0x7fe7e81f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:50.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7e6a00640 1 -- 172.21.15.81:0/2186553983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e815e3a0 con 0x7fe7e80d0510 2024-09-10T20:40:50.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7e7400640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7e80cfbf0 0x7fe7e81f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:40:50.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7e6a00640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815a410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006010 tx=0x7fe7d40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:50.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7df400640 1 -- 172.21.15.81:0/2186553983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d403f070 con 0x7fe7e80d0510 2024-09-10T20:40:50.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7df400640 1 -- 172.21.15.81:0/2186553983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7d40047a0 con 0x7fe7e80d0510 2024-09-10T20:40:50.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e815e680 con 0x7fe7e80d0510 2024-09-10T20:40:50.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.347+0000 7fe7df400640 1 -- 172.21.15.81:0/2186553983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4035030 con 0x7fe7e80d0510 2024-09-10T20:40:50.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.348+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e815aa50 con 0x7fe7e80d0510 2024-09-10T20:40:50.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.349+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e8160a20 con 0x7fe7e80d0510 2024-09-10T20:40:50.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.350+0000 7fe7df400640 1 -- 172.21.15.81:0/2186553983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe7d4004b90 con 0x7fe7e80d0510 2024-09-10T20:40:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.351+0000 7fe7df400640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe7c8077f70 0x7fe7c807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.351+0000 7fe7df400640 1 -- 172.21.15.81:0/2186553983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7fe7d40bac60 con 0x7fe7e80d0510 2024-09-10T20:40:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.352+0000 7fe7e7400640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe7c8077f70 0x7fe7c807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.352+0000 7fe7e7400640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe7c8077f70 0x7fe7c807a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800bfd0 tx=0x7fe7d800b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:50.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.356+0000 7fe7df400640 1 -- 172.21.15.81:0/2186553983 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe7d4083270 con 0x7fe7e80d0510 2024-09-10T20:40:50.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:50.550+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe7e806e5a0 con 0x7fe7e80d0510 2024-09-10T20:40:51.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.101+0000 7fe7df400640 1 -- 172.21.15.81:0/2186553983 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7fe7d4087ca0 con 0x7fe7e80d0510 2024-09-10T20:40:51.105 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe7c8077f70 msgr2=0x7fe7c807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe7c8077f70 0x7fe7c807a430 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800bfd0 tx=0x7fe7d800b390 comp rx=0 tx=0).stop 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 msgr2=0x7fe7e815a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815a410 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4006010 tx=0x7fe7d40038a0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 shutdown_connections 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe7c8077f70 0x7fe7c807a430 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7e8160200 0x7fe7e80cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e80d0510 0x7fe7e815a410 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 --2- 172.21.15.81:0/2186553983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7e80cfbf0 0x7fe7e81f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 >> 172.21.15.81:0/2186553983 conn(0x7fe7e80d1a10 msgr2=0x7fe7e80d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 shutdown_connections 2024-09-10T20:40:51.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.104+0000 7fe7ee600640 1 -- 172.21.15.81:0/2186553983 wait complete. 2024-09-10T20:40:51.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T20:40:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 -- 172.21.15.81:0/2231137415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 msgr2=0x7f4ec015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/2231137415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec015ba60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0005fd0 tx=0x7f4eb002a970 comp rx=0 tx=0).stop 2024-09-10T20:40:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 -- 172.21.15.81:0/2231137415 shutdown_connections 2024-09-10T20:40:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/2231137415 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ec015c750 0x7f4ec00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/2231137415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec015ba60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 -- 172.21.15.81:0/2231137415 >> 172.21.15.81:0/2231137415 conn(0x7f4ec006cb50 msgr2=0x7f4ec006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 -- 172.21.15.81:0/2231137415 shutdown_connections 2024-09-10T20:40:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.285+0000 7f4ec6a00640 1 -- 172.21.15.81:0/2231137415 wait complete. 2024-09-10T20:40:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.287+0000 7f4ec6a00640 1 Processor -- start 2024-09-10T20:40:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.287+0000 7f4ec6a00640 1 -- start start 2024-09-10T20:40:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ec6a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ec00741e0 0x7f4ec01e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ec6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec0157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ec6a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ec015c750 0x7f4ec0147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ec6a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00b29e0 con 0x7f4ec015b680 2024-09-10T20:40:51.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ec6a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00b2860 con 0x7f4ec015c750 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ec6a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec00b2b60 con 0x7f4ec00741e0 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec0157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec0157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51342/0 (socket says 172.21.15.81:51342) 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ebf400640 1 -- 172.21.15.81:0/4047942174 learned_addr learned my addr 172.21.15.81:0/4047942174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.288+0000 7f4ebfe00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ec00741e0 0x7f4ec01e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ec4a00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ec015c750 0x7f4ec0147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ebf400640 1 -- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ec00741e0 msgr2=0x7f4ec01e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ebf400640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ec00741e0 0x7f4ec01e5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ebf400640 1 -- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ec015c750 msgr2=0x7f4ec0147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ebf400640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ec015c750 0x7f4ec0147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ebf400640 1 -- 172.21.15.81:0/4047942174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec0158500 con 0x7f4ec015b680 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ebf400640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec0157b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00c430 tx=0x7f4eac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4eb7e00640 1 -- 172.21.15.81:0/4047942174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac011790 con 0x7f4ec015b680 2024-09-10T20:40:51.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4eb7e00640 1 -- 172.21.15.81:0/4047942174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4eac017070 con 0x7f4ec015b680 2024-09-10T20:40:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4eb7e00640 1 -- 172.21.15.81:0/4047942174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac011d00 con 0x7f4ec015b680 2024-09-10T20:40:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.289+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec01587e0 con 0x7f4ec015b680 2024-09-10T20:40:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.290+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec0159110 con 0x7f4ec015b680 2024-09-10T20:40:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.291+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec0159310 con 0x7f4ec015b680 2024-09-10T20:40:51.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.292+0000 7f4eb7e00640 1 -- 172.21.15.81:0/4047942174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4eac01c460 con 0x7f4ec015b680 2024-09-10T20:40:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.293+0000 7f4eb7e00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4ea0077f70 0x7f4ea007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.293+0000 7f4eb7e00640 1 -- 172.21.15.81:0/4047942174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f4eac0998e0 con 0x7f4ec015b680 2024-09-10T20:40:51.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.293+0000 7f4ebfe00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4ea0077f70 0x7f4ea007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.294+0000 7f4ebfe00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4ea0077f70 0x7f4ea007a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0035000 tx=0x7f4eb003c040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.298+0000 7f4eb7e00640 1 -- 172.21.15.81:0/4047942174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ec0159310 con 0x7f4ec015b680 2024-09-10T20:40:51.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.547+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4ec00b3010 con 0x7f4ec015b680 2024-09-10T20:40:51.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.548+0000 7f4eb7e00640 1 -- 172.21.15.81:0/4047942174 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f4eac061f40 con 0x7f4ec015b680 2024-09-10T20:40:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:51.552 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:40:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-10T20:40:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBaruBmecf/FBAAMrD8A2X25S1eXq18yJMTEw==", 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBaruBmMSmtKBAAyBCKaAIBElCh9m3c7xEzRw==", 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.553 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBaruBmIszLHhAAYUpveadz31/xr9LlC8m4Dg==", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-10T20:40:51.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBaruBmuMOlMhAAI4id4JiEdEkMM8ru8Y+LMw==", 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBeruBmjAOTCRAASWWLcPVmoZ0CTsvTypZTkA==", 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBhruBmmzeVExAAxXYH/KR0JP2R1zrJZFkUOw==", 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.556 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBkruBm2KtzHRAAwQERCDHC7zBBWSetonaxLQ==", 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBnruBmB3j3JhAA6SC6h/7dUHzwkH7kk+7ggg==", 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBtruBmoOP1JxAA+NGeZT+0U3CwTaMASAVcyg==", 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.558 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBwruBmgMcwMRAASULYtlLnFip6t9rVKRjLtA==", 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.559 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBzruBmMzePOxAAn22iwmc4edm37BhcAjL2Kw==", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3ruBm05KZChAARGHrKTyfDmeVtMMHeNXiig==", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-10T20:40:51.560 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBaruBmaPwoOxAAjHBOYp6lxVxDK5yph+ot9w==", 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.561 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBbruBm7w2JDBAA15G17VNnMhJREIHjAU5+xA==", 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBbruBmNmsMBhAAF6cuus1v1m18Hhxu1ktIUw==", 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.562 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBbruBmi0cFExAAXDgVwl69GCoc6mNj5zJV2g==", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-10T20:40:51.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBZruBm4MNEIBAAew5LKBKofhcz5bOgFU1r9g==", 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2024-09-10T20:40:51.564 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+ruBmvKGrIhAAOs+PP/NuCWa593heCjCsaw==", 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+ruBm8bKrIhAAzZ2b07i4ohxuCH364VS5eA==", 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+ruBmXcOrIhAAlbxXTXwUp5G8RkzPgVh8Dg==", 2024-09-10T20:40:51.565 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+ruBm1NKrIhAAN4vIrp7Iyh32/4pk7waaiQ==", 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+ruBmMuOrIhAAusg4obWscoqShll7fstx4Q==", 2024-09-10T20:40:51.566 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+ruBmEvOrIhAAVnOtSrgj1z69HlD3gNYzlg==", 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBaruBm6NVsDhAAi4P8yxI/EcbEoSE9W4Y7Sg==", 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.567 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBaruBmc8h3BhAA+jaHDToU+zkNV8JLEbWVHw==", 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:51.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T20:40:51.569 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.550+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4ea0077f70 msgr2=0x7f4ea007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.550+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4ea0077f70 0x7f4ea007a430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0035000 tx=0x7f4eb003c040 comp rx=0 tx=0).stop 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.550+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 msgr2=0x7f4ec0157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec0157b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00c430 tx=0x7f4eac00c8f0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 shutdown_connections 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4ea0077f70 0x7f4ea007a430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ec015c750 0x7f4ec0147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ec015b680 0x7f4ec0157b20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 --2- 172.21.15.81:0/4047942174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ec00741e0 0x7f4ec01e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 >> 172.21.15.81:0/4047942174 conn(0x7f4ec006cb50 msgr2=0x7f4ec015dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 shutdown_connections 2024-09-10T20:40:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.551+0000 7f4ec6a00640 1 -- 172.21.15.81:0/4047942174 wait complete. 2024-09-10T20:40:51.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 -- 172.21.15.81:0/2461506758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f899015c750 msgr2=0x7f89900cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 --2- 172.21.15.81:0/2461506758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f899015c750 0x7f89900cf780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8990070960 tx=0x7f898802aa30 comp rx=0 tx=0).stop 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 -- 172.21.15.81:0/2461506758 shutdown_connections 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 --2- 172.21.15.81:0/2461506758 >> v2:172.21.15.143:3300/0 conn(0x7f89900741e0 0x7f899015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 --2- 172.21.15.81:0/2461506758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f899015c750 0x7f89900cf780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 --2- 172.21.15.81:0/2461506758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f899015b680 0x7f899015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 -- 172.21.15.81:0/2461506758 >> 172.21.15.81:0/2461506758 conn(0x7f899006cb50 msgr2=0x7f899006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 -- 172.21.15.81:0/2461506758 shutdown_connections 2024-09-10T20:40:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.724+0000 7f8997600640 1 -- 172.21.15.81:0/2461506758 wait complete. 2024-09-10T20:40:51.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.726+0000 7f8997600640 1 Processor -- start 2024-09-10T20:40:51.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.726+0000 7f8997600640 1 -- start start 2024-09-10T20:40:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8997600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900741e0 0x7f89900b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8997600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f899015b680 0x7f899014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8997600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f899015c750 0x7f89900b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8997600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89900d00d0 con 0x7f89900741e0 2024-09-10T20:40:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8997600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f89900cff50 con 0x7f899015c750 2024-09-10T20:40:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8997600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f89900b2860 con 0x7f899015b680 2024-09-10T20:40:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8994c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900741e0 0x7f89900b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8994c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900741e0 0x7f89900b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51362/0 (socket says 172.21.15.81:51362) 2024-09-10T20:40:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8994c00640 1 -- 172.21.15.81:0/1352403284 learned_addr learned my addr 172.21.15.81:0/1352403284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f8995600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f899015c750 0x7f89900b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.727+0000 7f898fe00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f899015b680 0x7f899014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8994c00640 1 -- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f899015b680 msgr2=0x7f899014bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8994c00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f899015b680 0x7f899014bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8994c00640 1 -- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f899015c750 msgr2=0x7f89900b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8994c00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f899015c750 0x7f89900b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8994c00640 1 -- 172.21.15.81:0/1352403284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899006e470 con 0x7f89900741e0 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f898fe00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f899015b680 0x7f899014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8995600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f899015c750 0x7f89900b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8994c00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900741e0 0x7f89900b20b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f898000d950 tx=0x7f898000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:51.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f898cc00640 1 -- 172.21.15.81:0/1352403284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980017070 con 0x7f89900741e0 2024-09-10T20:40:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f898cc00640 1 -- 172.21.15.81:0/1352403284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8980009cc0 con 0x7f89900741e0 2024-09-10T20:40:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8990070360 con 0x7f89900741e0 2024-09-10T20:40:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f898cc00640 1 -- 172.21.15.81:0/1352403284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89800106c0 con 0x7f89900741e0 2024-09-10T20:40:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.728+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899006e9f0 con 0x7f89900741e0 2024-09-10T20:40:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.730+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899015ba60 con 0x7f89900741e0 2024-09-10T20:40:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.731+0000 7f898cc00640 1 -- 172.21.15.81:0/1352403284 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8980010860 con 0x7f89900741e0 2024-09-10T20:40:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.732+0000 7f898cc00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8970077fa0 0x7f897007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.732+0000 7f898cc00640 1 -- 172.21.15.81:0/1352403284 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f8980099e50 con 0x7f89900741e0 2024-09-10T20:40:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.733+0000 7f898fe00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8970077fa0 0x7f897007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:51.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.733+0000 7f898fe00640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8970077fa0 0x7f897007a460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f899015f3c0 tx=0x7f897c005d50 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:51.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.737+0000 7f898cc00640 1 -- 172.21.15.81:0/1352403284 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8980062ba0 con 0x7f89900741e0 2024-09-10T20:40:51.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.988+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f8990075d40 con 0x7f89900741e0 2024-09-10T20:40:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.991+0000 7f898cc00640 1 -- 172.21.15.81:0/1352403284 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f89800624a0 con 0x7f89900741e0 2024-09-10T20:40:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8970077fa0 msgr2=0x7f897007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8970077fa0 0x7f897007a460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f899015f3c0 tx=0x7f897c005d50 comp rx=0 tx=0).stop 2024-09-10T20:40:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900741e0 msgr2=0x7f89900b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900741e0 0x7f89900b20b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f898000d950 tx=0x7f898000de10 comp rx=0 tx=0).stop 2024-09-10T20:40:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 shutdown_connections 2024-09-10T20:40:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8970077fa0 0x7f897007a460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f899015c750 0x7f89900b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f899015b680 0x7f899014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 --2- 172.21.15.81:0/1352403284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89900741e0 0x7f89900b20b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:51.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 >> 172.21.15.81:0/1352403284 conn(0x7f899006cb50 msgr2=0x7f899015da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:51.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 shutdown_connections 2024-09-10T20:40:51.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:51.993+0000 7f8997600640 1 -- 172.21.15.81:0/1352403284 wait complete. 2024-09-10T20:40:52.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T20:40:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.169+0000 7ff770a00640 1 -- 172.21.15.81:0/2412613020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff750003a30 msgr2=0x7ff750003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.169+0000 7ff770a00640 1 --2- 172.21.15.81:0/2412613020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff750003a30 0x7ff750003e50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00c310 tx=0x7ff750005830 comp rx=0 tx=0).stop 2024-09-10T20:40:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.169+0000 7ff76a800640 1 -- 172.21.15.81:0/2412613020 reap_dead start 2024-09-10T20:40:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.169+0000 7ff770a00640 1 -- 172.21.15.81:0/2412613020 shutdown_connections 2024-09-10T20:40:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.169+0000 7ff770a00640 1 -- 172.21.15.81:0/2412613020 >> 172.21.15.81:0/2412613020 conn(0x7ff76c0d0930 msgr2=0x7ff76c0d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.169+0000 7ff770a00640 1 -- 172.21.15.81:0/2412613020 shutdown_connections 2024-09-10T20:40:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.169+0000 7ff770a00640 1 -- 172.21.15.81:0/2412613020 wait complete. 2024-09-10T20:40:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.170+0000 7ff770a00640 1 Processor -- start 2024-09-10T20:40:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.171+0000 7ff770a00640 1 -- start start 2024-09-10T20:40:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.171+0000 7ff770a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff750003a30 0x7ff76c14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.171+0000 7ff770a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76c14ea80 0x7ff76c1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.171+0000 7ff770a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff76c1f5dc0 0x7ff76c13f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.171+0000 7ff770a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c15ef20 con 0x7ff76c14ea80 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.171+0000 7ff770a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c15eda0 con 0x7ff750003a30 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.171+0000 7ff770a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c15f0a0 con 0x7ff76c1f5dc0 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76c14ea80 0x7ff76c1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76c14ea80 0x7ff76c1f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51374/0 (socket says 172.21.15.81:51374) 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 -- 172.21.15.81:0/2238142210 learned_addr learned my addr 172.21.15.81:0/2238142210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff76a800640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff76c1f5dc0 0x7ff76c13f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769e00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff750003a30 0x7ff76c14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 -- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff76c1f5dc0 msgr2=0x7ff76c13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff76c1f5dc0 0x7ff76c13f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 -- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff750003a30 msgr2=0x7ff76c14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff750003a30 0x7ff76c14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 -- 172.21.15.81:0/2238142210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c14eec0 con 0x7ff76c14ea80 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769e00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff750003a30 0x7ff76c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff769400640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76c14ea80 0x7ff76c1f5880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff758004e20 tx=0x7ff758001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.172+0000 7ff762000640 1 -- 172.21.15.81:0/2238142210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758015020 con 0x7ff76c14ea80 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.173+0000 7ff762000640 1 -- 172.21.15.81:0/2238142210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff758011960 con 0x7ff76c14ea80 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.173+0000 7ff762000640 1 -- 172.21.15.81:0/2238142210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758011d70 con 0x7ff76c14ea80 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.173+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c14d9e0 con 0x7ff76c14ea80 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.173+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c14dfa0 con 0x7ff76c14ea80 2024-09-10T20:40:52.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.174+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c0afd20 con 0x7ff76c14ea80 2024-09-10T20:40:52.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.175+0000 7ff762000640 1 -- 172.21.15.81:0/2238142210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff75801a400 con 0x7ff76c14ea80 2024-09-10T20:40:52.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.176+0000 7ff762000640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff74c077fa0 0x7ff74c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.176+0000 7ff762000640 1 -- 172.21.15.81:0/2238142210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7ff75809a880 con 0x7ff76c14ea80 2024-09-10T20:40:52.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.176+0000 7ff769e00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff74c077fa0 0x7ff74c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.177+0000 7ff769e00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff74c077fa0 0x7ff74c07a460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff75c033000 tx=0x7ff75c0019f0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.180+0000 7ff762000640 1 -- 172.21.15.81:0/2238142210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff75801f020 con 0x7ff76c14ea80 2024-09-10T20:40:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.429+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7ff76c1f61a0 con 0x7ff76c14ea80 2024-09-10T20:40:52.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.431+0000 7ff762000640 1 -- 172.21.15.81:0/2238142210 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7ff7580634a0 con 0x7ff76c14ea80 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff74c077fa0 msgr2=0x7ff74c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff74c077fa0 0x7ff74c07a460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff75c033000 tx=0x7ff75c0019f0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76c14ea80 msgr2=0x7ff76c1f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76c14ea80 0x7ff76c1f5880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff758004e20 tx=0x7ff758001630 comp rx=0 tx=0).stop 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 shutdown_connections 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff74c077fa0 0x7ff74c07a460 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff75c033000 tx=0x7ff75c0019f0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff76c1f5dc0 0x7ff76c13f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76c14ea80 0x7ff76c1f5880 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 --2- 172.21.15.81:0/2238142210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff750003a30 0x7ff76c14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 >> 172.21.15.81:0/2238142210 conn(0x7ff76c0d0930 msgr2=0x7ff76c0b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 shutdown_connections 2024-09-10T20:40:52.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.434+0000 7ff770a00640 1 -- 172.21.15.81:0/2238142210 wait complete. 2024-09-10T20:40:52.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T20:40:52.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 -- 172.21.15.81:0/2014001668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015c750 msgr2=0x7f68d00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 --2- 172.21.15.81:0/2014001668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015c750 0x7f68d00cf780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f68d0070960 tx=0x7f68c802aa30 comp rx=0 tx=0).stop 2024-09-10T20:40:52.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 -- 172.21.15.81:0/2014001668 shutdown_connections 2024-09-10T20:40:52.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 --2- 172.21.15.81:0/2014001668 >> v2:172.21.15.143:3300/0 conn(0x7f68d00741e0 0x7f68d015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 --2- 172.21.15.81:0/2014001668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015c750 0x7f68d00cf780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 --2- 172.21.15.81:0/2014001668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d015b680 0x7f68d015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 -- 172.21.15.81:0/2014001668 >> 172.21.15.81:0/2014001668 conn(0x7f68d006cb50 msgr2=0x7f68d006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:52.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 -- 172.21.15.81:0/2014001668 shutdown_connections 2024-09-10T20:40:52.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.608+0000 7f68d4a00640 1 -- 172.21.15.81:0/2014001668 wait complete. 2024-09-10T20:40:52.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.610+0000 7f68d4a00640 1 Processor -- start 2024-09-10T20:40:52.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.610+0000 7f68d4a00640 1 -- start start 2024-09-10T20:40:52.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.610+0000 7f68d4a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d00741e0 0x7f68d0144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.610+0000 7f68d4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015b680 0x7f68d0151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68d4a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d015c750 0x7f68d01f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68d4a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68d00d00d0 con 0x7f68d015b680 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68d4a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f68d00cff50 con 0x7f68d015c750 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68d4a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f68d00b2860 con 0x7f68d00741e0 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015b680 0x7f68d0151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015b680 0x7f68d0151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51396/0 (socket says 172.21.15.81:51396) 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 -- 172.21.15.81:0/3733027388 learned_addr learned my addr 172.21.15.81:0/3733027388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68cde00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d00741e0 0x7f68d0144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68ce800640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d015c750 0x7f68d01f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 -- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d00741e0 msgr2=0x7f68d0144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d00741e0 0x7f68d0144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 -- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d015c750 msgr2=0x7f68d01f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d015c750 0x7f68d01f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68c7e00640 1 -- 172.21.15.81:0/3733027388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d014ebe0 con 0x7f68d015b680 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.611+0000 7f68ce800640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d015c750 0x7f68d01f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.612+0000 7f68c7e00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015b680 0x7f68d0151920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68b800d7a0 tx=0x7f68b800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.612+0000 7f68c6000640 1 -- 172.21.15.81:0/3733027388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8017070 con 0x7f68d015b680 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.612+0000 7f68c6000640 1 -- 172.21.15.81:0/3733027388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68b8009d20 con 0x7f68d015b680 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.612+0000 7f68c6000640 1 -- 172.21.15.81:0/3733027388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b80106c0 con 0x7f68d015b680 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.612+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d01553b0 con 0x7f68d015b680 2024-09-10T20:40:52.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.612+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d01f5ad0 con 0x7f68d015b680 2024-09-10T20:40:52.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.613+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d00cc260 con 0x7f68d015b680 2024-09-10T20:40:52.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.614+0000 7f68c6000640 1 -- 172.21.15.81:0/3733027388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f68b8010860 con 0x7f68d015b680 2024-09-10T20:40:52.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.615+0000 7f68c6000640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f68ac077f70 0x7f68ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:52.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.615+0000 7f68c6000640 1 -- 172.21.15.81:0/3733027388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f68b8099f80 con 0x7f68d015b680 2024-09-10T20:40:52.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.615+0000 7f68cde00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f68ac077f70 0x7f68ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:52.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.616+0000 7f68cde00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f68ac077f70 0x7f68ac07a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68c0005fd0 tx=0x7f68c000b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:52.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.619+0000 7f68c6000640 1 -- 172.21.15.81:0/3733027388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f68d00cc260 con 0x7f68d015b680 2024-09-10T20:40:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.870+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f68d015ba60 con 0x7f68d015b680 2024-09-10T20:40:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.873+0000 7f68c6000640 1 -- 172.21.15.81:0/3733027388 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f68b80625e0 con 0x7f68d015b680 2024-09-10T20:40:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f68ac077f70 msgr2=0x7f68ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f68ac077f70 0x7f68ac07a430 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68c0005fd0 tx=0x7f68c000b390 comp rx=0 tx=0).stop 2024-09-10T20:40:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015b680 msgr2=0x7f68d0151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015b680 0x7f68d0151920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68b800d7a0 tx=0x7f68b800dc60 comp rx=0 tx=0).stop 2024-09-10T20:40:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 shutdown_connections 2024-09-10T20:40:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f68ac077f70 0x7f68ac07a430 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68d015c750 0x7f68d01f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d015b680 0x7f68d0151920 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 --2- 172.21.15.81:0/3733027388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f68d00741e0 0x7f68d0144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 >> 172.21.15.81:0/3733027388 conn(0x7f68d006cb50 msgr2=0x7f68d015d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 shutdown_connections 2024-09-10T20:40:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:52.875+0000 7f68d4a00640 1 -- 172.21.15.81:0/3733027388 wait complete. 2024-09-10T20:40:52.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T20:40:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.049+0000 7fab04200640 1 -- 172.21.15.81:0/815802751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 msgr2=0x7faae4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.049+0000 7fab04200640 1 --2- 172.21.15.81:0/815802751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faae4003e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009b20 tx=0x7faae4005830 comp rx=0 tx=0).stop 2024-09-10T20:40:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.049+0000 7fab04200640 1 -- 172.21.15.81:0/815802751 shutdown_connections 2024-09-10T20:40:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.049+0000 7fab04200640 1 --2- 172.21.15.81:0/815802751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faae4003e70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.049+0000 7fab04200640 1 -- 172.21.15.81:0/815802751 >> 172.21.15.81:0/815802751 conn(0x7faafc06cb50 msgr2=0x7faafc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.049+0000 7fab04200640 1 -- 172.21.15.81:0/815802751 shutdown_connections 2024-09-10T20:40:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.050+0000 7fab04200640 1 -- 172.21.15.81:0/815802751 wait complete. 2024-09-10T20:40:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.051+0000 7fab04200640 1 Processor -- start 2024-09-10T20:40:53.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.051+0000 7fab04200640 1 -- start start 2024-09-10T20:40:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab04200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faafc0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab04200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faafc06ef20 0x7faafc06f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab04200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc1f4dd0 0x7faafc15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab04200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faafc15f650 con 0x7faae4003a50 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab04200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faafc15f4d0 con 0x7faafc1f4dd0 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab04200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faafc15f7d0 con 0x7faafc06ef20 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab01800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faafc0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab01800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faafc0aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51410/0 (socket says 172.21.15.81:51410) 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab01800640 1 -- 172.21.15.81:0/1842505109 learned_addr learned my addr 172.21.15.81:0/1842505109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.052+0000 7fab00e00640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faafc06ef20 0x7faafc06f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab02200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc1f4dd0 0x7faafc15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab01800640 1 -- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faafc06ef20 msgr2=0x7faafc06f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab01800640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faafc06ef20 0x7faafc06f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab01800640 1 -- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc1f4dd0 msgr2=0x7faafc15a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab01800640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc1f4dd0 0x7faafc15a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab01800640 1 -- 172.21.15.81:0/1842505109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc06e5c0 con 0x7faae4003a50 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab02200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc1f4dd0 0x7faafc15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab00e00640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faafc06ef20 0x7faafc06f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab01800640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faafc0aeb40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009a70 tx=0x7faaf0033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7faaf9600640 1 -- 172.21.15.81:0/1842505109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0038040 con 0x7faae4003a50 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7faaf9600640 1 -- 172.21.15.81:0/1842505109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faaf0041070 con 0x7faae4003a50 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc0adaa0 con 0x7faae4003a50 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7faaf9600640 1 -- 172.21.15.81:0/1842505109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0033df0 con 0x7faae4003a50 2024-09-10T20:40:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.053+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc0ae060 con 0x7faae4003a50 2024-09-10T20:40:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.054+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc0cf7d0 con 0x7faae4003a50 2024-09-10T20:40:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.055+0000 7faaf9600640 1 -- 172.21.15.81:0/1842505109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7faaf003b070 con 0x7faae4003a50 2024-09-10T20:40:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.056+0000 7faaf9600640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faadc077fa0 0x7faadc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.057+0000 7faaf9600640 1 -- 172.21.15.81:0/1842505109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7faaf00ba160 con 0x7faae4003a50 2024-09-10T20:40:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.057+0000 7fab00e00640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faadc077fa0 0x7faadc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.058+0000 7fab00e00640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faadc077fa0 0x7faadc07a460 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faafc1574a0 tx=0x7faae8006b40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.060+0000 7faaf9600640 1 -- 172.21.15.81:0/1842505109 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7faaf0082d80 con 0x7faae4003a50 2024-09-10T20:40:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.310+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7faafc0cc490 con 0x7faae4003a50 2024-09-10T20:40:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.313+0000 7faaf9600640 1 -- 172.21.15.81:0/1842505109 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7faaf0082680 con 0x7faae4003a50 2024-09-10T20:40:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faadc077fa0 msgr2=0x7faadc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faadc077fa0 0x7faadc07a460 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faafc1574a0 tx=0x7faae8006b40 comp rx=0 tx=0).stop 2024-09-10T20:40:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 msgr2=0x7faafc0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faafc0aeb40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009a70 tx=0x7faaf0033670 comp rx=0 tx=0).stop 2024-09-10T20:40:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 shutdown_connections 2024-09-10T20:40:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7faadc077fa0 0x7faadc07a460 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faafc1f4dd0 0x7faafc15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faafc06ef20 0x7faafc06f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 --2- 172.21.15.81:0/1842505109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae4003a50 0x7faafc0aeb40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 >> 172.21.15.81:0/1842505109 conn(0x7faafc06cb50 msgr2=0x7faafc06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 shutdown_connections 2024-09-10T20:40:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.315+0000 7fab04200640 1 -- 172.21.15.81:0/1842505109 wait complete. 2024-09-10T20:40:53.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T20:40:53.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 -- 172.21.15.81:0/3617842542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 msgr2=0x7fb43c0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 --2- 172.21.15.81:0/3617842542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c0ae490 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb434005fd0 tx=0x7fb43402a980 comp rx=0 tx=0).stop 2024-09-10T20:40:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 -- 172.21.15.81:0/3617842542 shutdown_connections 2024-09-10T20:40:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 --2- 172.21.15.81:0/3617842542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c0ae490 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 --2- 172.21.15.81:0/3617842542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c074280 0x7fb43c0730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 -- 172.21.15.81:0/3617842542 >> 172.21.15.81:0/3617842542 conn(0x7fb43c0b1480 msgr2=0x7fb43c0b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 -- 172.21.15.81:0/3617842542 shutdown_connections 2024-09-10T20:40:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.489+0000 7fb441000640 1 -- 172.21.15.81:0/3617842542 wait complete. 2024-09-10T20:40:53.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.491+0000 7fb441000640 1 Processor -- start 2024-09-10T20:40:53.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.491+0000 7fb441000640 1 -- start start 2024-09-10T20:40:53.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb441000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c074280 0x7fb43c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb441000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c155df0 0x7fb43c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb441000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb441000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0cbed0 con 0x7fb43c15c6c0 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb441000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0cbd50 con 0x7fb43c074280 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb441000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c0ae9d0 con 0x7fb43c155df0 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb43be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb43be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51430/0 (socket says 172.21.15.81:51430) 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb43be00640 1 -- 172.21.15.81:0/3288966062 learned_addr learned my addr 172.21.15.81:0/3288966062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.492+0000 7fb43b400640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c074280 0x7fb43c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb432a00640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c155df0 0x7fb43c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb43be00640 1 -- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c155df0 msgr2=0x7fb43c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb43be00640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c155df0 0x7fb43c157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb43be00640 1 -- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c074280 msgr2=0x7fb43c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb43be00640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c074280 0x7fb43c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb43be00640 1 -- 172.21.15.81:0/3288966062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c156980 con 0x7fb43c15c6c0 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb43be00640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c156270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb434006010 tx=0x7fb434003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb433e00640 1 -- 172.21.15.81:0/3288966062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434034040 con 0x7fb43c15c6c0 2024-09-10T20:40:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb433e00640 1 -- 172.21.15.81:0/3288966062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb434004640 con 0x7fb43c15c6c0 2024-09-10T20:40:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb433e00640 1 -- 172.21.15.81:0/3288966062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434045480 con 0x7fb43c15c6c0 2024-09-10T20:40:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.493+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c156c60 con 0x7fb43c15c6c0 2024-09-10T20:40:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.494+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c157220 con 0x7fb43c15c6c0 2024-09-10T20:40:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.495+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c0aeee0 con 0x7fb43c15c6c0 2024-09-10T20:40:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.496+0000 7fb433e00640 1 -- 172.21.15.81:0/3288966062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb434045620 con 0x7fb43c15c6c0 2024-09-10T20:40:53.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.496+0000 7fb433e00640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb418077f70 0x7fb41807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.497+0000 7fb433e00640 1 -- 172.21.15.81:0/3288966062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fb4340bb6a0 con 0x7fb43c15c6c0 2024-09-10T20:40:53.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.497+0000 7fb43b400640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb418077f70 0x7fb41807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.498+0000 7fb43b400640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb418077f70 0x7fb41807a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0017f0 tx=0x7fb42c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.501+0000 7fb433e00640 1 -- 172.21.15.81:0/3288966062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb4340842f0 con 0x7fb43c15c6c0 2024-09-10T20:40:53.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.747+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fb43c0704a0 con 0x7fb43c15c6c0 2024-09-10T20:40:53.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.750+0000 7fb433e00640 1 -- 172.21.15.81:0/3288966062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7fb434083bf0 con 0x7fb43c15c6c0 2024-09-10T20:40:53.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.752+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb418077f70 msgr2=0x7fb41807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.752+0000 7fb441000640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb418077f70 0x7fb41807a430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0017f0 tx=0x7fb42c009040 comp rx=0 tx=0).stop 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.752+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 msgr2=0x7fb43c156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.752+0000 7fb441000640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c156270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb434006010 tx=0x7fb434003f10 comp rx=0 tx=0).stop 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 shutdown_connections 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb418077f70 0x7fb41807a430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c15c6c0 0x7fb43c156270 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb43c155df0 0x7fb43c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 --2- 172.21.15.81:0/3288966062 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb43c074280 0x7fb43c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 >> 172.21.15.81:0/3288966062 conn(0x7fb43c0b1480 msgr2=0x7fb43c1ea690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 shutdown_connections 2024-09-10T20:40:53.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.753+0000 7fb441000640 1 -- 172.21.15.81:0/3288966062 wait complete. 2024-09-10T20:40:53.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 -- 172.21.15.81:0/2002488335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 msgr2=0x7f2c1415f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 --2- 172.21.15.81:0/2002488335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c1415f4d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c14070770 tx=0x7f2c0002a560 comp rx=0 tx=0).stop 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 -- 172.21.15.81:0/2002488335 shutdown_connections 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 --2- 172.21.15.81:0/2002488335 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1415c750 0x7f2c140cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 --2- 172.21.15.81:0/2002488335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c1415f4d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 --2- 172.21.15.81:0/2002488335 >> v2:172.21.15.143:3300/0 conn(0x7f2c1415b680 0x7f2c1415ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 -- 172.21.15.81:0/2002488335 >> 172.21.15.81:0/2002488335 conn(0x7f2c1406cb50 msgr2=0x7f2c1406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 -- 172.21.15.81:0/2002488335 shutdown_connections 2024-09-10T20:40:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.927+0000 7f2c1a400640 1 -- 172.21.15.81:0/2002488335 wait complete. 2024-09-10T20:40:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.929+0000 7f2c1a400640 1 Processor -- start 2024-09-10T20:40:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.929+0000 7f2c1a400640 1 -- start start 2024-09-10T20:40:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c1a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c140b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c1a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1415b680 0x7f2c14147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c1a400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1415c750 0x7f2c140b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c1a400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140d00d0 con 0x7f2c140741e0 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c1a400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140cff50 con 0x7f2c1415c750 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c1a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140b2860 con 0x7f2c1415b680 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c13400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c140b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c13400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c140b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51442/0 (socket says 172.21.15.81:51442) 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c13400640 1 -- 172.21.15.81:0/4254156788 learned_addr learned my addr 172.21.15.81:0/4254156788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c12a00640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1415b680 0x7f2c14147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.930+0000 7f2c13e00640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1415c750 0x7f2c140b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c13400640 1 -- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1415b680 msgr2=0x7f2c14147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c13400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1415b680 0x7f2c14147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c13400640 1 -- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1415c750 msgr2=0x7f2c140b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c13400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1415c750 0x7f2c140b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c13400640 1 -- 172.21.15.81:0/4254156788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c141478d0 con 0x7f2c140741e0 2024-09-10T20:40:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c13400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c140b1e20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400ead0 tx=0x7f2c0400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c0b400640 1 -- 172.21.15.81:0/4254156788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400cde0 con 0x7f2c140741e0 2024-09-10T20:40:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c0b400640 1 -- 172.21.15.81:0/4254156788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c04011470 con 0x7f2c140741e0 2024-09-10T20:40:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c0b400640 1 -- 172.21.15.81:0/4254156788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c040118a0 con 0x7f2c140741e0 2024-09-10T20:40:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c140b0d80 con 0x7f2c140741e0 2024-09-10T20:40:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.931+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c140b1340 con 0x7f2c140741e0 2024-09-10T20:40:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.932+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1415ba60 con 0x7f2c140741e0 2024-09-10T20:40:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.934+0000 7f2c0b400640 1 -- 172.21.15.81:0/4254156788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2c0400f040 con 0x7f2c140741e0 2024-09-10T20:40:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.934+0000 7f2c0b400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bf4077f70 0x7f2bf407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:53.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.935+0000 7f2c0b400640 1 -- 172.21.15.81:0/4254156788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f2c0409a3e0 con 0x7f2c140741e0 2024-09-10T20:40:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.935+0000 7f2c12a00640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bf4077f70 0x7f2bf407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.936+0000 7f2c12a00640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bf4077f70 0x7f2bf407a430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2c00033000 tx=0x7f2c00004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:53.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:53.938+0000 7f2c0b400640 1 -- 172.21.15.81:0/4254156788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2c04016030 con 0x7f2c140741e0 2024-09-10T20:40:54.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.191+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f2c140b1a40 con 0x7f2c140741e0 2024-09-10T20:40:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.194+0000 7f2c0b400640 1 -- 172.21.15.81:0/4254156788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f2c040629b0 con 0x7f2c140741e0 2024-09-10T20:40:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bf4077f70 msgr2=0x7f2bf407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bf4077f70 0x7f2bf407a430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2c00033000 tx=0x7f2c00004730 comp rx=0 tx=0).stop 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 msgr2=0x7f2c140b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c140b1e20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400ead0 tx=0x7f2c0400ef90 comp rx=0 tx=0).stop 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 shutdown_connections 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2bf4077f70 0x7f2bf407a430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1415c750 0x7f2c140b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1415b680 0x7f2c14147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 --2- 172.21.15.81:0/4254156788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c140741e0 0x7f2c140b1e20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.196+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 >> 172.21.15.81:0/4254156788 conn(0x7f2c1406cb50 msgr2=0x7f2c1415ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.197+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 shutdown_connections 2024-09-10T20:40:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.197+0000 7f2c1a400640 1 -- 172.21.15.81:0/4254156788 wait complete. 2024-09-10T20:40:54.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T20:40:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.372+0000 7f6703200640 1 -- 172.21.15.81:0/959498038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66e0003a50 msgr2=0x7f66e0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.372+0000 7f6703200640 1 --2- 172.21.15.81:0/959498038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66e0003a50 0x7f66e0003e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f66ec005fd0 tx=0x7f66e0005830 comp rx=0 tx=0).stop 2024-09-10T20:40:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.372+0000 7f6701200640 1 -- 172.21.15.81:0/959498038 reap_dead start 2024-09-10T20:40:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.372+0000 7f6703200640 1 -- 172.21.15.81:0/959498038 shutdown_connections 2024-09-10T20:40:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.372+0000 7f6703200640 1 -- 172.21.15.81:0/959498038 >> 172.21.15.81:0/959498038 conn(0x7f66fc06cb50 msgr2=0x7f66fc06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:54.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.372+0000 7f6703200640 1 -- 172.21.15.81:0/959498038 shutdown_connections 2024-09-10T20:40:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.372+0000 7f6703200640 1 -- 172.21.15.81:0/959498038 wait complete. 2024-09-10T20:40:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.374+0000 7f6703200640 1 Processor -- start 2024-09-10T20:40:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.374+0000 7f6703200640 1 -- start start 2024-09-10T20:40:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6703200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66e0003a50 0x7f66fc14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6703200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66fc14f200 0x7f66fc1f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6703200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66fc14ec40 0x7f66fc1f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6703200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc0cfd60 con 0x7f66fc14ec40 2024-09-10T20:40:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6703200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc0cfbe0 con 0x7f66fc14f200 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6703200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f66fc0cfee0 con 0x7f66e0003a50 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6701200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66fc14ec40 0x7f66fc1f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6701200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66fc14ec40 0x7f66fc1f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51458/0 (socket says 172.21.15.81:51458) 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.375+0000 7f6701200640 1 -- 172.21.15.81:0/1748937330 learned_addr learned my addr 172.21.15.81:0/1748937330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f66fb400640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66fc14f200 0x7f66fc1f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f66fbe00640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66e0003a50 0x7f66fc14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6701200640 1 -- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66e0003a50 msgr2=0x7f66fc14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6701200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66e0003a50 0x7f66fc14e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6701200640 1 -- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66fc14f200 msgr2=0x7f66fc1f82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6701200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66fc14f200 0x7f66fc1f82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6701200640 1 -- 172.21.15.81:0/1748937330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc1f91f0 con 0x7f66fc14ec40 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6701200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66fc14ec40 0x7f66fc1f8820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66fc15fbe0 tx=0x7f66f4011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:54.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f66f3e00640 1 -- 172.21.15.81:0/1748937330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4004230 con 0x7f66fc14ec40 2024-09-10T20:40:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f66f3e00640 1 -- 172.21.15.81:0/1748937330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66f4016070 con 0x7f66fc14ec40 2024-09-10T20:40:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc156950 con 0x7f66fc14ec40 2024-09-10T20:40:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f66f3e00640 1 -- 172.21.15.81:0/1748937330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f400fac0 con 0x7f66fc14ec40 2024-09-10T20:40:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.376+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc155050 con 0x7f66fc14ec40 2024-09-10T20:40:54.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.377+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc155250 con 0x7f66fc14ec40 2024-09-10T20:40:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.378+0000 7f66f3e00640 1 -- 172.21.15.81:0/1748937330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f66f4023030 con 0x7f66fc14ec40 2024-09-10T20:40:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.379+0000 7f66f3e00640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f66dc077fa0 0x7f66dc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.379+0000 7f66f3e00640 1 -- 172.21.15.81:0/1748937330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f66f409a2b0 con 0x7f66fc14ec40 2024-09-10T20:40:54.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.380+0000 7f66fbe00640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f66dc077fa0 0x7f66dc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.380+0000 7f66fbe00640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f66dc077fa0 0x7f66dc07a460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f66ec035000 tx=0x7f66ec004a40 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:54.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.383+0000 7f66f3e00640 1 -- 172.21.15.81:0/1748937330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f66fc155250 con 0x7f66fc14ec40 2024-09-10T20:40:54.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.567+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f66fc0cc490 con 0x7f66fc14ec40 2024-09-10T20:40:54.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.568+0000 7f66f3e00640 1 -- 172.21.15.81:0/1748937330 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7f66f4062ed0 con 0x7f66fc14ec40 2024-09-10T20:40:54.572 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:54.572 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-10T20:40:54.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T20:40:54.573 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-10T20:40:54.573 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-10T20:40:54.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:40:54.573 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-10T20:40:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f66dc077fa0 msgr2=0x7f66dc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f66dc077fa0 0x7f66dc07a460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f66ec035000 tx=0x7f66ec004a40 comp rx=0 tx=0).stop 2024-09-10T20:40:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66fc14ec40 msgr2=0x7f66fc1f8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66fc14ec40 0x7f66fc1f8820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66fc15fbe0 tx=0x7f66f4011b10 comp rx=0 tx=0).stop 2024-09-10T20:40:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 shutdown_connections 2024-09-10T20:40:54.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f66dc077fa0 0x7f66dc07a460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66fc14ec40 0x7f66fc1f8820 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66fc14f200 0x7f66fc1f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 --2- 172.21.15.81:0/1748937330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f66e0003a50 0x7f66fc14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 >> 172.21.15.81:0/1748937330 conn(0x7f66fc06cb50 msgr2=0x7f66fc06fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 shutdown_connections 2024-09-10T20:40:54.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.570+0000 7f6703200640 1 -- 172.21.15.81:0/1748937330 wait complete. 2024-09-10T20:40:54.590 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T20:40:54.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T20:40:54.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.748+0000 7ffaa3000640 1 -- 172.21.15.81:0/2268365312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 msgr2=0x7ffa80004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.748+0000 7ffaa3000640 1 --2- 172.21.15.81:0/2268365312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa80004c80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa88001830 tx=0x7ffa80005830 comp rx=0 tx=0).stop 2024-09-10T20:40:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.748+0000 7ffaa3000640 1 -- 172.21.15.81:0/2268365312 shutdown_connections 2024-09-10T20:40:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.748+0000 7ffaa3000640 1 --2- 172.21.15.81:0/2268365312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa80004c80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.748+0000 7ffaa3000640 1 -- 172.21.15.81:0/2268365312 >> 172.21.15.81:0/2268365312 conn(0x7ffa9c06cb50 msgr2=0x7ffa9c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.748+0000 7ffaa3000640 1 -- 172.21.15.81:0/2268365312 shutdown_connections 2024-09-10T20:40:54.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.748+0000 7ffaa3000640 1 -- 172.21.15.81:0/2268365312 wait complete. 2024-09-10T20:40:54.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.750+0000 7ffaa3000640 1 Processor -- start 2024-09-10T20:40:54.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.750+0000 7ffaa3000640 1 -- start start 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffaa3000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa9c1f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffaa3000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9c0aeb20 0x7ffa9c14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffaa3000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c0aef80 0x7ffa9c14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffaa3000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c15f650 con 0x7ffa80004800 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffaa3000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c15f4d0 con 0x7ffa9c0aef80 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffaa3000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9c15f7d0 con 0x7ffa9c0aeb20 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffa9be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa9c1f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffa9be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa9c1f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51476/0 (socket says 172.21.15.81:51476) 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.751+0000 7ffa9be00640 1 -- 172.21.15.81:0/205551209 learned_addr learned my addr 172.21.15.81:0/205551209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffaa1000640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c0aef80 0x7ffa9c14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffa9b400640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9c0aeb20 0x7ffa9c14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffa9be00640 1 -- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9c0aeb20 msgr2=0x7ffa9c14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffa9be00640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9c0aeb20 0x7ffa9c14a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffa9be00640 1 -- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c0aef80 msgr2=0x7ffa9c14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffa9be00640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c0aef80 0x7ffa9c14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffa9be00640 1 -- 172.21.15.81:0/205551209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c149390 con 0x7ffa80004800 2024-09-10T20:40:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.752+0000 7ffa9be00640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa9c1f63f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c010b70 tx=0x7ffa8c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.753+0000 7ffa93e00640 1 -- 172.21.15.81:0/205551209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c004d20 con 0x7ffa80004800 2024-09-10T20:40:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.753+0000 7ffa93e00640 1 -- 172.21.15.81:0/205551209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa8c010e70 con 0x7ffa80004800 2024-09-10T20:40:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.753+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9c149670 con 0x7ffa80004800 2024-09-10T20:40:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.753+0000 7ffa93e00640 1 -- 172.21.15.81:0/205551209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c003bd0 con 0x7ffa80004800 2024-09-10T20:40:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.753+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9c149c30 con 0x7ffa80004800 2024-09-10T20:40:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.755+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c1569d0 con 0x7ffa80004800 2024-09-10T20:40:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.755+0000 7ffa93e00640 1 -- 172.21.15.81:0/205551209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffa8c023030 con 0x7ffa80004800 2024-09-10T20:40:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.756+0000 7ffa93e00640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa7c077fa0 0x7ffa7c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.756+0000 7ffa93e00640 1 -- 172.21.15.81:0/205551209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7ffa8c09a4c0 con 0x7ffa80004800 2024-09-10T20:40:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.757+0000 7ffa9b400640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa7c077fa0 0x7ffa7c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.758+0000 7ffa9b400640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa7c077fa0 0x7ffa7c07a460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa88032000 tx=0x7ffa88001360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.760+0000 7ffa93e00640 1 -- 172.21.15.81:0/205551209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffa9c1569d0 con 0x7ffa80004800 2024-09-10T20:40:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:54.943+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffa9c15d060 con 0x7ffa80004800 2024-09-10T20:40:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.753+0000 7ffa93e00640 1 -- 172.21.15.81:0/205551209 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7ffa9c15d060 con 0x7ffa80004800 2024-09-10T20:40:55.758 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-10T20:40:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.756+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa7c077fa0 msgr2=0x7ffa7c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.756+0000 7ffaa3000640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa7c077fa0 0x7ffa7c07a460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa88032000 tx=0x7ffa88001360 comp rx=0 tx=0).stop 2024-09-10T20:40:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.756+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 msgr2=0x7ffa9c1f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.756+0000 7ffaa3000640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa9c1f63f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c010b70 tx=0x7ffa8c00e720 comp rx=0 tx=0).stop 2024-09-10T20:40:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 shutdown_connections 2024-09-10T20:40:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa7c077fa0 0x7ffa7c07a460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c0aef80 0x7ffa9c14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa9c0aeb20 0x7ffa9c14a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 --2- 172.21.15.81:0/205551209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa80004800 0x7ffa9c1f63f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 >> 172.21.15.81:0/205551209 conn(0x7ffa9c06cb50 msgr2=0x7ffa9c0cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 shutdown_connections 2024-09-10T20:40:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.757+0000 7ffaa3000640 1 -- 172.21.15.81:0/205551209 wait complete. 2024-09-10T20:40:55.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T20:40:55.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.945+0000 7fbacce00640 1 -- 172.21.15.81:0/1687330407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaac004800 msgr2=0x7fbaac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.945+0000 7fbacce00640 1 --2- 172.21.15.81:0/1687330407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbaac004800 0x7fbaac004c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbac80b4c90 tx=0x7fbaac005830 comp rx=0 tx=0).stop 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.945+0000 7fbac6800640 1 -- 172.21.15.81:0/1687330407 reap_dead start 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.945+0000 7fbacce00640 1 -- 172.21.15.81:0/1687330407 shutdown_connections 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.945+0000 7fbacce00640 1 -- 172.21.15.81:0/1687330407 >> 172.21.15.81:0/1687330407 conn(0x7fbac80cf7e0 msgr2=0x7fbac80cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.945+0000 7fbacce00640 1 -- 172.21.15.81:0/1687330407 shutdown_connections 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.945+0000 7fbacce00640 1 -- 172.21.15.81:0/1687330407 wait complete. 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.947+0000 7fbacce00640 1 Processor -- start 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.947+0000 7fbacce00640 1 -- start start 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbacce00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaac004800 0x7fbac80af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbacce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbac81e4bc0 0x7fbac81e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbacce00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbac81f7e90 0x7fbac81f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbacce00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbac80723c0 con 0x7fbac81e4bc0 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbacce00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbac8073220 con 0x7fbaac004800 2024-09-10T20:40:55.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbacce00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbac8072540 con 0x7fbac81f7e90 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbac5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbac81e4bc0 0x7fbac81e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbac5400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbac81e4bc0 0x7fbac81e5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33592/0 (socket says 172.21.15.81:33592) 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbac5400640 1 -- 172.21.15.81:0/2689158572 learned_addr learned my addr 172.21.15.81:0/2689158572 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbac5e00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaac004800 0x7fbac80af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.948+0000 7fbac6800640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbac81f7e90 0x7fbac81f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbac5400640 1 -- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbac81f7e90 msgr2=0x7fbac81f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbac5400640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbac81f7e90 0x7fbac81f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbac5400640 1 -- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaac004800 msgr2=0x7fbac80af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbac5400640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaac004800 0x7fbac80af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbac5400640 1 -- 172.21.15.81:0/2689158572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac81e5760 con 0x7fbac81e4bc0 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbac5e00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaac004800 0x7fbac80af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbac5400640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbac81e4bc0 0x7fbac81e5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbab402a990 tx=0x7fbab4004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbabe000640 1 -- 172.21.15.81:0/2689158572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4038070 con 0x7fbac81e4bc0 2024-09-10T20:40:55.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbabe000640 1 -- 172.21.15.81:0/2689158572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbab4033470 con 0x7fbac81e4bc0 2024-09-10T20:40:55.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac81f4710 con 0x7fbac81e4bc0 2024-09-10T20:40:55.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbabe000640 1 -- 172.21.15.81:0/2689158572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40068c0 con 0x7fbac81e4bc0 2024-09-10T20:40:55.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.949+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac81f4cd0 con 0x7fbac81e4bc0 2024-09-10T20:40:55.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.950+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac806efb0 con 0x7fbac81e4bc0 2024-09-10T20:40:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.952+0000 7fbabe000640 1 -- 172.21.15.81:0/2689158572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbab40338c0 con 0x7fbac81e4bc0 2024-09-10T20:40:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.953+0000 7fbabe000640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbaa8077fa0 0x7fbaa807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.953+0000 7fbabe000640 1 -- 172.21.15.81:0/2689158572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7fbab40b9b20 con 0x7fbac81e4bc0 2024-09-10T20:40:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.953+0000 7fbac5e00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbaa8077fa0 0x7fbaa807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:55.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.954+0000 7fbac5e00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbaa8077fa0 0x7fbaa807a460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009c50 tx=0x7fbab8005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:55.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:55.957+0000 7fbabe000640 1 -- 172.21.15.81:0/2689158572 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbab4082690 con 0x7fbac81e4bc0 2024-09-10T20:40:56.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.143+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbac8073990 con 0x7fbac81e4bc0 2024-09-10T20:40:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.764+0000 7fbabe000640 1 -- 172.21.15.81:0/2689158572 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7fbab4081f90 con 0x7fbac81e4bc0 2024-09-10T20:40:56.768 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.766+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbaa8077fa0 msgr2=0x7fbaa807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.766+0000 7fbacce00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbaa8077fa0 0x7fbaa807a460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009c50 tx=0x7fbab8005f90 comp rx=0 tx=0).stop 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbac81e4bc0 msgr2=0x7fbac81e5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbac81e4bc0 0x7fbac81e5040 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbab402a990 tx=0x7fbab4004830 comp rx=0 tx=0).stop 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 shutdown_connections 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbaa8077fa0 0x7fbaa807a460 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbac81f7e90 0x7fbac81f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbac81e4bc0 0x7fbac81e5040 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 --2- 172.21.15.81:0/2689158572 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbaac004800 0x7fbac80af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 >> 172.21.15.81:0/2689158572 conn(0x7fbac80cf7e0 msgr2=0x7fbac8073bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 shutdown_connections 2024-09-10T20:40:56.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.767+0000 7fbacce00640 1 -- 172.21.15.81:0/2689158572 wait complete. 2024-09-10T20:40:56.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T20:40:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.958+0000 7fc721000640 1 -- 172.21.15.81:0/2130882812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 msgr2=0x7fc71c15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.958+0000 7fc721000640 1 --2- 172.21.15.81:0/2130882812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c15f4d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc708009830 tx=0x7fc70802a510 comp rx=0 tx=0).stop 2024-09-10T20:40:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.958+0000 7fc721000640 1 -- 172.21.15.81:0/2130882812 shutdown_connections 2024-09-10T20:40:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.958+0000 7fc721000640 1 --2- 172.21.15.81:0/2130882812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c15f4d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.958+0000 7fc721000640 1 -- 172.21.15.81:0/2130882812 >> 172.21.15.81:0/2130882812 conn(0x7fc71c06cb50 msgr2=0x7fc71c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.958+0000 7fc721000640 1 -- 172.21.15.81:0/2130882812 shutdown_connections 2024-09-10T20:40:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.958+0000 7fc721000640 1 -- 172.21.15.81:0/2130882812 wait complete. 2024-09-10T20:40:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.960+0000 7fc721000640 1 Processor -- start 2024-09-10T20:40:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.960+0000 7fc721000640 1 -- start start 2024-09-10T20:40:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc721000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc721000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c15b680 0x7fc71c1f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc721000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c15c750 0x7fc71c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc721000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0b2bf0 con 0x7fc71c0741e0 2024-09-10T20:40:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc721000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0b2a70 con 0x7fc71c15b680 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc721000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c0b2d70 con 0x7fc71c15c750 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc719e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc719e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c0b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33614/0 (socket says 172.21.15.81:33614) 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc719e00640 1 -- 172.21.15.81:0/3123090731 learned_addr learned my addr 172.21.15.81:0/3123090731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc719e00640 1 -- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c15c750 msgr2=0x7fc71c14ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.961+0000 7fc719e00640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c15c750 0x7fc71c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc719e00640 1 -- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c15b680 msgr2=0x7fc71c1f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc719e00640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c15b680 0x7fc71c1f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc719e00640 1 -- 172.21.15.81:0/3123090731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c1f2e00 con 0x7fc71c0741e0 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc719e00640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c0b0520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c4c0 tx=0x7fc70c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc712000640 1 -- 172.21.15.81:0/3123090731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c016020 con 0x7fc71c0741e0 2024-09-10T20:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc712000640 1 -- 172.21.15.81:0/3123090731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc70c012940 con 0x7fc71c0741e0 2024-09-10T20:40:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c1f30e0 con 0x7fc71c0741e0 2024-09-10T20:40:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc712000640 1 -- 172.21.15.81:0/3123090731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c012d90 con 0x7fc71c0741e0 2024-09-10T20:40:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.962+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c150bc0 con 0x7fc71c0741e0 2024-09-10T20:40:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.963+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c0cc490 con 0x7fc71c0741e0 2024-09-10T20:40:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.964+0000 7fc712000640 1 -- 172.21.15.81:0/3123090731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc70c01a3b0 con 0x7fc71c0741e0 2024-09-10T20:40:56.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.965+0000 7fc712000640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc6fc077f70 0x7fc6fc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:56.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.965+0000 7fc712000640 1 -- 172.21.15.81:0/3123090731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7fc70c099f20 con 0x7fc71c0741e0 2024-09-10T20:40:56.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.966+0000 7fc719400640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc6fc077f70 0x7fc6fc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:56.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.967+0000 7fc719400640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc6fc077f70 0x7fc6fc07a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc708034000 tx=0x7fc7080046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:56.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:56.970+0000 7fc712000640 1 -- 172.21.15.81:0/3123090731 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc70c020030 con 0x7fc71c0741e0 2024-09-10T20:40:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.188+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc71c15f4b0 con 0x7fc71c0741e0 2024-09-10T20:40:57.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.766+0000 7fc712000640 1 -- 172.21.15.81:0/3123090731 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc70c062860 con 0x7fc71c0741e0 2024-09-10T20:40:57.770 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 5 and data pool 6 2024-09-10T20:40:57.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc6fc077f70 msgr2=0x7fc6fc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:57.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc6fc077f70 0x7fc6fc07a430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc708034000 tx=0x7fc7080046c0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 msgr2=0x7fc71c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c0b0520 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c4c0 tx=0x7fc70c00c980 comp rx=0 tx=0).stop 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 shutdown_connections 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc6fc077f70 0x7fc6fc07a430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c15c750 0x7fc71c14ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c15b680 0x7fc71c1f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 --2- 172.21.15.81:0/3123090731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc71c0741e0 0x7fc71c0b0520 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 >> 172.21.15.81:0/3123090731 conn(0x7fc71c06cb50 msgr2=0x7fc71c0cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 shutdown_connections 2024-09-10T20:40:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.768+0000 7fc721000640 1 -- 172.21.15.81:0/3123090731 wait complete. 2024-09-10T20:40:57.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 -- 172.21.15.81:0/2497318823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 msgr2=0x7f849c15f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 --2- 172.21.15.81:0/2497318823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 0x7f849c15f4d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8488005fd0 tx=0x7f848802a5d0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 -- 172.21.15.81:0/2497318823 shutdown_connections 2024-09-10T20:40:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 --2- 172.21.15.81:0/2497318823 >> v2:172.21.15.143:3300/0 conn(0x7f849c15c750 0x7f849c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 --2- 172.21.15.81:0/2497318823 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 0x7f849c15f4d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 -- 172.21.15.81:0/2497318823 >> 172.21.15.81:0/2497318823 conn(0x7f849c06cb50 msgr2=0x7f849c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:57.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 -- 172.21.15.81:0/2497318823 shutdown_connections 2024-09-10T20:40:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.961+0000 7f84a3600640 1 -- 172.21.15.81:0/2497318823 wait complete. 2024-09-10T20:40:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.962+0000 7f84a3600640 1 Processor -- start 2024-09-10T20:40:57.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.962+0000 7f84a3600640 1 -- start start 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.963+0000 7f84a3600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 0x7f849c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.963+0000 7f84a3600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c15b680 0x7f849c147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.963+0000 7f84a3600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f849c15c750 0x7f849c144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.963+0000 7f84a3600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0b29e0 con 0x7f849c15b680 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.963+0000 7f84a3600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0b2860 con 0x7f849c15c750 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.963+0000 7f84a3600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f849c0b2b60 con 0x7f849c0741e0 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c15b680 0x7f849c147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:57.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c15b680 0x7f849c147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33618/0 (socket says 172.21.15.81:33618) 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 -- 172.21.15.81:0/3457062542 learned_addr learned my addr 172.21.15.81:0/3457062542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f84a0c00640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 0x7f849c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f84a1600640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f849c15c750 0x7f849c144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 -- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 msgr2=0x7f849c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 0x7f849c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 -- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f849c15c750 msgr2=0x7f849c144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f849c15c750 0x7f849c144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 -- 172.21.15.81:0/3457062542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c148390 con 0x7f849c15b680 2024-09-10T20:40:57.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.964+0000 7f849be00640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c15b680 0x7f849c147e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8488000c00 tx=0x7f8488003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.965+0000 7f8498c00640 1 -- 172.21.15.81:0/3457062542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848803f070 con 0x7f849c15b680 2024-09-10T20:40:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.965+0000 7f8498c00640 1 -- 172.21.15.81:0/3457062542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8488005600 con 0x7f849c15b680 2024-09-10T20:40:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.965+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c153fa0 con 0x7f849c15b680 2024-09-10T20:40:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.965+0000 7f8498c00640 1 -- 172.21.15.81:0/3457062542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488035030 con 0x7f849c15b680 2024-09-10T20:40:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.965+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c15e450 con 0x7f849c15b680 2024-09-10T20:40:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.966+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c1578d0 con 0x7f849c15b680 2024-09-10T20:40:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.967+0000 7f8498c00640 1 -- 172.21.15.81:0/3457062542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8488004a00 con 0x7f849c15b680 2024-09-10T20:40:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.968+0000 7f8498c00640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f847c077f70 0x7f847c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.968+0000 7f8498c00640 1 -- 172.21.15.81:0/3457062542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f84880bad60 con 0x7f849c15b680 2024-09-10T20:40:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.968+0000 7f84a0c00640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f847c077f70 0x7f847c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.969+0000 7f84a0c00640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f847c077f70 0x7f847c07a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f848c0017c0 tx=0x7f848c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:57.972+0000 7f8498c00640 1 -- 172.21.15.81:0/3457062542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f849c1578d0 con 0x7f849c15b680 2024-09-10T20:40:58.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.157+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f849c0cc490 con 0x7f849c15b680 2024-09-10T20:40:58.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.158+0000 7f8498c00640 1 -- 172.21.15.81:0/3457062542 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17003 (secure 0 0 0) 0x7f849c148390 con 0x7f849c15b680 2024-09-10T20:40:58.162 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:58.162 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:40:57.190124+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:58.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f847c077f70 msgr2=0x7f847c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f847c077f70 0x7f847c07a430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f848c0017c0 tx=0x7f848c009040 comp rx=0 tx=0).stop 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c15b680 msgr2=0x7f849c147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c15b680 0x7f849c147e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8488000c00 tx=0x7f8488003820 comp rx=0 tx=0).stop 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 shutdown_connections 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f847c077f70 0x7f847c07a430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f849c15c750 0x7f849c144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c15b680 0x7f849c147e50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 --2- 172.21.15.81:0/3457062542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f849c0741e0 0x7f849c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.160+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 >> 172.21.15.81:0/3457062542 conn(0x7f849c06cb50 msgr2=0x7f849c0ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.161+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 shutdown_connections 2024-09-10T20:40:58.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.161+0000 7f84a3600640 1 -- 172.21.15.81:0/3457062542 wait complete. 2024-09-10T20:40:58.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:40:58.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.333+0000 7f69d6200640 1 -- 172.21.15.81:0/3305516167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 msgr2=0x7f69d00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.333+0000 7f69d6200640 1 --2- 172.21.15.81:0/3305516167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d00cf780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f69c8005fd0 tx=0x7f69c802a940 comp rx=0 tx=0).stop 2024-09-10T20:40:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.333+0000 7f69d6200640 1 -- 172.21.15.81:0/3305516167 shutdown_connections 2024-09-10T20:40:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.333+0000 7f69d6200640 1 --2- 172.21.15.81:0/3305516167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d00cf780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.333+0000 7f69d6200640 1 -- 172.21.15.81:0/3305516167 >> 172.21.15.81:0/3305516167 conn(0x7f69d006cb50 msgr2=0x7f69d006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.333+0000 7f69d6200640 1 -- 172.21.15.81:0/3305516167 shutdown_connections 2024-09-10T20:40:58.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.333+0000 7f69d6200640 1 -- 172.21.15.81:0/3305516167 wait complete. 2024-09-10T20:40:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.335+0000 7f69d6200640 1 Processor -- start 2024-09-10T20:40:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.335+0000 7f69d6200640 1 -- start start 2024-09-10T20:40:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69d6200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69d00741e0 0x7f69d01483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69d6200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69d015b680 0x7f69d00b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69d6200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d01f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69d6200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69d00b2bf0 con 0x7f69d015c750 2024-09-10T20:40:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69d6200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f69d00b2a70 con 0x7f69d015b680 2024-09-10T20:40:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69d6200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f69d00b2d70 con 0x7f69d00741e0 2024-09-10T20:40:58.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69cfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d01f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69cfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d01f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33634/0 (socket says 172.21.15.81:33634) 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69cfe00640 1 -- 172.21.15.81:0/2969505294 learned_addr learned my addr 172.21.15.81:0/2969505294 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69cf400640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69d00741e0 0x7f69d01483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.336+0000 7f69cea00640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69d015b680 0x7f69d00b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69cfe00640 1 -- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69d00741e0 msgr2=0x7f69d01483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69cfe00640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69d00741e0 0x7f69d01483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69cfe00640 1 -- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69d015b680 msgr2=0x7f69d00b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69cfe00640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69d015b680 0x7f69d00b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69cfe00640 1 -- 172.21.15.81:0/2969505294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d01e5ca0 con 0x7f69d015c750 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69cea00640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69d015b680 0x7f69d00b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69cfe00640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d01f4aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006010 tx=0x7f69c8031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69c7400640 1 -- 172.21.15.81:0/2969505294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c803e070 con 0x7f69d015c750 2024-09-10T20:40:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69c7400640 1 -- 172.21.15.81:0/2969505294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69c8004540 con 0x7f69d015c750 2024-09-10T20:40:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d01e6220 con 0x7f69d015c750 2024-09-10T20:40:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69c7400640 1 -- 172.21.15.81:0/2969505294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8043460 con 0x7f69d015c750 2024-09-10T20:40:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.337+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d01e5f40 con 0x7f69d015c750 2024-09-10T20:40:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.338+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d00cc490 con 0x7f69d015c750 2024-09-10T20:40:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.339+0000 7f69c7400640 1 -- 172.21.15.81:0/2969505294 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f69c804b030 con 0x7f69d015c750 2024-09-10T20:40:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.340+0000 7f69c7400640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f69b0077f70 0x7f69b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.340+0000 7f69c7400640 1 -- 172.21.15.81:0/2969505294 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f69c80bb890 con 0x7f69d015c750 2024-09-10T20:40:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.341+0000 7f69cf400640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f69b0077f70 0x7f69b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.341+0000 7f69cf400640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f69b0077f70 0x7f69b007a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69c0001680 tx=0x7f69c0009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:58.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.344+0000 7f69c7400640 1 -- 172.21.15.81:0/2969505294 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f69c8084160 con 0x7f69d015c750 2024-09-10T20:40:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.537+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69d00cf700 con 0x7f69d015c750 2024-09-10T20:40:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.538+0000 7f69c7400640 1 -- 172.21.15.81:0/2969505294 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17003 (secure 0 0 0) 0x7f69c8083a60 con 0x7f69d015c750 2024-09-10T20:40:58.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:40:58.543 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:40:57.190124+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:40:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.540+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f69b0077f70 msgr2=0x7f69b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.540+0000 7f69d6200640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f69b0077f70 0x7f69b007a430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69c0001680 tx=0x7f69c0009040 comp rx=0 tx=0).stop 2024-09-10T20:40:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.540+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 msgr2=0x7f69d01f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d01f4aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006010 tx=0x7f69c8031e20 comp rx=0 tx=0).stop 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 shutdown_connections 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f69b0077f70 0x7f69b007a430 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015c750 0x7f69d01f4aa0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f69d015b680 0x7f69d00b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 --2- 172.21.15.81:0/2969505294 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f69d00741e0 0x7f69d01483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 >> 172.21.15.81:0/2969505294 conn(0x7f69d006cb50 msgr2=0x7f69d00ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 shutdown_connections 2024-09-10T20:40:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.541+0000 7f69d6200640 1 -- 172.21.15.81:0/2969505294 wait complete. 2024-09-10T20:40:58.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T20:40:58.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.725+0000 7f9a75800640 1 -- 172.21.15.81:0/919291401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a700cf810 msgr2=0x7f9a70161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.725+0000 7f9a75800640 1 --2- 172.21.15.81:0/919291401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a700cf810 0x7f9a70161640 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009860 tx=0x7f9a5802a670 comp rx=0 tx=0).stop 2024-09-10T20:40:58.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.725+0000 7f9a75800640 1 -- 172.21.15.81:0/919291401 shutdown_connections 2024-09-10T20:40:58.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.725+0000 7f9a75800640 1 --2- 172.21.15.81:0/919291401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a700cf810 0x7f9a70161640 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.725+0000 7f9a75800640 1 -- 172.21.15.81:0/919291401 >> 172.21.15.81:0/919291401 conn(0x7f9a7006cb50 msgr2=0x7f9a7006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:58.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.725+0000 7f9a75800640 1 -- 172.21.15.81:0/919291401 shutdown_connections 2024-09-10T20:40:58.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.725+0000 7f9a75800640 1 -- 172.21.15.81:0/919291401 wait complete. 2024-09-10T20:40:58.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.728+0000 7f9a75800640 1 Processor -- start 2024-09-10T20:40:58.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.728+0000 7f9a75800640 1 -- start start 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a75800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7006eb60 0x7f9a700b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a75800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a700cf810 0x7f9a700c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a75800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7015b4d0 0x7f9a700c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a75800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a700b3120 con 0x7f9a7015b4d0 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a75800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7006f3d0 con 0x7f9a7006eb60 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a75800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9a700b32a0 con 0x7f9a700cf810 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a6f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7015b4d0 0x7f9a700c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a6f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7015b4d0 0x7f9a700c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33644/0 (socket says 172.21.15.81:33644) 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a6f400640 1 -- 172.21.15.81:0/1476771408 learned_addr learned my addr 172.21.15.81:0/1476771408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a6ea00640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7006eb60 0x7f9a700b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.729+0000 7f9a66000640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a700cf810 0x7f9a700c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a6f400640 1 -- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a700cf810 msgr2=0x7f9a700c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a6f400640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a700cf810 0x7f9a700c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a6f400640 1 -- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7006eb60 msgr2=0x7f9a700b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a6f400640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7006eb60 0x7f9a700b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a6f400640 1 -- 172.21.15.81:0/1476771408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a700c4900 con 0x7f9a7015b4d0 2024-09-10T20:40:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a6f400640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7015b4d0 0x7f9a700c6510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c780 tx=0x7f9a6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a67400640 1 -- 172.21.15.81:0/1476771408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68003b70 con 0x7f9a7015b4d0 2024-09-10T20:40:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a67400640 1 -- 172.21.15.81:0/1476771408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a68003d10 con 0x7f9a7015b4d0 2024-09-10T20:40:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a67400640 1 -- 172.21.15.81:0/1476771408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800aab0 con 0x7f9a7015b4d0 2024-09-10T20:40:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.730+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a700c4be0 con 0x7f9a7015b4d0 2024-09-10T20:40:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.731+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a700c51a0 con 0x7f9a7015b4d0 2024-09-10T20:40:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.732+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a70161640 con 0x7f9a7015b4d0 2024-09-10T20:40:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.733+0000 7f9a67400640 1 -- 172.21.15.81:0/1476771408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9a6800ac50 con 0x7f9a7015b4d0 2024-09-10T20:40:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.734+0000 7f9a67400640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9a4c077f70 0x7f9a4c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:40:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.735+0000 7f9a67400640 1 -- 172.21.15.81:0/1476771408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9a68099c40 con 0x7f9a7015b4d0 2024-09-10T20:40:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.735+0000 7f9a6ea00640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9a4c077f70 0x7f9a4c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:40:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.736+0000 7f9a6ea00640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9a4c077f70 0x7f9a4c07a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a60007fd0 tx=0x7f9a60007eb0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:40:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.739+0000 7f9a67400640 1 -- 172.21.15.81:0/1476771408 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9a68061f50 con 0x7f9a7015b4d0 2024-09-10T20:40:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:58.969+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9a7015aa50 con 0x7f9a7015b4d0 2024-09-10T20:40:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.791+0000 7f9a67400640 1 -- 172.21.15.81:0/1476771408 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9a68066980 con 0x7f9a7015b4d0 2024-09-10T20:40:59.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9a4c077f70 msgr2=0x7f9a4c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:59.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9a4c077f70 0x7f9a4c07a430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a60007fd0 tx=0x7f9a60007eb0 comp rx=0 tx=0).stop 2024-09-10T20:40:59.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7015b4d0 msgr2=0x7f9a700c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:40:59.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7015b4d0 0x7f9a700c6510 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800c780 tx=0x7f9a6800cc40 comp rx=0 tx=0).stop 2024-09-10T20:40:59.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 shutdown_connections 2024-09-10T20:40:59.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9a4c077f70 0x7f9a4c07a430 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:59.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7015b4d0 0x7f9a700c6510 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:59.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9a700cf810 0x7f9a700c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:59.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 --2- 172.21.15.81:0/1476771408 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9a7006eb60 0x7f9a700b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:40:59.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.793+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 >> 172.21.15.81:0/1476771408 conn(0x7f9a7006cb50 msgr2=0x7f9a70072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:40:59.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.794+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 shutdown_connections 2024-09-10T20:40:59.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:40:59.794+0000 7f9a75800640 1 -- 172.21.15.81:0/1476771408 wait complete. 2024-09-10T20:40:59.888 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T20:40:59.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 -- 172.21.15.81:0/2026292893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 msgr2=0x7ff9b415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 --2- 172.21.15.81:0/2026292893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b415ba60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40cd2b0 tx=0x7ff9a402a4b0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 -- 172.21.15.81:0/2026292893 shutdown_connections 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 --2- 172.21.15.81:0/2026292893 >> v2:172.21.15.143:3300/0 conn(0x7ff9b415c750 0x7ff9b40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 --2- 172.21.15.81:0/2026292893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b415ba60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 -- 172.21.15.81:0/2026292893 >> 172.21.15.81:0/2026292893 conn(0x7ff9b406cb50 msgr2=0x7ff9b406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 -- 172.21.15.81:0/2026292893 shutdown_connections 2024-09-10T20:41:00.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.045+0000 7ff9b9800640 1 -- 172.21.15.81:0/2026292893 wait complete. 2024-09-10T20:41:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.047+0000 7ff9b9800640 1 Processor -- start 2024-09-10T20:41:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.047+0000 7ff9b9800640 1 -- start start 2024-09-10T20:41:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b9800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b40741e0 0x7ff9b4159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b9800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b41e7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b9800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b415c750 0x7ff9b41e7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b9800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b40b2860 con 0x7ff9b415b680 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b9800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b40b29e0 con 0x7ff9b415c750 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b9800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b40b2b60 con 0x7ff9b40741e0 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b41e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b2000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b41e7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33662/0 (socket says 172.21.15.81:33662) 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b2000640 1 -- 172.21.15.81:0/1499580268 learned_addr learned my addr 172.21.15.81:0/1499580268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b2a00640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b40741e0 0x7ff9b4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.048+0000 7ff9b3400640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b415c750 0x7ff9b41e7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b2000640 1 -- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b40741e0 msgr2=0x7ff9b4159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b2000640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b40741e0 0x7ff9b4159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b2000640 1 -- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b415c750 msgr2=0x7ff9b41e7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b2000640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b415c750 0x7ff9b41e7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b2000640 1 -- 172.21.15.81:0/1499580268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b41e5560 con 0x7ff9b415b680 2024-09-10T20:41:00.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b3400640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b415c750 0x7ff9b41e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b2a00640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b40741e0 0x7ff9b4159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b2000640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b41e7800 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c480 tx=0x7ff9a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9aaa00640 1 -- 172.21.15.81:0/1499580268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0016020 con 0x7ff9b415b680 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9aaa00640 1 -- 172.21.15.81:0/1499580268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9a0012920 con 0x7ff9b415b680 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9aaa00640 1 -- 172.21.15.81:0/1499580268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0012d70 con 0x7ff9b415b680 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b4159c10 con 0x7ff9b415b680 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.049+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b415a1d0 con 0x7ff9b415b680 2024-09-10T20:41:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.050+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b40cd040 con 0x7ff9b415b680 2024-09-10T20:41:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.051+0000 7ff9aaa00640 1 -- 172.21.15.81:0/1499580268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff9a001b400 con 0x7ff9b415b680 2024-09-10T20:41:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.052+0000 7ff9aaa00640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff994077f70 0x7ff99407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.052+0000 7ff9aaa00640 1 -- 172.21.15.81:0/1499580268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff9a009a260 con 0x7ff9b415b680 2024-09-10T20:41:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.053+0000 7ff9b2a00640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff994077f70 0x7ff99407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.053+0000 7ff9b2a00640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff994077f70 0x7ff99407a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4034000 tx=0x7ff9a4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:00.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.056+0000 7ff9aaa00640 1 -- 172.21.15.81:0/1499580268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff9b40cd040 con 0x7ff9b415b680 2024-09-10T20:41:00.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.277+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff9b40b3080 con 0x7ff9b415b680 2024-09-10T20:41:00.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.797+0000 7ff9aaa00640 1 -- 172.21.15.81:0/1499580268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7ff9a0020020 con 0x7ff9b415b680 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff994077f70 msgr2=0x7ff99407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff994077f70 0x7ff99407a430 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4034000 tx=0x7ff9a4004730 comp rx=0 tx=0).stop 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 msgr2=0x7ff9b41e7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b41e7800 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c480 tx=0x7ff9a000c940 comp rx=0 tx=0).stop 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 shutdown_connections 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff994077f70 0x7ff99407a430 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff9b415c750 0x7ff9b41e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9b415b680 0x7ff9b41e7800 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 --2- 172.21.15.81:0/1499580268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9b40741e0 0x7ff9b4159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 >> 172.21.15.81:0/1499580268 conn(0x7ff9b406cb50 msgr2=0x7ff9b40b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:00.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 shutdown_connections 2024-09-10T20:41:00.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.800+0000 7ff9b9800640 1 -- 172.21.15.81:0/1499580268 wait complete. 2024-09-10T20:41:00.820 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T20:41:00.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.972+0000 7fb6d2a00640 1 -- 172.21.15.81:0/3981837234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b0003c30 msgr2=0x7fb6b0004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.972+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/3981837234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b0003c30 0x7fb6b0004030 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc001830 tx=0x7fb6b0005830 comp rx=0 tx=0).stop 2024-09-10T20:41:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.972+0000 7fb6d2a00640 1 -- 172.21.15.81:0/3981837234 shutdown_connections 2024-09-10T20:41:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.973+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/3981837234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b0003c30 0x7fb6b0004030 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.973+0000 7fb6d2a00640 1 -- 172.21.15.81:0/3981837234 >> 172.21.15.81:0/3981837234 conn(0x7fb6cc0d1a10 msgr2=0x7fb6cc0d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.973+0000 7fb6d2a00640 1 -- 172.21.15.81:0/3981837234 shutdown_connections 2024-09-10T20:41:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.973+0000 7fb6d2a00640 1 -- 172.21.15.81:0/3981837234 wait complete. 2024-09-10T20:41:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.974+0000 7fb6d2a00640 1 Processor -- start 2024-09-10T20:41:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.974+0000 7fb6d2a00640 1 -- start start 2024-09-10T20:41:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6b0003c30 0x7fb6cc154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d2a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6cc0c8bc0 0x7fb6cc0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d2a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6cc0c7bb0 0x7fb6cc0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d2a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc15fcf0 con 0x7fb6cc0c7bb0 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d2a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc15fb70 con 0x7fb6b0003c30 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d2a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc15fe70 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d0a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6cc0c7bb0 0x7fb6cc0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d0a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6cc0c7bb0 0x7fb6cc0c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33682/0 (socket says 172.21.15.81:33682) 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6d0a00640 1 -- 172.21.15.81:0/2410880254 learned_addr learned my addr 172.21.15.81:0/2410880254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.975+0000 7fb6c3e00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6cc0c8bc0 0x7fb6cc0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6cbe00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6b0003c30 0x7fb6cc154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6c3e00640 1 -- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6b0003c30 msgr2=0x7fb6cc154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6c3e00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6b0003c30 0x7fb6cc154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6c3e00640 1 -- 172.21.15.81:0/2410880254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6cc0c7bb0 msgr2=0x7fb6cc0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6c3e00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6cc0c7bb0 0x7fb6cc0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6c3e00640 1 -- 172.21.15.81:0/2410880254 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc1f2720 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6d0a00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6cc0c7bb0 0x7fb6cc0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:41:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.976+0000 7fb6c3e00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6cc0c8bc0 0x7fb6cc0b3780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc06c1a0 tx=0x7fb6b40039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.977+0000 7fb6c8c00640 1 -- 172.21.15.81:0/2410880254 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4015070 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.977+0000 7fb6c8c00640 1 -- 172.21.15.81:0/2410880254 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6b4011860 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.977+0000 7fb6c8c00640 1 -- 172.21.15.81:0/2410880254 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4011cb0 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.977+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc1f2a00 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.977+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc1f2fc0 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.978+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc1603d0 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.979+0000 7fb6c8c00640 1 -- 172.21.15.81:0/2410880254 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb6b40103c0 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.980+0000 7fb6c8c00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb6a8077f70 0x7fb6a807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.980+0000 7fb6c8c00640 1 -- 172.21.15.81:0/2410880254 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fb6b409ae80 con 0x7fb6cc0c8bc0 2024-09-10T20:41:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.980+0000 7fb6cbe00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb6a8077f70 0x7fb6a807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.981+0000 7fb6cbe00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb6a8077f70 0x7fb6a807a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc032000 tx=0x7fb6bc001360 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:00.985+0000 7fb6c8c00640 1 -- 172.21.15.81:0/2410880254 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb6b4063080 con 0x7fb6cc0c8bc0 2024-09-10T20:41:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.201+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6cc0c50a0 con 0x7fb6cc0c8bc0 2024-09-10T20:41:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.202+0000 7fb6c8c00640 1 -- 172.21.15.81:0/2410880254 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7fb6b4067ab0 con 0x7fb6cc0c8bc0 2024-09-10T20:41:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:01.207 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-10T20:41:00:792626+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3968194636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3968194636},{"type":"v1","addr":"172.21.15.81:6834","nonce":3968194636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1543508951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1543508951},{"type":"v1","addr":"172.21.15.81:6835","nonce":1543508951}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3499520261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3499520261},{"type":"v1","addr":"172.21.15.143:6836","nonce":3499520261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:00.279039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3550323967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3550323967},{"type":"v1","addr":"172.21.15.143:6837","nonce":3550323967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4965,"qdb_cluster":[4965]},"id":2}]} 2024-09-10T20:41:01.207 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.204+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb6a8077f70 msgr2=0x7fb6a807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.204+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb6a8077f70 0x7fb6a807a430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc032000 tx=0x7fb6bc001360 comp rx=0 tx=0).stop 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.204+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6cc0c8bc0 msgr2=0x7fb6cc0b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.204+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6cc0c8bc0 0x7fb6cc0b3780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc06c1a0 tx=0x7fb6b40039c0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 shutdown_connections 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb6a8077f70 0x7fb6a807a430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6cc0c7bb0 0x7fb6cc0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb6cc0c8bc0 0x7fb6cc0b3780 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 --2- 172.21.15.81:0/2410880254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6b0003c30 0x7fb6cc154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 >> 172.21.15.81:0/2410880254 conn(0x7fb6cc0d1a10 msgr2=0x7fb6cc0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 shutdown_connections 2024-09-10T20:41:01.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.205+0000 7fb6d2a00640 1 -- 172.21.15.81:0/2410880254 wait complete. 2024-09-10T20:41:01.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:01.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 -- 172.21.15.81:0/3044575436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 msgr2=0x7efc1415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 --2- 172.21.15.81:0/3044575436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 0x7efc1415bcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc00005fd0 tx=0x7efc0002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 -- 172.21.15.81:0/3044575436 shutdown_connections 2024-09-10T20:41:01.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 --2- 172.21.15.81:0/3044575436 >> v2:172.21.15.143:3300/0 conn(0x7efc1415c210 0x7efc1415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 --2- 172.21.15.81:0/3044575436 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 0x7efc1415bcd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 -- 172.21.15.81:0/3044575436 >> 172.21.15.81:0/3044575436 conn(0x7efc1406d500 msgr2=0x7efc140b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:01.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 -- 172.21.15.81:0/3044575436 shutdown_connections 2024-09-10T20:41:01.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.377+0000 7efc1a600640 1 -- 172.21.15.81:0/3044575436 wait complete. 2024-09-10T20:41:01.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.378+0000 7efc1a600640 1 Processor -- start 2024-09-10T20:41:01.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.379+0000 7efc1a600640 1 -- start start 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.379+0000 7efc1a600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 0x7efc141f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.379+0000 7efc1a600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140aea30 0x7efc14154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.379+0000 7efc1a600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc1415c210 0x7efc141f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.379+0000 7efc1a600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc140cc110 con 0x7efc140aea30 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.379+0000 7efc1a600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efc141600c0 con 0x7efc1415c210 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.379+0000 7efc1a600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efc140cc290 con 0x7efc14073610 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140aea30 0x7efc14154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140aea30 0x7efc14154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33692/0 (socket says 172.21.15.81:33692) 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 -- 172.21.15.81:0/4244773108 learned_addr learned my addr 172.21.15.81:0/4244773108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc19c00640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc1415c210 0x7efc141f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc19200640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 0x7efc141f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 -- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 msgr2=0x7efc141f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 0x7efc141f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 -- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc1415c210 msgr2=0x7efc141f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc1415c210 0x7efc141f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc13e00640 1 -- 172.21.15.81:0/4244773108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc141f5680 con 0x7efc140aea30 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.380+0000 7efc19c00640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc1415c210 0x7efc141f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.381+0000 7efc13e00640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140aea30 0x7efc14154500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efc00006010 tx=0x7efc000035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.381+0000 7efc10c00640 1 -- 172.21.15.81:0/4244773108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0003f070 con 0x7efc140aea30 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.381+0000 7efc10c00640 1 -- 172.21.15.81:0/4244773108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc00003ce0 con 0x7efc140aea30 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.381+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc14152ce0 con 0x7efc140aea30 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.381+0000 7efc10c00640 1 -- 172.21.15.81:0/4244773108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00035030 con 0x7efc140aea30 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.381+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc141532a0 con 0x7efc140aea30 2024-09-10T20:41:01.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.382+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc140cc7f0 con 0x7efc140aea30 2024-09-10T20:41:01.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.383+0000 7efc10c00640 1 -- 172.21.15.81:0/4244773108 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7efc00004a00 con 0x7efc140aea30 2024-09-10T20:41:01.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.384+0000 7efc10c00640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7efbf4077f70 0x7efbf407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.384+0000 7efc10c00640 1 -- 172.21.15.81:0/4244773108 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7efc000bada0 con 0x7efc140aea30 2024-09-10T20:41:01.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.384+0000 7efc19200640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7efbf4077f70 0x7efbf407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.385+0000 7efc19200640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7efbf4077f70 0x7efbf407a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc040017c0 tx=0x7efc04009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:01.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.388+0000 7efc10c00640 1 -- 172.21.15.81:0/4244773108 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7efc141f5680 con 0x7efc140aea30 2024-09-10T20:41:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.571+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc140cedb0 con 0x7efc140aea30 2024-09-10T20:41:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.572+0000 7efc10c00640 1 -- 172.21.15.81:0/4244773108 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16990 (secure 0 0 0) 0x7efc000830b0 con 0x7efc140aea30 2024-09-10T20:41:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:01.577 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:40:58.778671+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7efbf4077f70 msgr2=0x7efbf407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7efbf4077f70 0x7efbf407a430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc040017c0 tx=0x7efc04009040 comp rx=0 tx=0).stop 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140aea30 msgr2=0x7efc14154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140aea30 0x7efc14154500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efc00006010 tx=0x7efc000035f0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 shutdown_connections 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7efbf4077f70 0x7efbf407a430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efc1415c210 0x7efc141f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140aea30 0x7efc14154500 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 --2- 172.21.15.81:0/4244773108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efc14073610 0x7efc141f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 >> 172.21.15.81:0/4244773108 conn(0x7efc1406d500 msgr2=0x7efc1406f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 shutdown_connections 2024-09-10T20:41:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.575+0000 7efc1a600640 1 -- 172.21.15.81:0/4244773108 wait complete. 2024-09-10T20:41:01.595 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:41:01.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.750+0000 7f530fe00640 1 -- 172.21.15.81:0/1217990960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f4003b10 msgr2=0x7f52f4003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.750+0000 7f530fe00640 1 --2- 172.21.15.81:0/1217990960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f4003b10 0x7f52f4003f30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5300006f80 tx=0x7f52f4005830 comp rx=0 tx=0).stop 2024-09-10T20:41:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.750+0000 7f530fe00640 1 -- 172.21.15.81:0/1217990960 shutdown_connections 2024-09-10T20:41:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.750+0000 7f530fe00640 1 --2- 172.21.15.81:0/1217990960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52f4003b10 0x7f52f4003f30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.750+0000 7f530fe00640 1 -- 172.21.15.81:0/1217990960 >> 172.21.15.81:0/1217990960 conn(0x7f531006d500 msgr2=0x7f53100b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:01.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.750+0000 7f530fe00640 1 -- 172.21.15.81:0/1217990960 shutdown_connections 2024-09-10T20:41:01.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.750+0000 7f530fe00640 1 -- 172.21.15.81:0/1217990960 wait complete. 2024-09-10T20:41:01.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.752+0000 7f530fe00640 1 Processor -- start 2024-09-10T20:41:01.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.752+0000 7f530fe00640 1 -- start start 2024-09-10T20:41:01.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52f4003b10 0x7f53101f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5310152190 0x7f53101e5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53101f4310 0x7f53100ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f531015c060 con 0x7f53101f4310 2024-09-10T20:41:01.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f531015bee0 con 0x7f52f4003b10 2024-09-10T20:41:01.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f53100cec80 con 0x7f5310152190 2024-09-10T20:41:01.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53101f4310 0x7f53100ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53101f4310 0x7f53100ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33720/0 (socket says 172.21.15.81:33720) 2024-09-10T20:41:01.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52f4003b10 0x7f53101f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530f400640 1 -- 172.21.15.81:0/1062192368 learned_addr learned my addr 172.21.15.81:0/1062192368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:01.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.753+0000 7f530e000640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5310152190 0x7f53101e5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530f400640 1 -- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5310152190 msgr2=0x7f53101e5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530f400640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5310152190 0x7f53101e5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530f400640 1 -- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52f4003b10 msgr2=0x7f53101f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530f400640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52f4003b10 0x7f53101f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530f400640 1 -- 172.21.15.81:0/1062192368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5310140db0 con 0x7f53101f4310 2024-09-10T20:41:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530f400640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53101f4310 0x7f53100ad850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f531015ce40 tx=0x7f53080019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f5306a00640 1 -- 172.21.15.81:0/1062192368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308017070 con 0x7f53101f4310 2024-09-10T20:41:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f5306a00640 1 -- 172.21.15.81:0/1062192368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53080108e0 con 0x7f53101f4310 2024-09-10T20:41:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53101f7ee0 con 0x7f53101f4310 2024-09-10T20:41:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f5306a00640 1 -- 172.21.15.81:0/1062192368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308010d30 con 0x7f53101f4310 2024-09-10T20:41:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.754+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101f84a0 con 0x7f53101f4310 2024-09-10T20:41:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.755+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53100cf1e0 con 0x7f53101f4310 2024-09-10T20:41:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.756+0000 7f5306a00640 1 -- 172.21.15.81:0/1062192368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f530801c440 con 0x7f53101f4310 2024-09-10T20:41:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.757+0000 7f5306a00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f52f0077f70 0x7f52f007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.757+0000 7f5306a00640 1 -- 172.21.15.81:0/1062192368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f5308099ee0 con 0x7f53101f4310 2024-09-10T20:41:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.758+0000 7f530ea00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f52f0077f70 0x7f52f007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:01.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.759+0000 7f530ea00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f52f0077f70 0x7f52f007a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5300033000 tx=0x7f5300001930 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:01.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.762+0000 7f5306a00640 1 -- 172.21.15.81:0/1062192368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5308062160 con 0x7f53101f4310 2024-09-10T20:41:01.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.944+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53101e4bd0 con 0x7f52f0077f70 2024-09-10T20:41:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.950+0000 7f5306a00640 1 -- 172.21.15.81:0/1062192368 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f53101e4bd0 con 0x7f52f0077f70 2024-09-10T20:41:01.957 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:01.959 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f52f0077f70 msgr2=0x7f52f007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f52f0077f70 0x7f52f007a430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5300033000 tx=0x7f5300001930 comp rx=0 tx=0).stop 2024-09-10T20:41:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53101f4310 msgr2=0x7f53100ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53101f4310 0x7f53100ad850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f531015ce40 tx=0x7f53080019b0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 shutdown_connections 2024-09-10T20:41:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f52f0077f70 0x7f52f007a430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53101f4310 0x7f53100ad850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5310152190 0x7f53101e5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 --2- 172.21.15.81:0/1062192368 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52f4003b10 0x7f53101f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 >> 172.21.15.81:0/1062192368 conn(0x7f531006d500 msgr2=0x7f531006f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 shutdown_connections 2024-09-10T20:41:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:01.954+0000 7f530fe00640 1 -- 172.21.15.81:0/1062192368 wait complete. 2024-09-10T20:41:01.974 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-10T20:41:01.861523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4878336,"data_stored":2737120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001243"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788846+0000","last_change":"2024-09-10T20:40:57.808566+0000","last_active":"2024-09-10T20:40:58.788846+0000","last_peered":"2024-09-10T20:40:58.788846+0000","last_clean":"2024-09-10T20:40:58.788846+0000","last_became_active":"2024-09-10T20:40:57.808299+0000","last_became_peered":"2024-09-10T20:40:57.808299+0000","last_unstale":"2024-09-10T20:40:58.788846+0000","last_undegraded":"2024-09-10T20:40:58.788846+0000","last_fullsized":"2024-09-10T20:40:58.788846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:44.054462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971131+0000","last_change":"2024-09-10T20:40:57.785246+0000","last_active":"2024-09-10T20:40:58.971131+0000","last_peered":"2024-09-10T20:40:58.971131+0000","last_clean":"2024-09-10T20:40:58.971131+0000","last_became_active":"2024-09-10T20:40:57.784969+0000","last_became_peered":"2024-09-10T20:40:57.784969+0000","last_unstale":"2024-09-10T20:40:58.971131+0000","last_undegraded":"2024-09-10T20:40:58.971131+0000","last_fullsized":"2024-09-10T20:40:58.971131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:44.678843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788282+0000","last_change":"2024-09-10T20:40:57.798413+0000","last_active":"2024-09-10T20:40:58.788282+0000","last_peered":"2024-09-10T20:40:58.788282+0000","last_clean":"2024-09-10T20:40:58.788282+0000","last_became_active":"2024-09-10T20:40:57.798085+0000","last_became_peered":"2024-09-10T20:40:57.798085+0000","last_unstale":"2024-09-10T20:40:58.788282+0000","last_undegraded":"2024-09-10T20:40:58.788282+0000","last_fullsized":"2024-09-10T20:40:58.788282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:15.958954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788573+0000","last_change":"2024-09-10T20:40:57.793918+0000","last_active":"2024-09-10T20:40:58.788573+0000","last_peered":"2024-09-10T20:40:58.788573+0000","last_clean":"2024-09-10T20:40:58.788573+0000","last_became_active":"2024-09-10T20:40:57.793335+0000","last_became_peered":"2024-09-10T20:40:57.793335+0000","last_unstale":"2024-09-10T20:40:58.788573+0000","last_undegraded":"2024-09-10T20:40:58.788573+0000","last_fullsized":"2024-09-10T20:40:58.788573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:20.370552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969945+0000","last_change":"2024-09-10T20:40:57.802056+0000","last_active":"2024-09-10T20:40:58.969945+0000","last_peered":"2024-09-10T20:40:58.969945+0000","last_clean":"2024-09-10T20:40:58.969945+0000","last_became_active":"2024-09-10T20:40:57.801252+0000","last_became_peered":"2024-09-10T20:40:57.801252+0000","last_unstale":"2024-09-10T20:40:58.969945+0000","last_undegraded":"2024-09-10T20:40:58.969945+0000","last_fullsized":"2024-09-10T20:40:58.969945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:22.702065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970232+0000","last_change":"2024-09-10T20:40:57.781646+0000","last_active":"2024-09-10T20:40:58.970232+0000","last_peered":"2024-09-10T20:40:58.970232+0000","last_clean":"2024-09-10T20:40:58.970232+0000","last_became_active":"2024-09-10T20:40:57.781350+0000","last_became_peered":"2024-09-10T20:40:57.781350+0000","last_unstale":"2024-09-10T20:40:58.970232+0000","last_undegraded":"2024-09-10T20:40:58.970232+0000","last_fullsized":"2024-09-10T20:40:58.970232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:39.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970560+0000","last_change":"2024-09-10T20:40:57.797129+0000","last_active":"2024-09-10T20:40:58.970560+0000","last_peered":"2024-09-10T20:40:58.970560+0000","last_clean":"2024-09-10T20:40:58.970560+0000","last_became_active":"2024-09-10T20:40:57.796854+0000","last_became_peered":"2024-09-10T20:40:57.796854+0000","last_unstale":"2024-09-10T20:40:58.970560+0000","last_undegraded":"2024-09-10T20:40:58.970560+0000","last_fullsized":"2024-09-10T20:40:58.970560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:07.449316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788860+0000","last_change":"2024-09-10T20:40:57.808609+0000","last_active":"2024-09-10T20:40:58.788860+0000","last_peered":"2024-09-10T20:40:58.788860+0000","last_clean":"2024-09-10T20:40:58.788860+0000","last_became_active":"2024-09-10T20:40:57.807999+0000","last_became_peered":"2024-09-10T20:40:57.807999+0000","last_unstale":"2024-09-10T20:40:58.788860+0000","last_undegraded":"2024-09-10T20:40:58.788860+0000","last_fullsized":"2024-09-10T20:40:58.788860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.365075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970176+0000","last_change":"2024-09-10T20:40:57.802618+0000","last_active":"2024-09-10T20:40:58.970176+0000","last_peered":"2024-09-10T20:40:58.970176+0000","last_clean":"2024-09-10T20:40:58.970176+0000","last_became_active":"2024-09-10T20:40:57.801991+0000","last_became_peered":"2024-09-10T20:40:57.801991+0000","last_unstale":"2024-09-10T20:40:58.970176+0000","last_undegraded":"2024-09-10T20:40:58.970176+0000","last_fullsized":"2024-09-10T20:40:58.970176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:48.162696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971654+0000","last_change":"2024-09-10T20:40:57.805178+0000","last_active":"2024-09-10T20:40:58.971654+0000","last_peered":"2024-09-10T20:40:58.971654+0000","last_clean":"2024-09-10T20:40:58.971654+0000","last_became_active":"2024-09-10T20:40:57.804919+0000","last_became_peered":"2024-09-10T20:40:57.804919+0000","last_unstale":"2024-09-10T20:40:58.971654+0000","last_undegraded":"2024-09-10T20:40:58.971654+0000","last_fullsized":"2024-09-10T20:40:58.971654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:16.263939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971284+0000","last_change":"2024-09-10T20:40:57.797147+0000","last_active":"2024-09-10T20:40:58.971284+0000","last_peered":"2024-09-10T20:40:58.971284+0000","last_clean":"2024-09-10T20:40:58.971284+0000","last_became_active":"2024-09-10T20:40:57.796910+0000","last_became_peered":"2024-09-10T20:40:57.796910+0000","last_unstale":"2024-09-10T20:40:58.971284+0000","last_undegraded":"2024-09-10T20:40:58.971284+0000","last_fullsized":"2024-09-10T20:40:58.971284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:40.968176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970443+0000","last_change":"2024-09-10T20:40:57.804510+0000","last_active":"2024-09-10T20:40:58.970443+0000","last_peered":"2024-09-10T20:40:58.970443+0000","last_clean":"2024-09-10T20:40:58.970443+0000","last_became_active":"2024-09-10T20:40:57.804220+0000","last_became_peered":"2024-09-10T20:40:57.804220+0000","last_unstale":"2024-09-10T20:40:58.970443+0000","last_undegraded":"2024-09-10T20:40:58.970443+0000","last_fullsized":"2024-09-10T20:40:58.970443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:34.652032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971287+0000","last_change":"2024-09-10T20:40:57.795473+0000","last_active":"2024-09-10T20:40:58.971287+0000","last_peered":"2024-09-10T20:40:58.971287+0000","last_clean":"2024-09-10T20:40:58.971287+0000","last_became_active":"2024-09-10T20:40:57.795179+0000","last_became_peered":"2024-09-10T20:40:57.795179+0000","last_unstale":"2024-09-10T20:40:58.971287+0000","last_undegraded":"2024-09-10T20:40:58.971287+0000","last_fullsized":"2024-09-10T20:40:58.971287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:36:25.736401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969498+0000","last_change":"2024-09-10T20:40:57.801649+0000","last_active":"2024-09-10T20:40:58.969498+0000","last_peered":"2024-09-10T20:40:58.969498+0000","last_clean":"2024-09-10T20:40:58.969498+0000","last_became_active":"2024-09-10T20:40:57.797096+0000","last_became_peered":"2024-09-10T20:40:57.797096+0000","last_unstale":"2024-09-10T20:40:58.969498+0000","last_undegraded":"2024-09-10T20:40:58.969498+0000","last_fullsized":"2024-09-10T20:40:58.969498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:55.727449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786486+0000","last_change":"2024-09-10T20:40:57.779842+0000","last_active":"2024-09-10T20:40:58.786486+0000","last_peered":"2024-09-10T20:40:58.786486+0000","last_clean":"2024-09-10T20:40:58.786486+0000","last_became_active":"2024-09-10T20:40:57.779564+0000","last_became_peered":"2024-09-10T20:40:57.779564+0000","last_unstale":"2024-09-10T20:40:58.786486+0000","last_undegraded":"2024-09-10T20:40:58.786486+0000","last_fullsized":"2024-09-10T20:40:58.786486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:19.763721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969870+0000","last_change":"2024-09-10T20:40:57.806288+0000","last_active":"2024-09-10T20:40:58.969870+0000","last_peered":"2024-09-10T20:40:58.969870+0000","last_clean":"2024-09-10T20:40:58.969870+0000","last_became_active":"2024-09-10T20:40:57.804491+0000","last_became_peered":"2024-09-10T20:40:57.804491+0000","last_unstale":"2024-09-10T20:40:58.969870+0000","last_undegraded":"2024-09-10T20:40:58.969870+0000","last_fullsized":"2024-09-10T20:40:58.969870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:48.162696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787263+0000","last_change":"2024-09-10T20:40:57.781946+0000","last_active":"2024-09-10T20:40:58.787263+0000","last_peered":"2024-09-10T20:40:58.787263+0000","last_clean":"2024-09-10T20:40:58.787263+0000","last_became_active":"2024-09-10T20:40:57.781711+0000","last_became_peered":"2024-09-10T20:40:57.781711+0000","last_unstale":"2024-09-10T20:40:58.787263+0000","last_undegraded":"2024-09-10T20:40:58.787263+0000","last_fullsized":"2024-09-10T20:40:58.787263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:49.508741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787072+0000","last_change":"2024-09-10T20:40:57.781131+0000","last_active":"2024-09-10T20:40:58.787072+0000","last_peered":"2024-09-10T20:40:58.787072+0000","last_clean":"2024-09-10T20:40:58.787072+0000","last_became_active":"2024-09-10T20:40:57.780857+0000","last_became_peered":"2024-09-10T20:40:57.780857+0000","last_unstale":"2024-09-10T20:40:58.787072+0000","last_undegraded":"2024-09-10T20:40:58.787072+0000","last_fullsized":"2024-09-10T20:40:58.787072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:25.893234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.802338+0000","last_change":"2024-09-10T20:40:57.799870+0000","last_active":"2024-09-10T20:40:57.802338+0000","last_peered":"2024-09-10T20:40:57.802338+0000","last_clean":"2024-09-10T20:40:57.802338+0000","last_became_active":"2024-09-10T20:40:57.799593+0000","last_became_peered":"2024-09-10T20:40:57.799593+0000","last_unstale":"2024-09-10T20:40:57.802338+0000","last_undegraded":"2024-09-10T20:40:57.802338+0000","last_fullsized":"2024-09-10T20:40:57.802338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:43.733854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970928+0000","last_change":"2024-09-10T20:40:57.788576+0000","last_active":"2024-09-10T20:40:58.970928+0000","last_peered":"2024-09-10T20:40:58.970928+0000","last_clean":"2024-09-10T20:40:58.970928+0000","last_became_active":"2024-09-10T20:40:57.788342+0000","last_became_peered":"2024-09-10T20:40:57.788342+0000","last_unstale":"2024-09-10T20:40:58.970928+0000","last_undegraded":"2024-09-10T20:40:58.970928+0000","last_fullsized":"2024-09-10T20:40:58.970928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:14.609649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970892+0000","last_change":"2024-09-10T20:40:57.797333+0000","last_active":"2024-09-10T20:40:58.970892+0000","last_peered":"2024-09-10T20:40:58.970892+0000","last_clean":"2024-09-10T20:40:58.970892+0000","last_became_active":"2024-09-10T20:40:57.794482+0000","last_became_peered":"2024-09-10T20:40:57.794482+0000","last_unstale":"2024-09-10T20:40:58.970892+0000","last_undegraded":"2024-09-10T20:40:58.970892+0000","last_fullsized":"2024-09-10T20:40:58.970892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:19.400396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970269+0000","last_change":"2024-09-10T20:40:57.785890+0000","last_active":"2024-09-10T20:40:58.970269+0000","last_peered":"2024-09-10T20:40:58.970269+0000","last_clean":"2024-09-10T20:40:58.970269+0000","last_became_active":"2024-09-10T20:40:57.785582+0000","last_became_peered":"2024-09-10T20:40:57.785582+0000","last_unstale":"2024-09-10T20:40:58.970269+0000","last_undegraded":"2024-09-10T20:40:58.970269+0000","last_fullsized":"2024-09-10T20:40:58.970269+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:17.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786536+0000","last_change":"2024-09-10T20:40:57.786174+0000","last_active":"2024-09-10T20:40:58.786536+0000","last_peered":"2024-09-10T20:40:58.786536+0000","last_clean":"2024-09-10T20:40:58.786536+0000","last_became_active":"2024-09-10T20:40:57.785175+0000","last_became_peered":"2024-09-10T20:40:57.785175+0000","last_unstale":"2024-09-10T20:40:58.786536+0000","last_undegraded":"2024-09-10T20:40:58.786536+0000","last_fullsized":"2024-09-10T20:40:58.786536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:24.467011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787773+0000","last_change":"2024-09-10T20:40:57.808222+0000","last_active":"2024-09-10T20:40:58.787773+0000","last_peered":"2024-09-10T20:40:58.787773+0000","last_clean":"2024-09-10T20:40:58.787773+0000","last_became_active":"2024-09-10T20:40:57.807578+0000","last_became_peered":"2024-09-10T20:40:57.807578+0000","last_unstale":"2024-09-10T20:40:58.787773+0000","last_undegraded":"2024-09-10T20:40:58.787773+0000","last_fullsized":"2024-09-10T20:40:58.787773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:22.672592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970103+0000","last_change":"2024-09-10T20:40:57.803089+0000","last_active":"2024-09-10T20:40:58.970103+0000","last_peered":"2024-09-10T20:40:58.970103+0000","last_clean":"2024-09-10T20:40:58.970103+0000","last_became_active":"2024-09-10T20:40:57.802606+0000","last_became_peered":"2024-09-10T20:40:57.802606+0000","last_unstale":"2024-09-10T20:40:58.970103+0000","last_undegraded":"2024-09-10T20:40:58.970103+0000","last_fullsized":"2024-09-10T20:40:58.970103+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:13.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788236+0000","last_change":"2024-09-10T20:40:57.804633+0000","last_active":"2024-09-10T20:40:58.788236+0000","last_peered":"2024-09-10T20:40:58.788236+0000","last_clean":"2024-09-10T20:40:58.788236+0000","last_became_active":"2024-09-10T20:40:57.804388+0000","last_became_peered":"2024-09-10T20:40:57.804388+0000","last_unstale":"2024-09-10T20:40:58.788236+0000","last_undegraded":"2024-09-10T20:40:58.788236+0000","last_fullsized":"2024-09-10T20:40:58.788236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:29.475021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971490+0000","last_change":"2024-09-10T20:40:57.790304+0000","last_active":"2024-09-10T20:40:58.971490+0000","last_peered":"2024-09-10T20:40:58.971490+0000","last_clean":"2024-09-10T20:40:58.971490+0000","last_became_active":"2024-09-10T20:40:57.790064+0000","last_became_peered":"2024-09-10T20:40:57.790064+0000","last_unstale":"2024-09-10T20:40:58.971490+0000","last_undegraded":"2024-09-10T20:40:58.971490+0000","last_fullsized":"2024-09-10T20:40:58.971490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:59.893364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971898+0000","last_change":"2024-09-10T20:40:57.811854+0000","last_active":"2024-09-10T20:40:58.971898+0000","last_peered":"2024-09-10T20:40:58.971898+0000","last_clean":"2024-09-10T20:40:58.971898+0000","last_became_active":"2024-09-10T20:40:57.811532+0000","last_became_peered":"2024-09-10T20:40:57.811532+0000","last_unstale":"2024-09-10T20:40:58.971898+0000","last_undegraded":"2024-09-10T20:40:58.971898+0000","last_fullsized":"2024-09-10T20:40:58.971898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:14.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786782+0000","last_change":"2024-09-10T20:40:57.783995+0000","last_active":"2024-09-10T20:40:58.786782+0000","last_peered":"2024-09-10T20:40:58.786782+0000","last_clean":"2024-09-10T20:40:58.786782+0000","last_became_active":"2024-09-10T20:40:57.782195+0000","last_became_peered":"2024-09-10T20:40:57.782195+0000","last_unstale":"2024-09-10T20:40:58.786782+0000","last_undegraded":"2024-09-10T20:40:58.786782+0000","last_fullsized":"2024-09-10T20:40:58.786782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:35.070564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786926+0000","last_change":"2024-09-10T20:40:57.778945+0000","last_active":"2024-09-10T20:40:58.786926+0000","last_peered":"2024-09-10T20:40:58.786926+0000","last_clean":"2024-09-10T20:40:58.786926+0000","last_became_active":"2024-09-10T20:40:57.778659+0000","last_became_peered":"2024-09-10T20:40:57.778659+0000","last_unstale":"2024-09-10T20:40:58.786926+0000","last_undegraded":"2024-09-10T20:40:58.786926+0000","last_fullsized":"2024-09-10T20:40:58.786926+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:12.740619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970755+0000","last_change":"2024-09-10T20:40:57.796477+0000","last_active":"2024-09-10T20:40:58.970755+0000","last_peered":"2024-09-10T20:40:58.970755+0000","last_clean":"2024-09-10T20:40:58.970755+0000","last_became_active":"2024-09-10T20:40:57.796191+0000","last_became_peered":"2024-09-10T20:40:57.796191+0000","last_unstale":"2024-09-10T20:40:58.970755+0000","last_undegraded":"2024-09-10T20:40:58.970755+0000","last_fullsized":"2024-09-10T20:40:58.970755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:29.160217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787979+0000","last_change":"2024-09-10T20:40:57.813103+0000","last_active":"2024-09-10T20:40:58.787979+0000","last_peered":"2024-09-10T20:40:58.787979+0000","last_clean":"2024-09-10T20:40:58.787979+0000","last_became_active":"2024-09-10T20:40:57.812863+0000","last_became_peered":"2024-09-10T20:40:57.812863+0000","last_unstale":"2024-09-10T20:40:58.787979+0000","last_undegraded":"2024-09-10T20:40:58.787979+0000","last_fullsized":"2024-09-10T20:40:58.787979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.959912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786971+0000","last_change":"2024-09-10T20:40:57.806845+0000","last_active":"2024-09-10T20:40:58.786971+0000","last_peered":"2024-09-10T20:40:58.786971+0000","last_clean":"2024-09-10T20:40:58.786971+0000","last_became_active":"2024-09-10T20:40:57.806562+0000","last_became_peered":"2024-09-10T20:40:57.806562+0000","last_unstale":"2024-09-10T20:40:58.786971+0000","last_undegraded":"2024-09-10T20:40:58.786971+0000","last_fullsized":"2024-09-10T20:40:58.786971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970157+0000","last_change":"2024-09-10T20:40:56.787360+0000","last_active":"2024-09-10T20:40:58.970157+0000","last_peered":"2024-09-10T20:40:58.970157+0000","last_clean":"2024-09-10T20:40:58.970157+0000","last_became_active":"2024-09-10T20:40:56.787113+0000","last_became_peered":"2024-09-10T20:40:56.787113+0000","last_unstale":"2024-09-10T20:40:58.970157+0000","last_undegraded":"2024-09-10T20:40:58.970157+0000","last_fullsized":"2024-09-10T20:40:58.970157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970733+0000","last_change":"2024-09-10T20:40:57.794642+0000","last_active":"2024-09-10T20:40:58.970733+0000","last_peered":"2024-09-10T20:40:58.970733+0000","last_clean":"2024-09-10T20:40:58.970733+0000","last_became_active":"2024-09-10T20:40:57.794432+0000","last_became_peered":"2024-09-10T20:40:57.794432+0000","last_unstale":"2024-09-10T20:40:58.970733+0000","last_undegraded":"2024-09-10T20:40:58.970733+0000","last_fullsized":"2024-09-10T20:40:58.970733+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:40.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971141+0000","last_change":"2024-09-10T20:40:56.790001+0000","last_active":"2024-09-10T20:40:58.971141+0000","last_peered":"2024-09-10T20:40:58.971141+0000","last_clean":"2024-09-10T20:40:58.971141+0000","last_became_active":"2024-09-10T20:40:56.789708+0000","last_became_peered":"2024-09-10T20:40:56.789708+0000","last_unstale":"2024-09-10T20:40:58.971141+0000","last_undegraded":"2024-09-10T20:40:58.971141+0000","last_fullsized":"2024-09-10T20:40:58.971141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:56.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787299+0000","last_change":"2024-09-10T20:40:57.804223+0000","last_active":"2024-09-10T20:40:58.787299+0000","last_peered":"2024-09-10T20:40:58.787299+0000","last_clean":"2024-09-10T20:40:58.787299+0000","last_became_active":"2024-09-10T20:40:57.800934+0000","last_became_peered":"2024-09-10T20:40:57.800934+0000","last_unstale":"2024-09-10T20:40:58.787299+0000","last_undegraded":"2024-09-10T20:40:58.787299+0000","last_fullsized":"2024-09-10T20:40:58.787299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:35.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788547+0000","last_change":"2024-09-10T20:40:56.798617+0000","last_active":"2024-09-10T20:40:58.788547+0000","last_peered":"2024-09-10T20:40:58.788547+0000","last_clean":"2024-09-10T20:40:58.788547+0000","last_became_active":"2024-09-10T20:40:56.798233+0000","last_became_peered":"2024-09-10T20:40:56.798233+0000","last_unstale":"2024-09-10T20:40:58.788547+0000","last_undegraded":"2024-09-10T20:40:58.788547+0000","last_fullsized":"2024-09-10T20:40:58.788547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:55.548605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971268+0000","last_change":"2024-09-10T20:40:57.790493+0000","last_active":"2024-09-10T20:40:58.971268+0000","last_peered":"2024-09-10T20:40:58.971268+0000","last_clean":"2024-09-10T20:40:58.971268+0000","last_became_active":"2024-09-10T20:40:57.789768+0000","last_became_peered":"2024-09-10T20:40:57.789768+0000","last_unstale":"2024-09-10T20:40:58.971268+0000","last_undegraded":"2024-09-10T20:40:58.971268+0000","last_fullsized":"2024-09-10T20:40:58.971268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:06.104237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969991+0000","last_change":"2024-09-10T20:40:56.798645+0000","last_active":"2024-09-10T20:40:58.969991+0000","last_peered":"2024-09-10T20:40:58.969991+0000","last_clean":"2024-09-10T20:40:58.969991+0000","last_became_active":"2024-09-10T20:40:56.798325+0000","last_became_peered":"2024-09-10T20:40:56.798325+0000","last_unstale":"2024-09-10T20:40:58.969991+0000","last_undegraded":"2024-09-10T20:40:58.969991+0000","last_fullsized":"2024-09-10T20:40:58.969991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:18.678416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789168+0000","last_change":"2024-09-10T20:40:57.792035+0000","last_active":"2024-09-10T20:40:58.789168+0000","last_peered":"2024-09-10T20:40:58.789168+0000","last_clean":"2024-09-10T20:40:58.789168+0000","last_became_active":"2024-09-10T20:40:57.791743+0000","last_became_peered":"2024-09-10T20:40:57.791743+0000","last_unstale":"2024-09-10T20:40:58.789168+0000","last_undegraded":"2024-09-10T20:40:58.789168+0000","last_fullsized":"2024-09-10T20:40:58.789168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:17.466229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969960+0000","last_change":"2024-09-10T20:40:56.778488+0000","last_active":"2024-09-10T20:40:58.969960+0000","last_peered":"2024-09-10T20:40:58.969960+0000","last_clean":"2024-09-10T20:40:58.969960+0000","last_became_active":"2024-09-10T20:40:56.778241+0000","last_became_peered":"2024-09-10T20:40:56.778241+0000","last_unstale":"2024-09-10T20:40:58.969960+0000","last_undegraded":"2024-09-10T20:40:58.969960+0000","last_fullsized":"2024-09-10T20:40:58.969960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969999+0000","last_change":"2024-09-10T20:40:57.787640+0000","last_active":"2024-09-10T20:40:58.969999+0000","last_peered":"2024-09-10T20:40:58.969999+0000","last_clean":"2024-09-10T20:40:58.969999+0000","last_became_active":"2024-09-10T20:40:57.787374+0000","last_became_peered":"2024-09-10T20:40:57.787374+0000","last_unstale":"2024-09-10T20:40:58.969999+0000","last_undegraded":"2024-09-10T20:40:58.969999+0000","last_fullsized":"2024-09-10T20:40:58.969999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:47.135269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971394+0000","last_change":"2024-09-10T20:40:56.799544+0000","last_active":"2024-09-10T20:40:58.971394+0000","last_peered":"2024-09-10T20:40:58.971394+0000","last_clean":"2024-09-10T20:40:58.971394+0000","last_became_active":"2024-09-10T20:40:56.799273+0000","last_became_peered":"2024-09-10T20:40:56.799273+0000","last_unstale":"2024-09-10T20:40:58.971394+0000","last_undegraded":"2024-09-10T20:40:58.971394+0000","last_fullsized":"2024-09-10T20:40:58.971394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:24.776937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786647+0000","last_change":"2024-09-10T20:40:57.790412+0000","last_active":"2024-09-10T20:40:58.786647+0000","last_peered":"2024-09-10T20:40:58.786647+0000","last_clean":"2024-09-10T20:40:58.786647+0000","last_became_active":"2024-09-10T20:40:57.788308+0000","last_became_peered":"2024-09-10T20:40:57.788308+0000","last_unstale":"2024-09-10T20:40:58.786647+0000","last_undegraded":"2024-09-10T20:40:58.786647+0000","last_fullsized":"2024-09-10T20:40:58.786647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:31.799493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788463+0000","last_change":"2024-09-10T20:40:56.795211+0000","last_active":"2024-09-10T20:40:58.788463+0000","last_peered":"2024-09-10T20:40:58.788463+0000","last_clean":"2024-09-10T20:40:58.788463+0000","last_became_active":"2024-09-10T20:40:56.794869+0000","last_became_peered":"2024-09-10T20:40:56.794869+0000","last_unstale":"2024-09-10T20:40:58.788463+0000","last_undegraded":"2024-09-10T20:40:58.788463+0000","last_fullsized":"2024-09-10T20:40:58.788463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:54.724711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970909+0000","last_change":"2024-09-10T20:40:57.799569+0000","last_active":"2024-09-10T20:40:58.970909+0000","last_peered":"2024-09-10T20:40:58.970909+0000","last_clean":"2024-09-10T20:40:58.970909+0000","last_became_active":"2024-09-10T20:40:57.799219+0000","last_became_peered":"2024-09-10T20:40:57.799219+0000","last_unstale":"2024-09-10T20:40:58.970909+0000","last_undegraded":"2024-09-10T20:40:58.970909+0000","last_fullsized":"2024-09-10T20:40:58.970909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:14.095093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971061+0000","last_change":"2024-09-10T20:40:56.779639+0000","last_active":"2024-09-10T20:40:58.971061+0000","last_peered":"2024-09-10T20:40:58.971061+0000","last_clean":"2024-09-10T20:40:58.971061+0000","last_became_active":"2024-09-10T20:40:56.779311+0000","last_became_peered":"2024-09-10T20:40:56.779311+0000","last_unstale":"2024-09-10T20:40:58.971061+0000","last_undegraded":"2024-09-10T20:40:58.971061+0000","last_fullsized":"2024-09-10T20:40:58.971061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:39.771929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788723+0000","last_change":"2024-09-10T20:40:57.793647+0000","last_active":"2024-09-10T20:40:58.788723+0000","last_peered":"2024-09-10T20:40:58.788723+0000","last_clean":"2024-09-10T20:40:58.788723+0000","last_became_active":"2024-09-10T20:40:57.792950+0000","last_became_peered":"2024-09-10T20:40:57.792950+0000","last_unstale":"2024-09-10T20:40:58.788723+0000","last_undegraded":"2024-09-10T20:40:58.788723+0000","last_fullsized":"2024-09-10T20:40:58.788723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:46.140416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788911+0000","last_change":"2024-09-10T20:40:56.799456+0000","last_active":"2024-09-10T20:40:58.788911+0000","last_peered":"2024-09-10T20:40:58.788911+0000","last_clean":"2024-09-10T20:40:58.788911+0000","last_became_active":"2024-09-10T20:40:56.799162+0000","last_became_peered":"2024-09-10T20:40:56.799162+0000","last_unstale":"2024-09-10T20:40:58.788911+0000","last_undegraded":"2024-09-10T20:40:58.788911+0000","last_fullsized":"2024-09-10T20:40:58.788911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:44.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970236+0000","last_change":"2024-09-10T20:40:57.802645+0000","last_active":"2024-09-10T20:40:58.970236+0000","last_peered":"2024-09-10T20:40:58.970236+0000","last_clean":"2024-09-10T20:40:58.970236+0000","last_became_active":"2024-09-10T20:40:57.802283+0000","last_became_peered":"2024-09-10T20:40:57.802283+0000","last_unstale":"2024-09-10T20:40:58.970236+0000","last_undegraded":"2024-09-10T20:40:58.970236+0000","last_fullsized":"2024-09-10T20:40:58.970236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:57.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787011+0000","last_change":"2024-09-10T20:40:56.787551+0000","last_active":"2024-09-10T20:40:58.787011+0000","last_peered":"2024-09-10T20:40:58.787011+0000","last_clean":"2024-09-10T20:40:58.787011+0000","last_became_active":"2024-09-10T20:40:56.786720+0000","last_became_peered":"2024-09-10T20:40:56.786720+0000","last_unstale":"2024-09-10T20:40:58.787011+0000","last_undegraded":"2024-09-10T20:40:58.787011+0000","last_fullsized":"2024-09-10T20:40:58.787011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:58.890626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788499+0000","last_change":"2024-09-10T20:40:57.805104+0000","last_active":"2024-09-10T20:40:58.788499+0000","last_peered":"2024-09-10T20:40:58.788499+0000","last_clean":"2024-09-10T20:40:58.788499+0000","last_became_active":"2024-09-10T20:40:57.804894+0000","last_became_peered":"2024-09-10T20:40:57.804894+0000","last_unstale":"2024-09-10T20:40:58.788499+0000","last_undegraded":"2024-09-10T20:40:58.788499+0000","last_fullsized":"2024-09-10T20:40:58.788499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:36.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786727+0000","last_change":"2024-09-10T20:40:56.798785+0000","last_active":"2024-09-10T20:40:58.786727+0000","last_peered":"2024-09-10T20:40:58.786727+0000","last_clean":"2024-09-10T20:40:58.786727+0000","last_became_active":"2024-09-10T20:40:56.798390+0000","last_became_peered":"2024-09-10T20:40:56.798390+0000","last_unstale":"2024-09-10T20:40:58.786727+0000","last_undegraded":"2024-09-10T20:40:58.786727+0000","last_fullsized":"2024-09-10T20:40:58.786727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:39.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971906+0000","last_change":"2024-09-10T20:40:57.807154+0000","last_active":"2024-09-10T20:40:58.971906+0000","last_peered":"2024-09-10T20:40:58.971906+0000","last_clean":"2024-09-10T20:40:58.971906+0000","last_became_active":"2024-09-10T20:40:57.806970+0000","last_became_peered":"2024-09-10T20:40:57.806970+0000","last_unstale":"2024-09-10T20:40:58.971906+0000","last_undegraded":"2024-09-10T20:40:58.971906+0000","last_fullsized":"2024-09-10T20:40:58.971906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:18.292524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788691+0000","last_change":"2024-09-10T20:40:56.798461+0000","last_active":"2024-09-10T20:40:58.788691+0000","last_peered":"2024-09-10T20:40:58.788691+0000","last_clean":"2024-09-10T20:40:58.788691+0000","last_became_active":"2024-09-10T20:40:56.798136+0000","last_became_peered":"2024-09-10T20:40:56.798136+0000","last_unstale":"2024-09-10T20:40:58.788691+0000","last_undegraded":"2024-09-10T20:40:58.788691+0000","last_fullsized":"2024-09-10T20:40:58.788691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:08.271880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788980+0000","last_change":"2024-09-10T20:40:57.800593+0000","last_active":"2024-09-10T20:40:58.788980+0000","last_peered":"2024-09-10T20:40:58.788980+0000","last_clean":"2024-09-10T20:40:58.788980+0000","last_became_active":"2024-09-10T20:40:57.796067+0000","last_became_peered":"2024-09-10T20:40:57.796067+0000","last_unstale":"2024-09-10T20:40:58.788980+0000","last_undegraded":"2024-09-10T20:40:58.788980+0000","last_fullsized":"2024-09-10T20:40:58.788980+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:08.647327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789473+0000","last_change":"2024-09-10T20:40:56.798892+0000","last_active":"2024-09-10T20:40:58.789473+0000","last_peered":"2024-09-10T20:40:58.789473+0000","last_clean":"2024-09-10T20:40:58.789473+0000","last_became_active":"2024-09-10T20:40:56.798574+0000","last_became_peered":"2024-09-10T20:40:56.798574+0000","last_unstale":"2024-09-10T20:40:58.789473+0000","last_undegraded":"2024-09-10T20:40:58.789473+0000","last_fullsized":"2024-09-10T20:40:58.789473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:12.809899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970283+0000","last_change":"2024-09-10T20:40:57.789344+0000","last_active":"2024-09-10T20:40:58.970283+0000","last_peered":"2024-09-10T20:40:58.970283+0000","last_clean":"2024-09-10T20:40:58.970283+0000","last_became_active":"2024-09-10T20:40:57.789092+0000","last_became_peered":"2024-09-10T20:40:57.789092+0000","last_unstale":"2024-09-10T20:40:58.970283+0000","last_undegraded":"2024-09-10T20:40:58.970283+0000","last_fullsized":"2024-09-10T20:40:58.970283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:34.267791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970301+0000","last_change":"2024-09-10T20:40:56.787899+0000","last_active":"2024-09-10T20:40:58.970301+0000","last_peered":"2024-09-10T20:40:58.970301+0000","last_clean":"2024-09-10T20:40:58.970301+0000","last_became_active":"2024-09-10T20:40:56.787509+0000","last_became_peered":"2024-09-10T20:40:56.787509+0000","last_unstale":"2024-09-10T20:40:58.970301+0000","last_undegraded":"2024-09-10T20:40:58.970301+0000","last_fullsized":"2024-09-10T20:40:58.970301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.249527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970581+0000","last_change":"2024-09-10T20:40:57.786588+0000","last_active":"2024-09-10T20:40:58.970581+0000","last_peered":"2024-09-10T20:40:58.970581+0000","last_clean":"2024-09-10T20:40:58.970581+0000","last_became_active":"2024-09-10T20:40:57.786296+0000","last_became_peered":"2024-09-10T20:40:57.786296+0000","last_unstale":"2024-09-10T20:40:58.970581+0000","last_undegraded":"2024-09-10T20:40:58.970581+0000","last_fullsized":"2024-09-10T20:40:58.970581+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:23.141364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786592+0000","last_change":"2024-09-10T20:40:56.783758+0000","last_active":"2024-09-10T20:40:58.786592+0000","last_peered":"2024-09-10T20:40:58.786592+0000","last_clean":"2024-09-10T20:40:58.786592+0000","last_became_active":"2024-09-10T20:40:56.783512+0000","last_became_peered":"2024-09-10T20:40:56.783512+0000","last_unstale":"2024-09-10T20:40:58.786592+0000","last_undegraded":"2024-09-10T20:40:58.786592+0000","last_fullsized":"2024-09-10T20:40:58.786592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:39.374632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970386+0000","last_change":"2024-09-10T20:40:57.801745+0000","last_active":"2024-09-10T20:40:58.970386+0000","last_peered":"2024-09-10T20:40:58.970386+0000","last_clean":"2024-09-10T20:40:58.970386+0000","last_became_active":"2024-09-10T20:40:57.801484+0000","last_became_peered":"2024-09-10T20:40:57.801484+0000","last_unstale":"2024-09-10T20:40:58.970386+0000","last_undegraded":"2024-09-10T20:40:58.970386+0000","last_fullsized":"2024-09-10T20:40:58.970386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:47.239308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969373+0000","last_change":"2024-09-10T20:40:56.779692+0000","last_active":"2024-09-10T20:40:58.969373+0000","last_peered":"2024-09-10T20:40:58.969373+0000","last_clean":"2024-09-10T20:40:58.969373+0000","last_became_active":"2024-09-10T20:40:56.779447+0000","last_became_peered":"2024-09-10T20:40:56.779447+0000","last_unstale":"2024-09-10T20:40:58.969373+0000","last_undegraded":"2024-09-10T20:40:58.969373+0000","last_fullsized":"2024-09-10T20:40:58.969373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:15.261201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970671+0000","last_change":"2024-09-10T20:40:57.795777+0000","last_active":"2024-09-10T20:40:58.970671+0000","last_peered":"2024-09-10T20:40:58.970671+0000","last_clean":"2024-09-10T20:40:58.970671+0000","last_became_active":"2024-09-10T20:40:57.795521+0000","last_became_peered":"2024-09-10T20:40:57.795521+0000","last_unstale":"2024-09-10T20:40:58.970671+0000","last_undegraded":"2024-09-10T20:40:58.970671+0000","last_fullsized":"2024-09-10T20:40:58.970671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971848+0000","last_change":"2024-09-10T20:40:56.792708+0000","last_active":"2024-09-10T20:40:58.971848+0000","last_peered":"2024-09-10T20:40:58.971848+0000","last_clean":"2024-09-10T20:40:58.971848+0000","last_became_active":"2024-09-10T20:40:56.792427+0000","last_became_peered":"2024-09-10T20:40:56.792427+0000","last_unstale":"2024-09-10T20:40:58.971848+0000","last_undegraded":"2024-09-10T20:40:58.971848+0000","last_fullsized":"2024-09-10T20:40:58.971848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:40.781428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971958+0000","last_change":"2024-09-10T20:40:57.805292+0000","last_active":"2024-09-10T20:40:58.971958+0000","last_peered":"2024-09-10T20:40:58.971958+0000","last_clean":"2024-09-10T20:40:58.971958+0000","last_became_active":"2024-09-10T20:40:57.804999+0000","last_became_peered":"2024-09-10T20:40:57.804999+0000","last_unstale":"2024-09-10T20:40:58.971958+0000","last_undegraded":"2024-09-10T20:40:58.971958+0000","last_fullsized":"2024-09-10T20:40:58.971958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:43.458885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787141+0000","last_change":"2024-09-10T20:40:56.798769+0000","last_active":"2024-09-10T20:40:58.787141+0000","last_peered":"2024-09-10T20:40:58.787141+0000","last_clean":"2024-09-10T20:40:58.787141+0000","last_became_active":"2024-09-10T20:40:56.798317+0000","last_became_peered":"2024-09-10T20:40:56.798317+0000","last_unstale":"2024-09-10T20:40:58.787141+0000","last_undegraded":"2024-09-10T20:40:58.787141+0000","last_fullsized":"2024-09-10T20:40:58.787141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:25.510395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971802+0000","last_change":"2024-09-10T20:40:57.795506+0000","last_active":"2024-09-10T20:40:58.971802+0000","last_peered":"2024-09-10T20:40:58.971802+0000","last_clean":"2024-09-10T20:40:58.971802+0000","last_became_active":"2024-09-10T20:40:57.795238+0000","last_became_peered":"2024-09-10T20:40:57.795238+0000","last_unstale":"2024-09-10T20:40:58.971802+0000","last_undegraded":"2024-09-10T20:40:58.971802+0000","last_fullsized":"2024-09-10T20:40:58.971802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:19.681154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969639+0000","last_change":"2024-09-10T20:40:56.792843+0000","last_active":"2024-09-10T20:40:58.969639+0000","last_peered":"2024-09-10T20:40:58.969639+0000","last_clean":"2024-09-10T20:40:58.969639+0000","last_became_active":"2024-09-10T20:40:56.792439+0000","last_became_peered":"2024-09-10T20:40:56.792439+0000","last_unstale":"2024-09-10T20:40:58.969639+0000","last_undegraded":"2024-09-10T20:40:58.969639+0000","last_fullsized":"2024-09-10T20:40:58.969639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:49.054542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.800595+0000","last_change":"2024-09-10T20:40:57.798663+0000","last_active":"2024-09-10T20:40:57.800595+0000","last_peered":"2024-09-10T20:40:57.800595+0000","last_clean":"2024-09-10T20:40:57.800595+0000","last_became_active":"2024-09-10T20:40:57.798333+0000","last_became_peered":"2024-09-10T20:40:57.798333+0000","last_unstale":"2024-09-10T20:40:57.800595+0000","last_undegraded":"2024-09-10T20:40:57.800595+0000","last_fullsized":"2024-09-10T20:40:57.800595+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:49.867232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.775151+0000","last_change":"2024-09-10T20:40:56.789841+0000","last_active":"2024-09-10T20:40:57.775151+0000","last_peered":"2024-09-10T20:40:57.775151+0000","last_clean":"2024-09-10T20:40:57.775151+0000","last_became_active":"2024-09-10T20:40:56.789524+0000","last_became_peered":"2024-09-10T20:40:56.789524+0000","last_unstale":"2024-09-10T20:40:57.775151+0000","last_undegraded":"2024-09-10T20:40:57.775151+0000","last_fullsized":"2024-09-10T20:40:57.775151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:06.139874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786504+0000","last_change":"2024-09-10T20:40:57.779901+0000","last_active":"2024-09-10T20:40:58.786504+0000","last_peered":"2024-09-10T20:40:58.786504+0000","last_clean":"2024-09-10T20:40:58.786504+0000","last_became_active":"2024-09-10T20:40:57.779489+0000","last_became_peered":"2024-09-10T20:40:57.779489+0000","last_unstale":"2024-09-10T20:40:58.786504+0000","last_undegraded":"2024-09-10T20:40:58.786504+0000","last_fullsized":"2024-09-10T20:40:58.786504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:18.624203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.805985+0000","last_change":"2024-09-10T20:40:56.787107+0000","last_active":"2024-09-10T20:40:57.805985+0000","last_peered":"2024-09-10T20:40:57.805985+0000","last_clean":"2024-09-10T20:40:57.805985+0000","last_became_active":"2024-09-10T20:40:56.786778+0000","last_became_peered":"2024-09-10T20:40:56.786778+0000","last_unstale":"2024-09-10T20:40:57.805985+0000","last_undegraded":"2024-09-10T20:40:57.805985+0000","last_fullsized":"2024-09-10T20:40:57.805985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:21.098826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788497+0000","last_change":"2024-09-10T20:40:57.805036+0000","last_active":"2024-09-10T20:40:58.788497+0000","last_peered":"2024-09-10T20:40:58.788497+0000","last_clean":"2024-09-10T20:40:58.788497+0000","last_became_active":"2024-09-10T20:40:57.804826+0000","last_became_peered":"2024-09-10T20:40:57.804826+0000","last_unstale":"2024-09-10T20:40:58.788497+0000","last_undegraded":"2024-09-10T20:40:58.788497+0000","last_fullsized":"2024-09-10T20:40:58.788497+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.004069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970377+0000","last_change":"2024-09-10T20:40:56.792580+0000","last_active":"2024-09-10T20:40:58.970377+0000","last_peered":"2024-09-10T20:40:58.970377+0000","last_clean":"2024-09-10T20:40:58.970377+0000","last_became_active":"2024-09-10T20:40:56.792296+0000","last_became_peered":"2024-09-10T20:40:56.792296+0000","last_unstale":"2024-09-10T20:40:58.970377+0000","last_undegraded":"2024-09-10T20:40:58.970377+0000","last_fullsized":"2024-09-10T20:40:58.970377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:34.728794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971014+0000","last_change":"2024-09-10T20:40:57.798757+0000","last_active":"2024-09-10T20:40:58.971014+0000","last_peered":"2024-09-10T20:40:58.971014+0000","last_clean":"2024-09-10T20:40:58.971014+0000","last_became_active":"2024-09-10T20:40:57.796635+0000","last_became_peered":"2024-09-10T20:40:57.796635+0000","last_unstale":"2024-09-10T20:40:58.971014+0000","last_undegraded":"2024-09-10T20:40:58.971014+0000","last_fullsized":"2024-09-10T20:40:58.971014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:56.551343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970814+0000","last_change":"2024-09-10T20:40:56.779612+0000","last_active":"2024-09-10T20:40:58.970814+0000","last_peered":"2024-09-10T20:40:58.970814+0000","last_clean":"2024-09-10T20:40:58.970814+0000","last_became_active":"2024-09-10T20:40:56.779319+0000","last_became_peered":"2024-09-10T20:40:56.779319+0000","last_unstale":"2024-09-10T20:40:58.970814+0000","last_undegraded":"2024-09-10T20:40:58.970814+0000","last_fullsized":"2024-09-10T20:40:58.970814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:20.129458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789658+0000","last_change":"2024-09-10T20:40:57.794987+0000","last_active":"2024-09-10T20:40:58.789658+0000","last_peered":"2024-09-10T20:40:58.789658+0000","last_clean":"2024-09-10T20:40:58.789658+0000","last_became_active":"2024-09-10T20:40:57.794701+0000","last_became_peered":"2024-09-10T20:40:57.794701+0000","last_unstale":"2024-09-10T20:40:58.789658+0000","last_undegraded":"2024-09-10T20:40:58.789658+0000","last_fullsized":"2024-09-10T20:40:58.789658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:19.763721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969666+0000","last_change":"2024-09-10T20:40:56.796619+0000","last_active":"2024-09-10T20:40:58.969666+0000","last_peered":"2024-09-10T20:40:58.969666+0000","last_clean":"2024-09-10T20:40:58.969666+0000","last_became_active":"2024-09-10T20:40:56.796334+0000","last_became_peered":"2024-09-10T20:40:56.796334+0000","last_unstale":"2024-09-10T20:40:58.969666+0000","last_undegraded":"2024-09-10T20:40:58.969666+0000","last_fullsized":"2024-09-10T20:40:58.969666+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:18.035879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970154+0000","last_change":"2024-09-10T20:40:57.797064+0000","last_active":"2024-09-10T20:40:58.970154+0000","last_peered":"2024-09-10T20:40:58.970154+0000","last_clean":"2024-09-10T20:40:58.970154+0000","last_became_active":"2024-09-10T20:40:57.796778+0000","last_became_peered":"2024-09-10T20:40:57.796778+0000","last_unstale":"2024-09-10T20:40:58.970154+0000","last_undegraded":"2024-09-10T20:40:58.970154+0000","last_fullsized":"2024-09-10T20:40:58.970154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:15.851683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787324+0000","last_change":"2024-09-10T20:40:56.781802+0000","last_active":"2024-09-10T20:40:58.787324+0000","last_peered":"2024-09-10T20:40:58.787324+0000","last_clean":"2024-09-10T20:40:58.787324+0000","last_became_active":"2024-09-10T20:40:56.781430+0000","last_became_peered":"2024-09-10T20:40:56.781430+0000","last_unstale":"2024-09-10T20:40:58.787324+0000","last_undegraded":"2024-09-10T20:40:58.787324+0000","last_fullsized":"2024-09-10T20:40:58.787324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:52.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971437+0000","last_change":"2024-09-10T20:40:57.797088+0000","last_active":"2024-09-10T20:40:58.971437+0000","last_peered":"2024-09-10T20:40:58.971437+0000","last_clean":"2024-09-10T20:40:58.971437+0000","last_became_active":"2024-09-10T20:40:57.796516+0000","last_became_peered":"2024-09-10T20:40:57.796516+0000","last_unstale":"2024-09-10T20:40:58.971437+0000","last_undegraded":"2024-09-10T20:40:58.971437+0000","last_fullsized":"2024-09-10T20:40:58.971437+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:53.214686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970405+0000","last_change":"2024-09-10T20:40:56.792746+0000","last_active":"2024-09-10T20:40:58.970405+0000","last_peered":"2024-09-10T20:40:58.970405+0000","last_clean":"2024-09-10T20:40:58.970405+0000","last_became_active":"2024-09-10T20:40:56.792409+0000","last_became_peered":"2024-09-10T20:40:56.792409+0000","last_unstale":"2024-09-10T20:40:58.970405+0000","last_undegraded":"2024-09-10T20:40:58.970405+0000","last_fullsized":"2024-09-10T20:40:58.970405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:11.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.787730+0000","last_change":"2024-09-10T20:40:57.780255+0000","last_active":"2024-09-10T20:40:57.787730+0000","last_peered":"2024-09-10T20:40:57.787730+0000","last_clean":"2024-09-10T20:40:57.787730+0000","last_became_active":"2024-09-10T20:40:57.779962+0000","last_became_peered":"2024-09-10T20:40:57.779962+0000","last_unstale":"2024-09-10T20:40:57.787730+0000","last_undegraded":"2024-09-10T20:40:57.787730+0000","last_fullsized":"2024-09-10T20:40:57.787730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:35.983774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969923+0000","last_change":"2024-09-10T20:40:56.800962+0000","last_active":"2024-09-10T20:40:58.969923+0000","last_peered":"2024-09-10T20:40:58.969923+0000","last_clean":"2024-09-10T20:40:58.969923+0000","last_became_active":"2024-09-10T20:40:56.800727+0000","last_became_peered":"2024-09-10T20:40:56.800727+0000","last_unstale":"2024-09-10T20:40:58.969923+0000","last_undegraded":"2024-09-10T20:40:58.969923+0000","last_fullsized":"2024-09-10T20:40:58.969923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:52.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970256+0000","last_change":"2024-09-10T20:40:57.793540+0000","last_active":"2024-09-10T20:40:58.970256+0000","last_peered":"2024-09-10T20:40:58.970256+0000","last_clean":"2024-09-10T20:40:58.970256+0000","last_became_active":"2024-09-10T20:40:57.793231+0000","last_became_peered":"2024-09-10T20:40:57.793231+0000","last_unstale":"2024-09-10T20:40:58.970256+0000","last_undegraded":"2024-09-10T20:40:58.970256+0000","last_fullsized":"2024-09-10T20:40:58.970256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:01.359250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789708+0000","last_change":"2024-09-10T20:40:56.795661+0000","last_active":"2024-09-10T20:40:58.789708+0000","last_peered":"2024-09-10T20:40:58.789708+0000","last_clean":"2024-09-10T20:40:58.789708+0000","last_became_active":"2024-09-10T20:40:56.794893+0000","last_became_peered":"2024-09-10T20:40:56.794893+0000","last_unstale":"2024-09-10T20:40:58.789708+0000","last_undegraded":"2024-09-10T20:40:58.789708+0000","last_fullsized":"2024-09-10T20:40:58.789708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:56.476490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970166+0000","last_change":"2024-09-10T20:40:57.777674+0000","last_active":"2024-09-10T20:40:58.970166+0000","last_peered":"2024-09-10T20:40:58.970166+0000","last_clean":"2024-09-10T20:40:58.970166+0000","last_became_active":"2024-09-10T20:40:57.776652+0000","last_became_peered":"2024-09-10T20:40:57.776652+0000","last_unstale":"2024-09-10T20:40:58.970166+0000","last_undegraded":"2024-09-10T20:40:58.970166+0000","last_fullsized":"2024-09-10T20:40:58.970166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:56.651005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970632+0000","last_change":"2024-09-10T20:40:56.786260+0000","last_active":"2024-09-10T20:40:58.970632+0000","last_peered":"2024-09-10T20:40:58.970632+0000","last_clean":"2024-09-10T20:40:58.970632+0000","last_became_active":"2024-09-10T20:40:56.785702+0000","last_became_peered":"2024-09-10T20:40:56.785702+0000","last_unstale":"2024-09-10T20:40:58.970632+0000","last_undegraded":"2024-09-10T20:40:58.970632+0000","last_fullsized":"2024-09-10T20:40:58.970632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786905+0000","last_change":"2024-09-10T20:40:57.793392+0000","last_active":"2024-09-10T20:40:58.786905+0000","last_peered":"2024-09-10T20:40:58.786905+0000","last_clean":"2024-09-10T20:40:58.786905+0000","last_became_active":"2024-09-10T20:40:57.793192+0000","last_became_peered":"2024-09-10T20:40:57.793192+0000","last_unstale":"2024-09-10T20:40:58.786905+0000","last_undegraded":"2024-09-10T20:40:58.786905+0000","last_fullsized":"2024-09-10T20:40:58.786905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:26.742701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786613+0000","last_change":"2024-09-10T20:40:56.781668+0000","last_active":"2024-09-10T20:40:58.786613+0000","last_peered":"2024-09-10T20:40:58.786613+0000","last_clean":"2024-09-10T20:40:58.786613+0000","last_became_active":"2024-09-10T20:40:56.781402+0000","last_became_peered":"2024-09-10T20:40:56.781402+0000","last_unstale":"2024-09-10T20:40:58.786613+0000","last_undegraded":"2024-09-10T20:40:58.786613+0000","last_fullsized":"2024-09-10T20:40:58.786613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:35.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970969+0000","last_change":"2024-09-10T20:40:57.789700+0000","last_active":"2024-09-10T20:40:58.970969+0000","last_peered":"2024-09-10T20:40:58.970969+0000","last_clean":"2024-09-10T20:40:58.970969+0000","last_became_active":"2024-09-10T20:40:57.789433+0000","last_became_peered":"2024-09-10T20:40:57.789433+0000","last_unstale":"2024-09-10T20:40:58.970969+0000","last_undegraded":"2024-09-10T20:40:58.970969+0000","last_fullsized":"2024-09-10T20:40:58.970969+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:36.586950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789045+0000","last_change":"2024-09-10T20:40:56.795619+0000","last_active":"2024-09-10T20:40:58.789045+0000","last_peered":"2024-09-10T20:40:58.789045+0000","last_clean":"2024-09-10T20:40:58.789045+0000","last_became_active":"2024-09-10T20:40:56.795292+0000","last_became_peered":"2024-09-10T20:40:56.795292+0000","last_unstale":"2024-09-10T20:40:58.789045+0000","last_undegraded":"2024-09-10T20:40:58.789045+0000","last_fullsized":"2024-09-10T20:40:58.789045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:09.500262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787259+0000","last_change":"2024-09-10T20:40:57.784029+0000","last_active":"2024-09-10T20:40:58.787259+0000","last_peered":"2024-09-10T20:40:58.787259+0000","last_clean":"2024-09-10T20:40:58.787259+0000","last_became_active":"2024-09-10T20:40:57.783716+0000","last_became_peered":"2024-09-10T20:40:57.783716+0000","last_unstale":"2024-09-10T20:40:58.787259+0000","last_undegraded":"2024-09-10T20:40:58.787259+0000","last_fullsized":"2024-09-10T20:40:58.787259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:17.034966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970985+0000","last_change":"2024-09-10T20:40:56.785344+0000","last_active":"2024-09-10T20:40:58.970985+0000","last_peered":"2024-09-10T20:40:58.970985+0000","last_clean":"2024-09-10T20:40:58.970985+0000","last_became_active":"2024-09-10T20:40:56.785096+0000","last_became_peered":"2024-09-10T20:40:56.785096+0000","last_unstale":"2024-09-10T20:40:58.970985+0000","last_undegraded":"2024-09-10T20:40:58.970985+0000","last_fullsized":"2024-09-10T20:40:58.970985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971146+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:40:58.971146+0000","last_peered":"2024-09-10T20:40:58.971146+0000","last_clean":"2024-09-10T20:40:58.971146+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:40:58.971146+0000","last_undegraded":"2024-09-10T20:40:58.971146+0000","last_fullsized":"2024-09-10T20:40:58.971146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":196518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":196976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":785172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":462848,"data_stored":194874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":779040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:01.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:02.119 INFO:tasks.ceph.mds.d.smithi143.stderr:2024-09-10T20:41:02.114+0000 7fcc12000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:41:02.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 -- 172.21.15.81:0/2151914031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a240cec80 msgr2=0x7f8a2415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2151914031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a240cec80 0x7f8a2415bcd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8a240cc040 tx=0x7f8a1002a560 comp rx=0 tx=0).stop 2024-09-10T20:41:02.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 -- 172.21.15.81:0/2151914031 shutdown_connections 2024-09-10T20:41:02.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2151914031 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a2415c210 0x7f8a2415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2151914031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a240cec80 0x7f8a2415bcd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2151914031 >> v2:172.21.15.143:3300/0 conn(0x7f8a240aea30 0x7f8a24073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 -- 172.21.15.81:0/2151914031 >> 172.21.15.81:0/2151914031 conn(0x7f8a2406d500 msgr2=0x7f8a240b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:02.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 -- 172.21.15.81:0/2151914031 shutdown_connections 2024-09-10T20:41:02.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.169+0000 7f8a28c00640 1 -- 172.21.15.81:0/2151914031 wait complete. 2024-09-10T20:41:02.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.171+0000 7f8a28c00640 1 Processor -- start 2024-09-10T20:41:02.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.171+0000 7f8a28c00640 1 -- start start 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.171+0000 7f8a28c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a240aea30 0x7f8a241f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a28c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a240cec80 0x7f8a24154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a28c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2415c210 0x7f8a240ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a28c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2415ffb0 con 0x7f8a2415c210 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a28c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2415fe30 con 0x7f8a240cec80 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a28c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8a24160130 con 0x7f8a240aea30 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2415c210 0x7f8a240ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2415c210 0x7f8a240ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33730/0 (socket says 172.21.15.81:33730) 2024-09-10T20:41:02.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a240aea30 0x7f8a241f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 -- 172.21.15.81:0/2997216929 learned_addr learned my addr 172.21.15.81:0/2997216929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a22a00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a240cec80 0x7f8a24154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 -- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a240aea30 msgr2=0x7f8a241f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a240aea30 0x7f8a241f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 -- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a240cec80 msgr2=0x7f8a24154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a240cec80 0x7f8a24154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.172+0000 7f8a23e00640 1 -- 172.21.15.81:0/2997216929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a240c9e10 con 0x7f8a2415c210 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.173+0000 7f8a23e00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2415c210 0x7f8a240ad850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e990 tx=0x7f8a1c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.173+0000 7f8a1b400640 1 -- 172.21.15.81:0/2997216929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c004d20 con 0x7f8a2415c210 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.173+0000 7f8a1b400640 1 -- 172.21.15.81:0/2997216929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a1c00cb00 con 0x7f8a2415c210 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.173+0000 7f8a1b400640 1 -- 172.21.15.81:0/2997216929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c005020 con 0x7f8a2415c210 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.173+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a240ca0f0 con 0x7f8a2415c210 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.173+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a240ca6b0 con 0x7f8a2415c210 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.174+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2415bcd0 con 0x7f8a2415c210 2024-09-10T20:41:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.175+0000 7f8a1b400640 1 -- 172.21.15.81:0/2997216929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8a1c00f040 con 0x7f8a2415c210 2024-09-10T20:41:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.176+0000 7f8a1b400640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8a04077f70 0x7f8a0407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.176+0000 7f8a1b400640 1 -- 172.21.15.81:0/2997216929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8a1c09a440 con 0x7f8a2415c210 2024-09-10T20:41:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.176+0000 7f8a23400640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8a04077f70 0x7f8a0407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.177+0000 7f8a23400640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8a04077f70 0x7f8a0407a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400bb70 tx=0x7f8a1400b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.180+0000 7f8a1b400640 1 -- 172.21.15.81:0/2997216929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8a1c016030 con 0x7f8a2415c210 2024-09-10T20:41:02.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.358+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a24075c90 con 0x7f8a04077f70 2024-09-10T20:41:02.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.364+0000 7f8a1b400640 1 -- 172.21.15.81:0/2997216929 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f8a24075c90 con 0x7f8a04077f70 2024-09-10T20:41:02.370 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:02.371 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.367+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8a04077f70 msgr2=0x7f8a0407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.367+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8a04077f70 0x7f8a0407a430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400bb70 tx=0x7f8a1400b2e0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.367+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2415c210 msgr2=0x7f8a240ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.367+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2415c210 0x7f8a240ad850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00e990 tx=0x7f8a1c00ee50 comp rx=0 tx=0).stop 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 shutdown_connections 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8a04077f70 0x7f8a0407a430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a2415c210 0x7f8a240ad850 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a240cec80 0x7f8a24154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 --2- 172.21.15.81:0/2997216929 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a240aea30 0x7f8a241f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 >> 172.21.15.81:0/2997216929 conn(0x7f8a2406d500 msgr2=0x7f8a240b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 shutdown_connections 2024-09-10T20:41:02.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.368+0000 7f8a28c00640 1 -- 172.21.15.81:0/2997216929 wait complete. 2024-09-10T20:41:02.387 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-10T20:41:01.861523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221024,"kb_used_data":4764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753696,"statfs":{"total":773094113280,"available":772867784704,"internally_reserved":0,"allocated":4878336,"data_stored":2737120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001243"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788846+0000","last_change":"2024-09-10T20:40:57.808566+0000","last_active":"2024-09-10T20:40:58.788846+0000","last_peered":"2024-09-10T20:40:58.788846+0000","last_clean":"2024-09-10T20:40:58.788846+0000","last_became_active":"2024-09-10T20:40:57.808299+0000","last_became_peered":"2024-09-10T20:40:57.808299+0000","last_unstale":"2024-09-10T20:40:58.788846+0000","last_undegraded":"2024-09-10T20:40:58.788846+0000","last_fullsized":"2024-09-10T20:40:58.788846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:27:44.054462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971131+0000","last_change":"2024-09-10T20:40:57.785246+0000","last_active":"2024-09-10T20:40:58.971131+0000","last_peered":"2024-09-10T20:40:58.971131+0000","last_clean":"2024-09-10T20:40:58.971131+0000","last_became_active":"2024-09-10T20:40:57.784969+0000","last_became_peered":"2024-09-10T20:40:57.784969+0000","last_unstale":"2024-09-10T20:40:58.971131+0000","last_undegraded":"2024-09-10T20:40:58.971131+0000","last_fullsized":"2024-09-10T20:40:58.971131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:44.678843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788282+0000","last_change":"2024-09-10T20:40:57.798413+0000","last_active":"2024-09-10T20:40:58.788282+0000","last_peered":"2024-09-10T20:40:58.788282+0000","last_clean":"2024-09-10T20:40:58.788282+0000","last_became_active":"2024-09-10T20:40:57.798085+0000","last_became_peered":"2024-09-10T20:40:57.798085+0000","last_unstale":"2024-09-10T20:40:58.788282+0000","last_undegraded":"2024-09-10T20:40:58.788282+0000","last_fullsized":"2024-09-10T20:40:58.788282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:15.958954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788573+0000","last_change":"2024-09-10T20:40:57.793918+0000","last_active":"2024-09-10T20:40:58.788573+0000","last_peered":"2024-09-10T20:40:58.788573+0000","last_clean":"2024-09-10T20:40:58.788573+0000","last_became_active":"2024-09-10T20:40:57.793335+0000","last_became_peered":"2024-09-10T20:40:57.793335+0000","last_unstale":"2024-09-10T20:40:58.788573+0000","last_undegraded":"2024-09-10T20:40:58.788573+0000","last_fullsized":"2024-09-10T20:40:58.788573+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:20.370552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969945+0000","last_change":"2024-09-10T20:40:57.802056+0000","last_active":"2024-09-10T20:40:58.969945+0000","last_peered":"2024-09-10T20:40:58.969945+0000","last_clean":"2024-09-10T20:40:58.969945+0000","last_became_active":"2024-09-10T20:40:57.801252+0000","last_became_peered":"2024-09-10T20:40:57.801252+0000","last_unstale":"2024-09-10T20:40:58.969945+0000","last_undegraded":"2024-09-10T20:40:58.969945+0000","last_fullsized":"2024-09-10T20:40:58.969945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:43:22.702065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970232+0000","last_change":"2024-09-10T20:40:57.781646+0000","last_active":"2024-09-10T20:40:58.970232+0000","last_peered":"2024-09-10T20:40:58.970232+0000","last_clean":"2024-09-10T20:40:58.970232+0000","last_became_active":"2024-09-10T20:40:57.781350+0000","last_became_peered":"2024-09-10T20:40:57.781350+0000","last_unstale":"2024-09-10T20:40:58.970232+0000","last_undegraded":"2024-09-10T20:40:58.970232+0000","last_fullsized":"2024-09-10T20:40:58.970232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:39.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970560+0000","last_change":"2024-09-10T20:40:57.797129+0000","last_active":"2024-09-10T20:40:58.970560+0000","last_peered":"2024-09-10T20:40:58.970560+0000","last_clean":"2024-09-10T20:40:58.970560+0000","last_became_active":"2024-09-10T20:40:57.796854+0000","last_became_peered":"2024-09-10T20:40:57.796854+0000","last_unstale":"2024-09-10T20:40:58.970560+0000","last_undegraded":"2024-09-10T20:40:58.970560+0000","last_fullsized":"2024-09-10T20:40:58.970560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:04:07.449316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788860+0000","last_change":"2024-09-10T20:40:57.808609+0000","last_active":"2024-09-10T20:40:58.788860+0000","last_peered":"2024-09-10T20:40:58.788860+0000","last_clean":"2024-09-10T20:40:58.788860+0000","last_became_active":"2024-09-10T20:40:57.807999+0000","last_became_peered":"2024-09-10T20:40:57.807999+0000","last_unstale":"2024-09-10T20:40:58.788860+0000","last_undegraded":"2024-09-10T20:40:58.788860+0000","last_fullsized":"2024-09-10T20:40:58.788860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:55:52.365075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970176+0000","last_change":"2024-09-10T20:40:57.802618+0000","last_active":"2024-09-10T20:40:58.970176+0000","last_peered":"2024-09-10T20:40:58.970176+0000","last_clean":"2024-09-10T20:40:58.970176+0000","last_became_active":"2024-09-10T20:40:57.801991+0000","last_became_peered":"2024-09-10T20:40:57.801991+0000","last_unstale":"2024-09-10T20:40:58.970176+0000","last_undegraded":"2024-09-10T20:40:58.970176+0000","last_fullsized":"2024-09-10T20:40:58.970176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:48.162696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971654+0000","last_change":"2024-09-10T20:40:57.805178+0000","last_active":"2024-09-10T20:40:58.971654+0000","last_peered":"2024-09-10T20:40:58.971654+0000","last_clean":"2024-09-10T20:40:58.971654+0000","last_became_active":"2024-09-10T20:40:57.804919+0000","last_became_peered":"2024-09-10T20:40:57.804919+0000","last_unstale":"2024-09-10T20:40:58.971654+0000","last_undegraded":"2024-09-10T20:40:58.971654+0000","last_fullsized":"2024-09-10T20:40:58.971654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:16.263939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971284+0000","last_change":"2024-09-10T20:40:57.797147+0000","last_active":"2024-09-10T20:40:58.971284+0000","last_peered":"2024-09-10T20:40:58.971284+0000","last_clean":"2024-09-10T20:40:58.971284+0000","last_became_active":"2024-09-10T20:40:57.796910+0000","last_became_peered":"2024-09-10T20:40:57.796910+0000","last_unstale":"2024-09-10T20:40:58.971284+0000","last_undegraded":"2024-09-10T20:40:58.971284+0000","last_fullsized":"2024-09-10T20:40:58.971284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:40.968176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970443+0000","last_change":"2024-09-10T20:40:57.804510+0000","last_active":"2024-09-10T20:40:58.970443+0000","last_peered":"2024-09-10T20:40:58.970443+0000","last_clean":"2024-09-10T20:40:58.970443+0000","last_became_active":"2024-09-10T20:40:57.804220+0000","last_became_peered":"2024-09-10T20:40:57.804220+0000","last_unstale":"2024-09-10T20:40:58.970443+0000","last_undegraded":"2024-09-10T20:40:58.970443+0000","last_fullsized":"2024-09-10T20:40:58.970443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:34.652032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971287+0000","last_change":"2024-09-10T20:40:57.795473+0000","last_active":"2024-09-10T20:40:58.971287+0000","last_peered":"2024-09-10T20:40:58.971287+0000","last_clean":"2024-09-10T20:40:58.971287+0000","last_became_active":"2024-09-10T20:40:57.795179+0000","last_became_peered":"2024-09-10T20:40:57.795179+0000","last_unstale":"2024-09-10T20:40:58.971287+0000","last_undegraded":"2024-09-10T20:40:58.971287+0000","last_fullsized":"2024-09-10T20:40:58.971287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:36:25.736401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969498+0000","last_change":"2024-09-10T20:40:57.801649+0000","last_active":"2024-09-10T20:40:58.969498+0000","last_peered":"2024-09-10T20:40:58.969498+0000","last_clean":"2024-09-10T20:40:58.969498+0000","last_became_active":"2024-09-10T20:40:57.797096+0000","last_became_peered":"2024-09-10T20:40:57.797096+0000","last_unstale":"2024-09-10T20:40:58.969498+0000","last_undegraded":"2024-09-10T20:40:58.969498+0000","last_fullsized":"2024-09-10T20:40:58.969498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:55.727449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786486+0000","last_change":"2024-09-10T20:40:57.779842+0000","last_active":"2024-09-10T20:40:58.786486+0000","last_peered":"2024-09-10T20:40:58.786486+0000","last_clean":"2024-09-10T20:40:58.786486+0000","last_became_active":"2024-09-10T20:40:57.779564+0000","last_became_peered":"2024-09-10T20:40:57.779564+0000","last_unstale":"2024-09-10T20:40:58.786486+0000","last_undegraded":"2024-09-10T20:40:58.786486+0000","last_fullsized":"2024-09-10T20:40:58.786486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:19.763721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969870+0000","last_change":"2024-09-10T20:40:57.806288+0000","last_active":"2024-09-10T20:40:58.969870+0000","last_peered":"2024-09-10T20:40:58.969870+0000","last_clean":"2024-09-10T20:40:58.969870+0000","last_became_active":"2024-09-10T20:40:57.804491+0000","last_became_peered":"2024-09-10T20:40:57.804491+0000","last_unstale":"2024-09-10T20:40:58.969870+0000","last_undegraded":"2024-09-10T20:40:58.969870+0000","last_fullsized":"2024-09-10T20:40:58.969870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:04:48.162696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787263+0000","last_change":"2024-09-10T20:40:57.781946+0000","last_active":"2024-09-10T20:40:58.787263+0000","last_peered":"2024-09-10T20:40:58.787263+0000","last_clean":"2024-09-10T20:40:58.787263+0000","last_became_active":"2024-09-10T20:40:57.781711+0000","last_became_peered":"2024-09-10T20:40:57.781711+0000","last_unstale":"2024-09-10T20:40:58.787263+0000","last_undegraded":"2024-09-10T20:40:58.787263+0000","last_fullsized":"2024-09-10T20:40:58.787263+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:49.508741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787072+0000","last_change":"2024-09-10T20:40:57.781131+0000","last_active":"2024-09-10T20:40:58.787072+0000","last_peered":"2024-09-10T20:40:58.787072+0000","last_clean":"2024-09-10T20:40:58.787072+0000","last_became_active":"2024-09-10T20:40:57.780857+0000","last_became_peered":"2024-09-10T20:40:57.780857+0000","last_unstale":"2024-09-10T20:40:58.787072+0000","last_undegraded":"2024-09-10T20:40:58.787072+0000","last_fullsized":"2024-09-10T20:40:58.787072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:25.893234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.802338+0000","last_change":"2024-09-10T20:40:57.799870+0000","last_active":"2024-09-10T20:40:57.802338+0000","last_peered":"2024-09-10T20:40:57.802338+0000","last_clean":"2024-09-10T20:40:57.802338+0000","last_became_active":"2024-09-10T20:40:57.799593+0000","last_became_peered":"2024-09-10T20:40:57.799593+0000","last_unstale":"2024-09-10T20:40:57.802338+0000","last_undegraded":"2024-09-10T20:40:57.802338+0000","last_fullsized":"2024-09-10T20:40:57.802338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:14:43.733854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970928+0000","last_change":"2024-09-10T20:40:57.788576+0000","last_active":"2024-09-10T20:40:58.970928+0000","last_peered":"2024-09-10T20:40:58.970928+0000","last_clean":"2024-09-10T20:40:58.970928+0000","last_became_active":"2024-09-10T20:40:57.788342+0000","last_became_peered":"2024-09-10T20:40:57.788342+0000","last_unstale":"2024-09-10T20:40:58.970928+0000","last_undegraded":"2024-09-10T20:40:58.970928+0000","last_fullsized":"2024-09-10T20:40:58.970928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:14.609649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970892+0000","last_change":"2024-09-10T20:40:57.797333+0000","last_active":"2024-09-10T20:40:58.970892+0000","last_peered":"2024-09-10T20:40:58.970892+0000","last_clean":"2024-09-10T20:40:58.970892+0000","last_became_active":"2024-09-10T20:40:57.794482+0000","last_became_peered":"2024-09-10T20:40:57.794482+0000","last_unstale":"2024-09-10T20:40:58.970892+0000","last_undegraded":"2024-09-10T20:40:58.970892+0000","last_fullsized":"2024-09-10T20:40:58.970892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:19.400396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970269+0000","last_change":"2024-09-10T20:40:57.785890+0000","last_active":"2024-09-10T20:40:58.970269+0000","last_peered":"2024-09-10T20:40:58.970269+0000","last_clean":"2024-09-10T20:40:58.970269+0000","last_became_active":"2024-09-10T20:40:57.785582+0000","last_became_peered":"2024-09-10T20:40:57.785582+0000","last_unstale":"2024-09-10T20:40:58.970269+0000","last_undegraded":"2024-09-10T20:40:58.970269+0000","last_fullsized":"2024-09-10T20:40:58.970269+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:17.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786536+0000","last_change":"2024-09-10T20:40:57.786174+0000","last_active":"2024-09-10T20:40:58.786536+0000","last_peered":"2024-09-10T20:40:58.786536+0000","last_clean":"2024-09-10T20:40:58.786536+0000","last_became_active":"2024-09-10T20:40:57.785175+0000","last_became_peered":"2024-09-10T20:40:57.785175+0000","last_unstale":"2024-09-10T20:40:58.786536+0000","last_undegraded":"2024-09-10T20:40:58.786536+0000","last_fullsized":"2024-09-10T20:40:58.786536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:24.467011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787773+0000","last_change":"2024-09-10T20:40:57.808222+0000","last_active":"2024-09-10T20:40:58.787773+0000","last_peered":"2024-09-10T20:40:58.787773+0000","last_clean":"2024-09-10T20:40:58.787773+0000","last_became_active":"2024-09-10T20:40:57.807578+0000","last_became_peered":"2024-09-10T20:40:57.807578+0000","last_unstale":"2024-09-10T20:40:58.787773+0000","last_undegraded":"2024-09-10T20:40:58.787773+0000","last_fullsized":"2024-09-10T20:40:58.787773+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:22.672592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970103+0000","last_change":"2024-09-10T20:40:57.803089+0000","last_active":"2024-09-10T20:40:58.970103+0000","last_peered":"2024-09-10T20:40:58.970103+0000","last_clean":"2024-09-10T20:40:58.970103+0000","last_became_active":"2024-09-10T20:40:57.802606+0000","last_became_peered":"2024-09-10T20:40:57.802606+0000","last_unstale":"2024-09-10T20:40:58.970103+0000","last_undegraded":"2024-09-10T20:40:58.970103+0000","last_fullsized":"2024-09-10T20:40:58.970103+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:13.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788236+0000","last_change":"2024-09-10T20:40:57.804633+0000","last_active":"2024-09-10T20:40:58.788236+0000","last_peered":"2024-09-10T20:40:58.788236+0000","last_clean":"2024-09-10T20:40:58.788236+0000","last_became_active":"2024-09-10T20:40:57.804388+0000","last_became_peered":"2024-09-10T20:40:57.804388+0000","last_unstale":"2024-09-10T20:40:58.788236+0000","last_undegraded":"2024-09-10T20:40:58.788236+0000","last_fullsized":"2024-09-10T20:40:58.788236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:29.475021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971490+0000","last_change":"2024-09-10T20:40:57.790304+0000","last_active":"2024-09-10T20:40:58.971490+0000","last_peered":"2024-09-10T20:40:58.971490+0000","last_clean":"2024-09-10T20:40:58.971490+0000","last_became_active":"2024-09-10T20:40:57.790064+0000","last_became_peered":"2024-09-10T20:40:57.790064+0000","last_unstale":"2024-09-10T20:40:58.971490+0000","last_undegraded":"2024-09-10T20:40:58.971490+0000","last_fullsized":"2024-09-10T20:40:58.971490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:59.893364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971898+0000","last_change":"2024-09-10T20:40:57.811854+0000","last_active":"2024-09-10T20:40:58.971898+0000","last_peered":"2024-09-10T20:40:58.971898+0000","last_clean":"2024-09-10T20:40:58.971898+0000","last_became_active":"2024-09-10T20:40:57.811532+0000","last_became_peered":"2024-09-10T20:40:57.811532+0000","last_unstale":"2024-09-10T20:40:58.971898+0000","last_undegraded":"2024-09-10T20:40:58.971898+0000","last_fullsized":"2024-09-10T20:40:58.971898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:14.298794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786782+0000","last_change":"2024-09-10T20:40:57.783995+0000","last_active":"2024-09-10T20:40:58.786782+0000","last_peered":"2024-09-10T20:40:58.786782+0000","last_clean":"2024-09-10T20:40:58.786782+0000","last_became_active":"2024-09-10T20:40:57.782195+0000","last_became_peered":"2024-09-10T20:40:57.782195+0000","last_unstale":"2024-09-10T20:40:58.786782+0000","last_undegraded":"2024-09-10T20:40:58.786782+0000","last_fullsized":"2024-09-10T20:40:58.786782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:35.070564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786926+0000","last_change":"2024-09-10T20:40:57.778945+0000","last_active":"2024-09-10T20:40:58.786926+0000","last_peered":"2024-09-10T20:40:58.786926+0000","last_clean":"2024-09-10T20:40:58.786926+0000","last_became_active":"2024-09-10T20:40:57.778659+0000","last_became_peered":"2024-09-10T20:40:57.778659+0000","last_unstale":"2024-09-10T20:40:58.786926+0000","last_undegraded":"2024-09-10T20:40:58.786926+0000","last_fullsized":"2024-09-10T20:40:58.786926+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:12.740619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970755+0000","last_change":"2024-09-10T20:40:57.796477+0000","last_active":"2024-09-10T20:40:58.970755+0000","last_peered":"2024-09-10T20:40:58.970755+0000","last_clean":"2024-09-10T20:40:58.970755+0000","last_became_active":"2024-09-10T20:40:57.796191+0000","last_became_peered":"2024-09-10T20:40:57.796191+0000","last_unstale":"2024-09-10T20:40:58.970755+0000","last_undegraded":"2024-09-10T20:40:58.970755+0000","last_fullsized":"2024-09-10T20:40:58.970755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:29.160217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787979+0000","last_change":"2024-09-10T20:40:57.813103+0000","last_active":"2024-09-10T20:40:58.787979+0000","last_peered":"2024-09-10T20:40:58.787979+0000","last_clean":"2024-09-10T20:40:58.787979+0000","last_became_active":"2024-09-10T20:40:57.812863+0000","last_became_peered":"2024-09-10T20:40:57.812863+0000","last_unstale":"2024-09-10T20:40:58.787979+0000","last_undegraded":"2024-09-10T20:40:58.787979+0000","last_fullsized":"2024-09-10T20:40:58.787979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.959912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786971+0000","last_change":"2024-09-10T20:40:57.806845+0000","last_active":"2024-09-10T20:40:58.786971+0000","last_peered":"2024-09-10T20:40:58.786971+0000","last_clean":"2024-09-10T20:40:58.786971+0000","last_became_active":"2024-09-10T20:40:57.806562+0000","last_became_peered":"2024-09-10T20:40:57.806562+0000","last_unstale":"2024-09-10T20:40:58.786971+0000","last_undegraded":"2024-09-10T20:40:58.786971+0000","last_fullsized":"2024-09-10T20:40:58.786971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970157+0000","last_change":"2024-09-10T20:40:56.787360+0000","last_active":"2024-09-10T20:40:58.970157+0000","last_peered":"2024-09-10T20:40:58.970157+0000","last_clean":"2024-09-10T20:40:58.970157+0000","last_became_active":"2024-09-10T20:40:56.787113+0000","last_became_peered":"2024-09-10T20:40:56.787113+0000","last_unstale":"2024-09-10T20:40:58.970157+0000","last_undegraded":"2024-09-10T20:40:58.970157+0000","last_fullsized":"2024-09-10T20:40:58.970157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970733+0000","last_change":"2024-09-10T20:40:57.794642+0000","last_active":"2024-09-10T20:40:58.970733+0000","last_peered":"2024-09-10T20:40:58.970733+0000","last_clean":"2024-09-10T20:40:58.970733+0000","last_became_active":"2024-09-10T20:40:57.794432+0000","last_became_peered":"2024-09-10T20:40:57.794432+0000","last_unstale":"2024-09-10T20:40:58.970733+0000","last_undegraded":"2024-09-10T20:40:58.970733+0000","last_fullsized":"2024-09-10T20:40:58.970733+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:40.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971141+0000","last_change":"2024-09-10T20:40:56.790001+0000","last_active":"2024-09-10T20:40:58.971141+0000","last_peered":"2024-09-10T20:40:58.971141+0000","last_clean":"2024-09-10T20:40:58.971141+0000","last_became_active":"2024-09-10T20:40:56.789708+0000","last_became_peered":"2024-09-10T20:40:56.789708+0000","last_unstale":"2024-09-10T20:40:58.971141+0000","last_undegraded":"2024-09-10T20:40:58.971141+0000","last_fullsized":"2024-09-10T20:40:58.971141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:56.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787299+0000","last_change":"2024-09-10T20:40:57.804223+0000","last_active":"2024-09-10T20:40:58.787299+0000","last_peered":"2024-09-10T20:40:58.787299+0000","last_clean":"2024-09-10T20:40:58.787299+0000","last_became_active":"2024-09-10T20:40:57.800934+0000","last_became_peered":"2024-09-10T20:40:57.800934+0000","last_unstale":"2024-09-10T20:40:58.787299+0000","last_undegraded":"2024-09-10T20:40:58.787299+0000","last_fullsized":"2024-09-10T20:40:58.787299+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:35.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788547+0000","last_change":"2024-09-10T20:40:56.798617+0000","last_active":"2024-09-10T20:40:58.788547+0000","last_peered":"2024-09-10T20:40:58.788547+0000","last_clean":"2024-09-10T20:40:58.788547+0000","last_became_active":"2024-09-10T20:40:56.798233+0000","last_became_peered":"2024-09-10T20:40:56.798233+0000","last_unstale":"2024-09-10T20:40:58.788547+0000","last_undegraded":"2024-09-10T20:40:58.788547+0000","last_fullsized":"2024-09-10T20:40:58.788547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:55.548605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971268+0000","last_change":"2024-09-10T20:40:57.790493+0000","last_active":"2024-09-10T20:40:58.971268+0000","last_peered":"2024-09-10T20:40:58.971268+0000","last_clean":"2024-09-10T20:40:58.971268+0000","last_became_active":"2024-09-10T20:40:57.789768+0000","last_became_peered":"2024-09-10T20:40:57.789768+0000","last_unstale":"2024-09-10T20:40:58.971268+0000","last_undegraded":"2024-09-10T20:40:58.971268+0000","last_fullsized":"2024-09-10T20:40:58.971268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:06.104237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969991+0000","last_change":"2024-09-10T20:40:56.798645+0000","last_active":"2024-09-10T20:40:58.969991+0000","last_peered":"2024-09-10T20:40:58.969991+0000","last_clean":"2024-09-10T20:40:58.969991+0000","last_became_active":"2024-09-10T20:40:56.798325+0000","last_became_peered":"2024-09-10T20:40:56.798325+0000","last_unstale":"2024-09-10T20:40:58.969991+0000","last_undegraded":"2024-09-10T20:40:58.969991+0000","last_fullsized":"2024-09-10T20:40:58.969991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:18.678416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789168+0000","last_change":"2024-09-10T20:40:57.792035+0000","last_active":"2024-09-10T20:40:58.789168+0000","last_peered":"2024-09-10T20:40:58.789168+0000","last_clean":"2024-09-10T20:40:58.789168+0000","last_became_active":"2024-09-10T20:40:57.791743+0000","last_became_peered":"2024-09-10T20:40:57.791743+0000","last_unstale":"2024-09-10T20:40:58.789168+0000","last_undegraded":"2024-09-10T20:40:58.789168+0000","last_fullsized":"2024-09-10T20:40:58.789168+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:51:17.466229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969960+0000","last_change":"2024-09-10T20:40:56.778488+0000","last_active":"2024-09-10T20:40:58.969960+0000","last_peered":"2024-09-10T20:40:58.969960+0000","last_clean":"2024-09-10T20:40:58.969960+0000","last_became_active":"2024-09-10T20:40:56.778241+0000","last_became_peered":"2024-09-10T20:40:56.778241+0000","last_unstale":"2024-09-10T20:40:58.969960+0000","last_undegraded":"2024-09-10T20:40:58.969960+0000","last_fullsized":"2024-09-10T20:40:58.969960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969999+0000","last_change":"2024-09-10T20:40:57.787640+0000","last_active":"2024-09-10T20:40:58.969999+0000","last_peered":"2024-09-10T20:40:58.969999+0000","last_clean":"2024-09-10T20:40:58.969999+0000","last_became_active":"2024-09-10T20:40:57.787374+0000","last_became_peered":"2024-09-10T20:40:57.787374+0000","last_unstale":"2024-09-10T20:40:58.969999+0000","last_undegraded":"2024-09-10T20:40:58.969999+0000","last_fullsized":"2024-09-10T20:40:58.969999+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:47.135269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971394+0000","last_change":"2024-09-10T20:40:56.799544+0000","last_active":"2024-09-10T20:40:58.971394+0000","last_peered":"2024-09-10T20:40:58.971394+0000","last_clean":"2024-09-10T20:40:58.971394+0000","last_became_active":"2024-09-10T20:40:56.799273+0000","last_became_peered":"2024-09-10T20:40:56.799273+0000","last_unstale":"2024-09-10T20:40:58.971394+0000","last_undegraded":"2024-09-10T20:40:58.971394+0000","last_fullsized":"2024-09-10T20:40:58.971394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:24.776937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786647+0000","last_change":"2024-09-10T20:40:57.790412+0000","last_active":"2024-09-10T20:40:58.786647+0000","last_peered":"2024-09-10T20:40:58.786647+0000","last_clean":"2024-09-10T20:40:58.786647+0000","last_became_active":"2024-09-10T20:40:57.788308+0000","last_became_peered":"2024-09-10T20:40:57.788308+0000","last_unstale":"2024-09-10T20:40:58.786647+0000","last_undegraded":"2024-09-10T20:40:58.786647+0000","last_fullsized":"2024-09-10T20:40:58.786647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:51:31.799493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788463+0000","last_change":"2024-09-10T20:40:56.795211+0000","last_active":"2024-09-10T20:40:58.788463+0000","last_peered":"2024-09-10T20:40:58.788463+0000","last_clean":"2024-09-10T20:40:58.788463+0000","last_became_active":"2024-09-10T20:40:56.794869+0000","last_became_peered":"2024-09-10T20:40:56.794869+0000","last_unstale":"2024-09-10T20:40:58.788463+0000","last_undegraded":"2024-09-10T20:40:58.788463+0000","last_fullsized":"2024-09-10T20:40:58.788463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:54.724711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970909+0000","last_change":"2024-09-10T20:40:57.799569+0000","last_active":"2024-09-10T20:40:58.970909+0000","last_peered":"2024-09-10T20:40:58.970909+0000","last_clean":"2024-09-10T20:40:58.970909+0000","last_became_active":"2024-09-10T20:40:57.799219+0000","last_became_peered":"2024-09-10T20:40:57.799219+0000","last_unstale":"2024-09-10T20:40:58.970909+0000","last_undegraded":"2024-09-10T20:40:58.970909+0000","last_fullsized":"2024-09-10T20:40:58.970909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:14.095093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971061+0000","last_change":"2024-09-10T20:40:56.779639+0000","last_active":"2024-09-10T20:40:58.971061+0000","last_peered":"2024-09-10T20:40:58.971061+0000","last_clean":"2024-09-10T20:40:58.971061+0000","last_became_active":"2024-09-10T20:40:56.779311+0000","last_became_peered":"2024-09-10T20:40:56.779311+0000","last_unstale":"2024-09-10T20:40:58.971061+0000","last_undegraded":"2024-09-10T20:40:58.971061+0000","last_fullsized":"2024-09-10T20:40:58.971061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:39.771929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788723+0000","last_change":"2024-09-10T20:40:57.793647+0000","last_active":"2024-09-10T20:40:58.788723+0000","last_peered":"2024-09-10T20:40:58.788723+0000","last_clean":"2024-09-10T20:40:58.788723+0000","last_became_active":"2024-09-10T20:40:57.792950+0000","last_became_peered":"2024-09-10T20:40:57.792950+0000","last_unstale":"2024-09-10T20:40:58.788723+0000","last_undegraded":"2024-09-10T20:40:58.788723+0000","last_fullsized":"2024-09-10T20:40:58.788723+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:46.140416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788911+0000","last_change":"2024-09-10T20:40:56.799456+0000","last_active":"2024-09-10T20:40:58.788911+0000","last_peered":"2024-09-10T20:40:58.788911+0000","last_clean":"2024-09-10T20:40:58.788911+0000","last_became_active":"2024-09-10T20:40:56.799162+0000","last_became_peered":"2024-09-10T20:40:56.799162+0000","last_unstale":"2024-09-10T20:40:58.788911+0000","last_undegraded":"2024-09-10T20:40:58.788911+0000","last_fullsized":"2024-09-10T20:40:58.788911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:44.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970236+0000","last_change":"2024-09-10T20:40:57.802645+0000","last_active":"2024-09-10T20:40:58.970236+0000","last_peered":"2024-09-10T20:40:58.970236+0000","last_clean":"2024-09-10T20:40:58.970236+0000","last_became_active":"2024-09-10T20:40:57.802283+0000","last_became_peered":"2024-09-10T20:40:57.802283+0000","last_unstale":"2024-09-10T20:40:58.970236+0000","last_undegraded":"2024-09-10T20:40:58.970236+0000","last_fullsized":"2024-09-10T20:40:58.970236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:57.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787011+0000","last_change":"2024-09-10T20:40:56.787551+0000","last_active":"2024-09-10T20:40:58.787011+0000","last_peered":"2024-09-10T20:40:58.787011+0000","last_clean":"2024-09-10T20:40:58.787011+0000","last_became_active":"2024-09-10T20:40:56.786720+0000","last_became_peered":"2024-09-10T20:40:56.786720+0000","last_unstale":"2024-09-10T20:40:58.787011+0000","last_undegraded":"2024-09-10T20:40:58.787011+0000","last_fullsized":"2024-09-10T20:40:58.787011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:58.890626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788499+0000","last_change":"2024-09-10T20:40:57.805104+0000","last_active":"2024-09-10T20:40:58.788499+0000","last_peered":"2024-09-10T20:40:58.788499+0000","last_clean":"2024-09-10T20:40:58.788499+0000","last_became_active":"2024-09-10T20:40:57.804894+0000","last_became_peered":"2024-09-10T20:40:57.804894+0000","last_unstale":"2024-09-10T20:40:58.788499+0000","last_undegraded":"2024-09-10T20:40:58.788499+0000","last_fullsized":"2024-09-10T20:40:58.788499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:36.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786727+0000","last_change":"2024-09-10T20:40:56.798785+0000","last_active":"2024-09-10T20:40:58.786727+0000","last_peered":"2024-09-10T20:40:58.786727+0000","last_clean":"2024-09-10T20:40:58.786727+0000","last_became_active":"2024-09-10T20:40:56.798390+0000","last_became_peered":"2024-09-10T20:40:56.798390+0000","last_unstale":"2024-09-10T20:40:58.786727+0000","last_undegraded":"2024-09-10T20:40:58.786727+0000","last_fullsized":"2024-09-10T20:40:58.786727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:39.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971906+0000","last_change":"2024-09-10T20:40:57.807154+0000","last_active":"2024-09-10T20:40:58.971906+0000","last_peered":"2024-09-10T20:40:58.971906+0000","last_clean":"2024-09-10T20:40:58.971906+0000","last_became_active":"2024-09-10T20:40:57.806970+0000","last_became_peered":"2024-09-10T20:40:57.806970+0000","last_unstale":"2024-09-10T20:40:58.971906+0000","last_undegraded":"2024-09-10T20:40:58.971906+0000","last_fullsized":"2024-09-10T20:40:58.971906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:18.292524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788691+0000","last_change":"2024-09-10T20:40:56.798461+0000","last_active":"2024-09-10T20:40:58.788691+0000","last_peered":"2024-09-10T20:40:58.788691+0000","last_clean":"2024-09-10T20:40:58.788691+0000","last_became_active":"2024-09-10T20:40:56.798136+0000","last_became_peered":"2024-09-10T20:40:56.798136+0000","last_unstale":"2024-09-10T20:40:58.788691+0000","last_undegraded":"2024-09-10T20:40:58.788691+0000","last_fullsized":"2024-09-10T20:40:58.788691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:08.271880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788980+0000","last_change":"2024-09-10T20:40:57.800593+0000","last_active":"2024-09-10T20:40:58.788980+0000","last_peered":"2024-09-10T20:40:58.788980+0000","last_clean":"2024-09-10T20:40:58.788980+0000","last_became_active":"2024-09-10T20:40:57.796067+0000","last_became_peered":"2024-09-10T20:40:57.796067+0000","last_unstale":"2024-09-10T20:40:58.788980+0000","last_undegraded":"2024-09-10T20:40:58.788980+0000","last_fullsized":"2024-09-10T20:40:58.788980+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:33:08.647327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789473+0000","last_change":"2024-09-10T20:40:56.798892+0000","last_active":"2024-09-10T20:40:58.789473+0000","last_peered":"2024-09-10T20:40:58.789473+0000","last_clean":"2024-09-10T20:40:58.789473+0000","last_became_active":"2024-09-10T20:40:56.798574+0000","last_became_peered":"2024-09-10T20:40:56.798574+0000","last_unstale":"2024-09-10T20:40:58.789473+0000","last_undegraded":"2024-09-10T20:40:58.789473+0000","last_fullsized":"2024-09-10T20:40:58.789473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:12.809899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970283+0000","last_change":"2024-09-10T20:40:57.789344+0000","last_active":"2024-09-10T20:40:58.970283+0000","last_peered":"2024-09-10T20:40:58.970283+0000","last_clean":"2024-09-10T20:40:58.970283+0000","last_became_active":"2024-09-10T20:40:57.789092+0000","last_became_peered":"2024-09-10T20:40:57.789092+0000","last_unstale":"2024-09-10T20:40:58.970283+0000","last_undegraded":"2024-09-10T20:40:58.970283+0000","last_fullsized":"2024-09-10T20:40:58.970283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:34.267791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970301+0000","last_change":"2024-09-10T20:40:56.787899+0000","last_active":"2024-09-10T20:40:58.970301+0000","last_peered":"2024-09-10T20:40:58.970301+0000","last_clean":"2024-09-10T20:40:58.970301+0000","last_became_active":"2024-09-10T20:40:56.787509+0000","last_became_peered":"2024-09-10T20:40:56.787509+0000","last_unstale":"2024-09-10T20:40:58.970301+0000","last_undegraded":"2024-09-10T20:40:58.970301+0000","last_fullsized":"2024-09-10T20:40:58.970301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.249527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970581+0000","last_change":"2024-09-10T20:40:57.786588+0000","last_active":"2024-09-10T20:40:58.970581+0000","last_peered":"2024-09-10T20:40:58.970581+0000","last_clean":"2024-09-10T20:40:58.970581+0000","last_became_active":"2024-09-10T20:40:57.786296+0000","last_became_peered":"2024-09-10T20:40:57.786296+0000","last_unstale":"2024-09-10T20:40:58.970581+0000","last_undegraded":"2024-09-10T20:40:58.970581+0000","last_fullsized":"2024-09-10T20:40:58.970581+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:23.141364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786592+0000","last_change":"2024-09-10T20:40:56.783758+0000","last_active":"2024-09-10T20:40:58.786592+0000","last_peered":"2024-09-10T20:40:58.786592+0000","last_clean":"2024-09-10T20:40:58.786592+0000","last_became_active":"2024-09-10T20:40:56.783512+0000","last_became_peered":"2024-09-10T20:40:56.783512+0000","last_unstale":"2024-09-10T20:40:58.786592+0000","last_undegraded":"2024-09-10T20:40:58.786592+0000","last_fullsized":"2024-09-10T20:40:58.786592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:39.374632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970386+0000","last_change":"2024-09-10T20:40:57.801745+0000","last_active":"2024-09-10T20:40:58.970386+0000","last_peered":"2024-09-10T20:40:58.970386+0000","last_clean":"2024-09-10T20:40:58.970386+0000","last_became_active":"2024-09-10T20:40:57.801484+0000","last_became_peered":"2024-09-10T20:40:57.801484+0000","last_unstale":"2024-09-10T20:40:58.970386+0000","last_undegraded":"2024-09-10T20:40:58.970386+0000","last_fullsized":"2024-09-10T20:40:58.970386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:03:47.239308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969373+0000","last_change":"2024-09-10T20:40:56.779692+0000","last_active":"2024-09-10T20:40:58.969373+0000","last_peered":"2024-09-10T20:40:58.969373+0000","last_clean":"2024-09-10T20:40:58.969373+0000","last_became_active":"2024-09-10T20:40:56.779447+0000","last_became_peered":"2024-09-10T20:40:56.779447+0000","last_unstale":"2024-09-10T20:40:58.969373+0000","last_undegraded":"2024-09-10T20:40:58.969373+0000","last_fullsized":"2024-09-10T20:40:58.969373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:15.261201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970671+0000","last_change":"2024-09-10T20:40:57.795777+0000","last_active":"2024-09-10T20:40:58.970671+0000","last_peered":"2024-09-10T20:40:58.970671+0000","last_clean":"2024-09-10T20:40:58.970671+0000","last_became_active":"2024-09-10T20:40:57.795521+0000","last_became_peered":"2024-09-10T20:40:57.795521+0000","last_unstale":"2024-09-10T20:40:58.970671+0000","last_undegraded":"2024-09-10T20:40:58.970671+0000","last_fullsized":"2024-09-10T20:40:58.970671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971848+0000","last_change":"2024-09-10T20:40:56.792708+0000","last_active":"2024-09-10T20:40:58.971848+0000","last_peered":"2024-09-10T20:40:58.971848+0000","last_clean":"2024-09-10T20:40:58.971848+0000","last_became_active":"2024-09-10T20:40:56.792427+0000","last_became_peered":"2024-09-10T20:40:56.792427+0000","last_unstale":"2024-09-10T20:40:58.971848+0000","last_undegraded":"2024-09-10T20:40:58.971848+0000","last_fullsized":"2024-09-10T20:40:58.971848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:40.781428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971958+0000","last_change":"2024-09-10T20:40:57.805292+0000","last_active":"2024-09-10T20:40:58.971958+0000","last_peered":"2024-09-10T20:40:58.971958+0000","last_clean":"2024-09-10T20:40:58.971958+0000","last_became_active":"2024-09-10T20:40:57.804999+0000","last_became_peered":"2024-09-10T20:40:57.804999+0000","last_unstale":"2024-09-10T20:40:58.971958+0000","last_undegraded":"2024-09-10T20:40:58.971958+0000","last_fullsized":"2024-09-10T20:40:58.971958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:43.458885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787141+0000","last_change":"2024-09-10T20:40:56.798769+0000","last_active":"2024-09-10T20:40:58.787141+0000","last_peered":"2024-09-10T20:40:58.787141+0000","last_clean":"2024-09-10T20:40:58.787141+0000","last_became_active":"2024-09-10T20:40:56.798317+0000","last_became_peered":"2024-09-10T20:40:56.798317+0000","last_unstale":"2024-09-10T20:40:58.787141+0000","last_undegraded":"2024-09-10T20:40:58.787141+0000","last_fullsized":"2024-09-10T20:40:58.787141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:25.510395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971802+0000","last_change":"2024-09-10T20:40:57.795506+0000","last_active":"2024-09-10T20:40:58.971802+0000","last_peered":"2024-09-10T20:40:58.971802+0000","last_clean":"2024-09-10T20:40:58.971802+0000","last_became_active":"2024-09-10T20:40:57.795238+0000","last_became_peered":"2024-09-10T20:40:57.795238+0000","last_unstale":"2024-09-10T20:40:58.971802+0000","last_undegraded":"2024-09-10T20:40:58.971802+0000","last_fullsized":"2024-09-10T20:40:58.971802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:19.681154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969639+0000","last_change":"2024-09-10T20:40:56.792843+0000","last_active":"2024-09-10T20:40:58.969639+0000","last_peered":"2024-09-10T20:40:58.969639+0000","last_clean":"2024-09-10T20:40:58.969639+0000","last_became_active":"2024-09-10T20:40:56.792439+0000","last_became_peered":"2024-09-10T20:40:56.792439+0000","last_unstale":"2024-09-10T20:40:58.969639+0000","last_undegraded":"2024-09-10T20:40:58.969639+0000","last_fullsized":"2024-09-10T20:40:58.969639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:49.054542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.800595+0000","last_change":"2024-09-10T20:40:57.798663+0000","last_active":"2024-09-10T20:40:57.800595+0000","last_peered":"2024-09-10T20:40:57.800595+0000","last_clean":"2024-09-10T20:40:57.800595+0000","last_became_active":"2024-09-10T20:40:57.798333+0000","last_became_peered":"2024-09-10T20:40:57.798333+0000","last_unstale":"2024-09-10T20:40:57.800595+0000","last_undegraded":"2024-09-10T20:40:57.800595+0000","last_fullsized":"2024-09-10T20:40:57.800595+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:49.867232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.775151+0000","last_change":"2024-09-10T20:40:56.789841+0000","last_active":"2024-09-10T20:40:57.775151+0000","last_peered":"2024-09-10T20:40:57.775151+0000","last_clean":"2024-09-10T20:40:57.775151+0000","last_became_active":"2024-09-10T20:40:56.789524+0000","last_became_peered":"2024-09-10T20:40:56.789524+0000","last_unstale":"2024-09-10T20:40:57.775151+0000","last_undegraded":"2024-09-10T20:40:57.775151+0000","last_fullsized":"2024-09-10T20:40:57.775151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:06.139874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786504+0000","last_change":"2024-09-10T20:40:57.779901+0000","last_active":"2024-09-10T20:40:58.786504+0000","last_peered":"2024-09-10T20:40:58.786504+0000","last_clean":"2024-09-10T20:40:58.786504+0000","last_became_active":"2024-09-10T20:40:57.779489+0000","last_became_peered":"2024-09-10T20:40:57.779489+0000","last_unstale":"2024-09-10T20:40:58.786504+0000","last_undegraded":"2024-09-10T20:40:58.786504+0000","last_fullsized":"2024-09-10T20:40:58.786504+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:18.624203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.805985+0000","last_change":"2024-09-10T20:40:56.787107+0000","last_active":"2024-09-10T20:40:57.805985+0000","last_peered":"2024-09-10T20:40:57.805985+0000","last_clean":"2024-09-10T20:40:57.805985+0000","last_became_active":"2024-09-10T20:40:56.786778+0000","last_became_peered":"2024-09-10T20:40:56.786778+0000","last_unstale":"2024-09-10T20:40:57.805985+0000","last_undegraded":"2024-09-10T20:40:57.805985+0000","last_fullsized":"2024-09-10T20:40:57.805985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:21.098826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.788497+0000","last_change":"2024-09-10T20:40:57.805036+0000","last_active":"2024-09-10T20:40:58.788497+0000","last_peered":"2024-09-10T20:40:58.788497+0000","last_clean":"2024-09-10T20:40:58.788497+0000","last_became_active":"2024-09-10T20:40:57.804826+0000","last_became_peered":"2024-09-10T20:40:57.804826+0000","last_unstale":"2024-09-10T20:40:58.788497+0000","last_undegraded":"2024-09-10T20:40:58.788497+0000","last_fullsized":"2024-09-10T20:40:58.788497+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.004069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970377+0000","last_change":"2024-09-10T20:40:56.792580+0000","last_active":"2024-09-10T20:40:58.970377+0000","last_peered":"2024-09-10T20:40:58.970377+0000","last_clean":"2024-09-10T20:40:58.970377+0000","last_became_active":"2024-09-10T20:40:56.792296+0000","last_became_peered":"2024-09-10T20:40:56.792296+0000","last_unstale":"2024-09-10T20:40:58.970377+0000","last_undegraded":"2024-09-10T20:40:58.970377+0000","last_fullsized":"2024-09-10T20:40:58.970377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:34.728794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971014+0000","last_change":"2024-09-10T20:40:57.798757+0000","last_active":"2024-09-10T20:40:58.971014+0000","last_peered":"2024-09-10T20:40:58.971014+0000","last_clean":"2024-09-10T20:40:58.971014+0000","last_became_active":"2024-09-10T20:40:57.796635+0000","last_became_peered":"2024-09-10T20:40:57.796635+0000","last_unstale":"2024-09-10T20:40:58.971014+0000","last_undegraded":"2024-09-10T20:40:58.971014+0000","last_fullsized":"2024-09-10T20:40:58.971014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:56.551343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970814+0000","last_change":"2024-09-10T20:40:56.779612+0000","last_active":"2024-09-10T20:40:58.970814+0000","last_peered":"2024-09-10T20:40:58.970814+0000","last_clean":"2024-09-10T20:40:58.970814+0000","last_became_active":"2024-09-10T20:40:56.779319+0000","last_became_peered":"2024-09-10T20:40:56.779319+0000","last_unstale":"2024-09-10T20:40:58.970814+0000","last_undegraded":"2024-09-10T20:40:58.970814+0000","last_fullsized":"2024-09-10T20:40:58.970814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:20.129458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789658+0000","last_change":"2024-09-10T20:40:57.794987+0000","last_active":"2024-09-10T20:40:58.789658+0000","last_peered":"2024-09-10T20:40:58.789658+0000","last_clean":"2024-09-10T20:40:58.789658+0000","last_became_active":"2024-09-10T20:40:57.794701+0000","last_became_peered":"2024-09-10T20:40:57.794701+0000","last_unstale":"2024-09-10T20:40:58.789658+0000","last_undegraded":"2024-09-10T20:40:58.789658+0000","last_fullsized":"2024-09-10T20:40:58.789658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:19.763721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969666+0000","last_change":"2024-09-10T20:40:56.796619+0000","last_active":"2024-09-10T20:40:58.969666+0000","last_peered":"2024-09-10T20:40:58.969666+0000","last_clean":"2024-09-10T20:40:58.969666+0000","last_became_active":"2024-09-10T20:40:56.796334+0000","last_became_peered":"2024-09-10T20:40:56.796334+0000","last_unstale":"2024-09-10T20:40:58.969666+0000","last_undegraded":"2024-09-10T20:40:58.969666+0000","last_fullsized":"2024-09-10T20:40:58.969666+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:18.035879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970154+0000","last_change":"2024-09-10T20:40:57.797064+0000","last_active":"2024-09-10T20:40:58.970154+0000","last_peered":"2024-09-10T20:40:58.970154+0000","last_clean":"2024-09-10T20:40:58.970154+0000","last_became_active":"2024-09-10T20:40:57.796778+0000","last_became_peered":"2024-09-10T20:40:57.796778+0000","last_unstale":"2024-09-10T20:40:58.970154+0000","last_undegraded":"2024-09-10T20:40:58.970154+0000","last_fullsized":"2024-09-10T20:40:58.970154+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:15.851683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787324+0000","last_change":"2024-09-10T20:40:56.781802+0000","last_active":"2024-09-10T20:40:58.787324+0000","last_peered":"2024-09-10T20:40:58.787324+0000","last_clean":"2024-09-10T20:40:58.787324+0000","last_became_active":"2024-09-10T20:40:56.781430+0000","last_became_peered":"2024-09-10T20:40:56.781430+0000","last_unstale":"2024-09-10T20:40:58.787324+0000","last_undegraded":"2024-09-10T20:40:58.787324+0000","last_fullsized":"2024-09-10T20:40:58.787324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:52.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971437+0000","last_change":"2024-09-10T20:40:57.797088+0000","last_active":"2024-09-10T20:40:58.971437+0000","last_peered":"2024-09-10T20:40:58.971437+0000","last_clean":"2024-09-10T20:40:58.971437+0000","last_became_active":"2024-09-10T20:40:57.796516+0000","last_became_peered":"2024-09-10T20:40:57.796516+0000","last_unstale":"2024-09-10T20:40:58.971437+0000","last_undegraded":"2024-09-10T20:40:58.971437+0000","last_fullsized":"2024-09-10T20:40:58.971437+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:53.214686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970405+0000","last_change":"2024-09-10T20:40:56.792746+0000","last_active":"2024-09-10T20:40:58.970405+0000","last_peered":"2024-09-10T20:40:58.970405+0000","last_clean":"2024-09-10T20:40:58.970405+0000","last_became_active":"2024-09-10T20:40:56.792409+0000","last_became_peered":"2024-09-10T20:40:56.792409+0000","last_unstale":"2024-09-10T20:40:58.970405+0000","last_undegraded":"2024-09-10T20:40:58.970405+0000","last_fullsized":"2024-09-10T20:40:58.970405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:11.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-10T20:40:57.787730+0000","last_change":"2024-09-10T20:40:57.780255+0000","last_active":"2024-09-10T20:40:57.787730+0000","last_peered":"2024-09-10T20:40:57.787730+0000","last_clean":"2024-09-10T20:40:57.787730+0000","last_became_active":"2024-09-10T20:40:57.779962+0000","last_became_peered":"2024-09-10T20:40:57.779962+0000","last_unstale":"2024-09-10T20:40:57.787730+0000","last_undegraded":"2024-09-10T20:40:57.787730+0000","last_fullsized":"2024-09-10T20:40:57.787730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:18:35.983774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.969923+0000","last_change":"2024-09-10T20:40:56.800962+0000","last_active":"2024-09-10T20:40:58.969923+0000","last_peered":"2024-09-10T20:40:58.969923+0000","last_clean":"2024-09-10T20:40:58.969923+0000","last_became_active":"2024-09-10T20:40:56.800727+0000","last_became_peered":"2024-09-10T20:40:56.800727+0000","last_unstale":"2024-09-10T20:40:58.969923+0000","last_undegraded":"2024-09-10T20:40:58.969923+0000","last_fullsized":"2024-09-10T20:40:58.969923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:52.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970256+0000","last_change":"2024-09-10T20:40:57.793540+0000","last_active":"2024-09-10T20:40:58.970256+0000","last_peered":"2024-09-10T20:40:58.970256+0000","last_clean":"2024-09-10T20:40:58.970256+0000","last_became_active":"2024-09-10T20:40:57.793231+0000","last_became_peered":"2024-09-10T20:40:57.793231+0000","last_unstale":"2024-09-10T20:40:58.970256+0000","last_undegraded":"2024-09-10T20:40:58.970256+0000","last_fullsized":"2024-09-10T20:40:58.970256+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:01.359250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789708+0000","last_change":"2024-09-10T20:40:56.795661+0000","last_active":"2024-09-10T20:40:58.789708+0000","last_peered":"2024-09-10T20:40:58.789708+0000","last_clean":"2024-09-10T20:40:58.789708+0000","last_became_active":"2024-09-10T20:40:56.794893+0000","last_became_peered":"2024-09-10T20:40:56.794893+0000","last_unstale":"2024-09-10T20:40:58.789708+0000","last_undegraded":"2024-09-10T20:40:58.789708+0000","last_fullsized":"2024-09-10T20:40:58.789708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:56.476490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970166+0000","last_change":"2024-09-10T20:40:57.777674+0000","last_active":"2024-09-10T20:40:58.970166+0000","last_peered":"2024-09-10T20:40:58.970166+0000","last_clean":"2024-09-10T20:40:58.970166+0000","last_became_active":"2024-09-10T20:40:57.776652+0000","last_became_peered":"2024-09-10T20:40:57.776652+0000","last_unstale":"2024-09-10T20:40:58.970166+0000","last_undegraded":"2024-09-10T20:40:58.970166+0000","last_fullsized":"2024-09-10T20:40:58.970166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:56.651005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970632+0000","last_change":"2024-09-10T20:40:56.786260+0000","last_active":"2024-09-10T20:40:58.970632+0000","last_peered":"2024-09-10T20:40:58.970632+0000","last_clean":"2024-09-10T20:40:58.970632+0000","last_became_active":"2024-09-10T20:40:56.785702+0000","last_became_peered":"2024-09-10T20:40:56.785702+0000","last_unstale":"2024-09-10T20:40:58.970632+0000","last_undegraded":"2024-09-10T20:40:58.970632+0000","last_fullsized":"2024-09-10T20:40:58.970632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786905+0000","last_change":"2024-09-10T20:40:57.793392+0000","last_active":"2024-09-10T20:40:58.786905+0000","last_peered":"2024-09-10T20:40:58.786905+0000","last_clean":"2024-09-10T20:40:58.786905+0000","last_became_active":"2024-09-10T20:40:57.793192+0000","last_became_peered":"2024-09-10T20:40:57.793192+0000","last_unstale":"2024-09-10T20:40:58.786905+0000","last_undegraded":"2024-09-10T20:40:58.786905+0000","last_fullsized":"2024-09-10T20:40:58.786905+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:26.742701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.786613+0000","last_change":"2024-09-10T20:40:56.781668+0000","last_active":"2024-09-10T20:40:58.786613+0000","last_peered":"2024-09-10T20:40:58.786613+0000","last_clean":"2024-09-10T20:40:58.786613+0000","last_became_active":"2024-09-10T20:40:56.781402+0000","last_became_peered":"2024-09-10T20:40:56.781402+0000","last_unstale":"2024-09-10T20:40:58.786613+0000","last_undegraded":"2024-09-10T20:40:58.786613+0000","last_fullsized":"2024-09-10T20:40:58.786613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:35.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970969+0000","last_change":"2024-09-10T20:40:57.789700+0000","last_active":"2024-09-10T20:40:58.970969+0000","last_peered":"2024-09-10T20:40:58.970969+0000","last_clean":"2024-09-10T20:40:58.970969+0000","last_became_active":"2024-09-10T20:40:57.789433+0000","last_became_peered":"2024-09-10T20:40:57.789433+0000","last_unstale":"2024-09-10T20:40:58.970969+0000","last_undegraded":"2024-09-10T20:40:58.970969+0000","last_fullsized":"2024-09-10T20:40:58.970969+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:36.586950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.789045+0000","last_change":"2024-09-10T20:40:56.795619+0000","last_active":"2024-09-10T20:40:58.789045+0000","last_peered":"2024-09-10T20:40:58.789045+0000","last_clean":"2024-09-10T20:40:58.789045+0000","last_became_active":"2024-09-10T20:40:56.795292+0000","last_became_peered":"2024-09-10T20:40:56.795292+0000","last_unstale":"2024-09-10T20:40:58.789045+0000","last_undegraded":"2024-09-10T20:40:58.789045+0000","last_fullsized":"2024-09-10T20:40:58.789045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:09.500262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.787259+0000","last_change":"2024-09-10T20:40:57.784029+0000","last_active":"2024-09-10T20:40:58.787259+0000","last_peered":"2024-09-10T20:40:58.787259+0000","last_clean":"2024-09-10T20:40:58.787259+0000","last_became_active":"2024-09-10T20:40:57.783716+0000","last_became_peered":"2024-09-10T20:40:57.783716+0000","last_unstale":"2024-09-10T20:40:58.787259+0000","last_undegraded":"2024-09-10T20:40:58.787259+0000","last_fullsized":"2024-09-10T20:40:58.787259+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:17.034966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.970985+0000","last_change":"2024-09-10T20:40:56.785344+0000","last_active":"2024-09-10T20:40:58.970985+0000","last_peered":"2024-09-10T20:40:58.970985+0000","last_clean":"2024-09-10T20:40:58.970985+0000","last_became_active":"2024-09-10T20:40:56.785096+0000","last_became_peered":"2024-09-10T20:40:56.785096+0000","last_unstale":"2024-09-10T20:40:58.970985+0000","last_undegraded":"2024-09-10T20:40:58.970985+0000","last_fullsized":"2024-09-10T20:40:58.970985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T20:40:58.971146+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:40:58.971146+0000","last_peered":"2024-09-10T20:40:58.971146+0000","last_clean":"2024-09-10T20:40:58.971146+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:40:58.971146+0000","last_undegraded":"2024-09-10T20:40:58.971146+0000","last_fullsized":"2024-09-10T20:40:58.971146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":475136,"data_stored":196518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":194872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":196976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1052672,"data_stored":785172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":462848,"data_stored":194874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":779040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:02.390 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:41:02.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T20:41:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 -- 172.21.15.81:0/1220115507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 msgr2=0x7f09d00ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 --2- 172.21.15.81:0/1220115507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d00ccf30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f09d00d0860 tx=0x7f09c802aac0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 -- 172.21.15.81:0/1220115507 shutdown_connections 2024-09-10T20:41:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 --2- 172.21.15.81:0/1220115507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d00ccf30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 --2- 172.21.15.81:0/1220115507 >> v2:172.21.15.143:3300/0 conn(0x7f09d00ae9c0 0x7f09d00aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 -- 172.21.15.81:0/1220115507 >> 172.21.15.81:0/1220115507 conn(0x7f09d00cf7e0 msgr2=0x7f09d00cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:02.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 -- 172.21.15.81:0/1220115507 shutdown_connections 2024-09-10T20:41:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.589+0000 7f09d8400640 1 -- 172.21.15.81:0/1220115507 wait complete. 2024-09-10T20:41:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.590+0000 7f09d8400640 1 Processor -- start 2024-09-10T20:41:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.591+0000 7f09d8400640 1 -- start start 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d8400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09d00ae9c0 0x7f09d0158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d8400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d8400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09d015def0 0x7f09d00ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d8400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0072f70 con 0x7f09d00ccaa0 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d8400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0072df0 con 0x7f09d015def0 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d8400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f09d00730f0 con 0x7f09d00ae9c0 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d014e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33744/0 (socket says 172.21.15.81:33744) 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 -- 172.21.15.81:0/3205450207 learned_addr learned my addr 172.21.15.81:0/3205450207 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d6400640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09d015def0 0x7f09d00ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5a00640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09d00ae9c0 0x7f09d0158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 -- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09d00ae9c0 msgr2=0x7f09d0158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09d00ae9c0 0x7f09d0158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 -- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09d015def0 msgr2=0x7f09d00ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09d015def0 0x7f09d00ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5000640 1 -- 172.21.15.81:0/3205450207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d0159010 con 0x7f09d00ccaa0 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.592+0000 7f09d5a00640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09d00ae9c0 0x7f09d0158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.593+0000 7f09d5000640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d014e260 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00e9c0 tx=0x7f09bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.593+0000 7f09cd600640 1 -- 172.21.15.81:0/3205450207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc00cd80 con 0x7f09d00ccaa0 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.593+0000 7f09cd600640 1 -- 172.21.15.81:0/3205450207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09bc004020 con 0x7f09d00ccaa0 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.593+0000 7f09cd600640 1 -- 172.21.15.81:0/3205450207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09bc004450 con 0x7f09d00ccaa0 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.593+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d01592b0 con 0x7f09d00ccaa0 2024-09-10T20:41:02.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.593+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d0158cd0 con 0x7f09d00ccaa0 2024-09-10T20:41:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.594+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d0071ea0 con 0x7f09d00ccaa0 2024-09-10T20:41:02.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.595+0000 7f09cd600640 1 -- 172.21.15.81:0/3205450207 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f09bc0035f0 con 0x7f09d00ccaa0 2024-09-10T20:41:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.596+0000 7f09cd600640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f09b0077f70 0x7f09b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.596+0000 7f09cd600640 1 -- 172.21.15.81:0/3205450207 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f09bc09a960 con 0x7f09d00ccaa0 2024-09-10T20:41:02.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.597+0000 7f09d5a00640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f09b0077f70 0x7f09b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:02.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.597+0000 7f09d5a00640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f09b0077f70 0x7f09b007a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f09c4007fd0 tx=0x7f09c4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:02.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.600+0000 7f09cd600640 1 -- 172.21.15.81:0/3205450207 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f09d0071ea0 con 0x7f09d00ccaa0 2024-09-10T20:41:02.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.852+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f09d0073680 con 0x7f09d00ccaa0 2024-09-10T20:41:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.856+0000 7f09cd600640 1 -- 172.21.15.81:0/3205450207 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f09bc063230 con 0x7f09d00ccaa0 2024-09-10T20:41:02.860 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-10T20:41:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBaruBmaPwoOxAAjHBOYp6lxVxDK5yph+ot9w== 2024-09-10T20:41:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-10T20:41:02.860 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-10T20:41:02.861 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T20:41:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-10T20:41:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f09b0077f70 msgr2=0x7f09b007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f09b0077f70 0x7f09b007a430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f09c4007fd0 tx=0x7f09c4009040 comp rx=0 tx=0).stop 2024-09-10T20:41:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 msgr2=0x7f09d014e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d014e260 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f09bc00e9c0 tx=0x7f09bc00ee80 comp rx=0 tx=0).stop 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 shutdown_connections 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f09b0077f70 0x7f09b007a430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09d015def0 0x7f09d00ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d00ccaa0 0x7f09d014e260 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 --2- 172.21.15.81:0/3205450207 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f09d00ae9c0 0x7f09d0158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 >> 172.21.15.81:0/3205450207 conn(0x7f09d00cf7e0 msgr2=0x7f09d00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 shutdown_connections 2024-09-10T20:41:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:02.859+0000 7f09d8400640 1 -- 172.21.15.81:0/3205450207 wait complete. 2024-09-10T20:41:02.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.032+0000 7fd90a400640 1 -- 172.21.15.81:0/1917467121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90415c750 msgr2=0x7fd9040cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.032+0000 7fd90a400640 1 --2- 172.21.15.81:0/1917467121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90415c750 0x7fd9040cf780 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc005fd0 tx=0x7fd8fc02a8b0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.032+0000 7fd90a400640 1 -- 172.21.15.81:0/1917467121 shutdown_connections 2024-09-10T20:41:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.032+0000 7fd90a400640 1 --2- 172.21.15.81:0/1917467121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90415c750 0x7fd9040cf780 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.032+0000 7fd90a400640 1 -- 172.21.15.81:0/1917467121 >> 172.21.15.81:0/1917467121 conn(0x7fd90406cb50 msgr2=0x7fd90406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.033+0000 7fd90a400640 1 -- 172.21.15.81:0/1917467121 shutdown_connections 2024-09-10T20:41:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.033+0000 7fd90a400640 1 -- 172.21.15.81:0/1917467121 wait complete. 2024-09-10T20:41:03.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.034+0000 7fd90a400640 1 Processor -- start 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.034+0000 7fd90a400640 1 -- start start 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.035+0000 7fd90a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9040741e0 0x7fd9041f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.035+0000 7fd90a400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd90415b680 0x7fd9040cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.035+0000 7fd90a400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd90415c750 0x7fd9040c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.035+0000 7fd90a400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9040b2bf0 con 0x7fd9040741e0 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.035+0000 7fd90a400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd9040b2a70 con 0x7fd90415c750 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.035+0000 7fd90a400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd9040b2d70 con 0x7fd90415b680 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9040741e0 0x7fd9041f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9040741e0 0x7fd9041f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33766/0 (socket says 172.21.15.81:33766) 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 -- 172.21.15.81:0/1014364991 learned_addr learned my addr 172.21.15.81:0/1014364991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd902a00640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd90415b680 0x7fd9040cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903e00640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd90415c750 0x7fd9040c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 -- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd90415b680 msgr2=0x7fd9040cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd90415b680 0x7fd9040cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 -- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd90415c750 msgr2=0x7fd9040c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd90415c750 0x7fd9040c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 -- 172.21.15.81:0/1014364991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9040b0370 con 0x7fd9040741e0 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903e00640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd90415c750 0x7fd9040c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd903400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9040741e0 0x7fd9041f4c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400c500 tx=0x7fd8f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd8fb400640 1 -- 172.21.15.81:0/1014364991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4017070 con 0x7fd9040741e0 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd8fb400640 1 -- 172.21.15.81:0/1014364991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8f40035f0 con 0x7fd9040741e0 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.036+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9040b0650 con 0x7fd9040741e0 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.037+0000 7fd8fb400640 1 -- 172.21.15.81:0/1014364991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4003a40 con 0x7fd9040741e0 2024-09-10T20:41:03.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.037+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9040b0c10 con 0x7fd9040741e0 2024-09-10T20:41:03.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.038+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9040cd040 con 0x7fd9040741e0 2024-09-10T20:41:03.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.039+0000 7fd8fb400640 1 -- 172.21.15.81:0/1014364991 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd8f4003be0 con 0x7fd9040741e0 2024-09-10T20:41:03.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.039+0000 7fd8fb400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8e4077f70 0x7fd8e407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.040+0000 7fd8fb400640 1 -- 172.21.15.81:0/1014364991 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd8f4099710 con 0x7fd9040741e0 2024-09-10T20:41:03.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.040+0000 7fd902a00640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8e4077f70 0x7fd8e407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.041+0000 7fd902a00640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8e4077f70 0x7fd8e407a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd90415aa60 tx=0x7fd8f0009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.044+0000 7fd8fb400640 1 -- 172.21.15.81:0/1014364991 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd9040cd040 con 0x7fd9040741e0 2024-09-10T20:41:03.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.262+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9040cf700 con 0x7fd9040741e0 2024-09-10T20:41:03.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.262+0000 7fd8fb400640 1 -- 172.21.15.81:0/1014364991 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7fd8f4062070 con 0x7fd9040741e0 2024-09-10T20:41:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:03.267 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-10T20:41:00:792626+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3968194636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3968194636},{"type":"v1","addr":"172.21.15.81:6834","nonce":3968194636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1543508951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1543508951},{"type":"v1","addr":"172.21.15.81:6835","nonce":1543508951}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3499520261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3499520261},{"type":"v1","addr":"172.21.15.143:6836","nonce":3499520261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:00.279039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3550323967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3550323967},{"type":"v1","addr":"172.21.15.143:6837","nonce":3550323967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4965,"qdb_cluster":[4965]},"id":2}]} 2024-09-10T20:41:03.267 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-10T20:41:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8e4077f70 msgr2=0x7fd8e407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8e4077f70 0x7fd8e407a430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd90415aa60 tx=0x7fd8f0009040 comp rx=0 tx=0).stop 2024-09-10T20:41:03.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9040741e0 msgr2=0x7fd9041f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9040741e0 0x7fd9041f4c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400c500 tx=0x7fd8f400c9c0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 shutdown_connections 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd8e4077f70 0x7fd8e407a430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd90415c750 0x7fd9040c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd90415b680 0x7fd9040cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 --2- 172.21.15.81:0/1014364991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9040741e0 0x7fd9041f4c80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 >> 172.21.15.81:0/1014364991 conn(0x7fd90406cb50 msgr2=0x7fd90415ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 shutdown_connections 2024-09-10T20:41:03.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.265+0000 7fd90a400640 1 -- 172.21.15.81:0/1014364991 wait complete. 2024-09-10T20:41:03.688 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:40:57.190090+0000', 'modified': '2024-09-10T20:41:00.279039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4965}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4965': {'gid': 4965, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.143:6837/3550323967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6835', 'nonce': 3550323967}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3550323967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4965, 'qdb_cluster': [4965]} 2024-09-10T20:41:03.688 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T20:41:03.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-10T20:41:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.847+0000 7f4738400640 1 -- 172.21.15.81:0/2410722493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 msgr2=0x7f4718004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.847+0000 7f4738400640 1 --2- 172.21.15.81:0/2410722493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 0x7f4718004c80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f471c00bbe0 tx=0x7f4718005830 comp rx=0 tx=0).stop 2024-09-10T20:41:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.847+0000 7f4736400640 1 -- 172.21.15.81:0/2410722493 reap_dead start 2024-09-10T20:41:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.847+0000 7f4738400640 1 -- 172.21.15.81:0/2410722493 shutdown_connections 2024-09-10T20:41:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.847+0000 7f4738400640 1 -- 172.21.15.81:0/2410722493 >> 172.21.15.81:0/2410722493 conn(0x7f473006cb50 msgr2=0x7f473006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.847+0000 7f4738400640 1 -- 172.21.15.81:0/2410722493 shutdown_connections 2024-09-10T20:41:03.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.847+0000 7f4738400640 1 -- 172.21.15.81:0/2410722493 wait complete. 2024-09-10T20:41:03.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.848+0000 7f4738400640 1 Processor -- start 2024-09-10T20:41:03.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.849+0000 7f4738400640 1 -- start start 2024-09-10T20:41:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.849+0000 7f4738400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 0x7f4730149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.849+0000 7f4738400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47300b0ae0 0x7f47300b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.849+0000 7f4738400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4730135c50 0x7f47301360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.849+0000 7f4738400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f473015ac70 con 0x7f4718004800 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.849+0000 7f4738400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f473015adf0 con 0x7f4730135c50 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.849+0000 7f4738400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f473015af70 con 0x7f47300b0ae0 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 0x7f4730149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 0x7f4730149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33782/0 (socket says 172.21.15.81:33782) 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 -- 172.21.15.81:0/1100471138 learned_addr learned my addr 172.21.15.81:0/1100471138 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735000640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47300b0ae0 0x7f47300b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4736400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4730135c50 0x7f47301360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 -- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47300b0ae0 msgr2=0x7f47300b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47300b0ae0 0x7f47300b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 -- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4730135c50 msgr2=0x7f47301360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4730135c50 0x7f47301360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 -- 172.21.15.81:0/1100471138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4730149b70 con 0x7f4718004800 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735000640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47300b0ae0 0x7f47300b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4736400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4730135c50 0x7f47301360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.850+0000 7f4735a00640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 0x7f4730149630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f472400fa00 tx=0x7f472400fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.851+0000 7f472d600640 1 -- 172.21.15.81:0/1100471138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472400bd70 con 0x7f4718004800 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.851+0000 7f472d600640 1 -- 172.21.15.81:0/1100471138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4724017070 con 0x7f4718004800 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.851+0000 7f472d600640 1 -- 172.21.15.81:0/1100471138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240116a0 con 0x7f4718004800 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.851+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473014b5f0 con 0x7f4718004800 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.851+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47300afd20 con 0x7f4718004800 2024-09-10T20:41:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.853+0000 7f472d600640 1 -- 172.21.15.81:0/1100471138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4724011840 con 0x7f4718004800 2024-09-10T20:41:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.854+0000 7f472d600640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4710077fa0 0x7f471007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.854+0000 7f472d600640 1 -- 172.21.15.81:0/1100471138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f472409ae70 con 0x7f4718004800 2024-09-10T20:41:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.854+0000 7f473b2db740 1 Processor -- start 2024-09-10T20:41:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.854+0000 7f473b2db740 1 -- start start 2024-09-10T20:41:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.854+0000 7f4735000640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4710077fa0 0x7f471007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f4735000640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4710077fa0 0x7f471007a460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f471c035000 tx=0x7f471c0046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f473b2db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de87359cc0 0x55de8735a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87314e30 0x55de873587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de873153b0 0x55de87358ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f473b2db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de87293430 con 0x55de87359cc0 2024-09-10T20:41:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55de872835d0 con 0x55de87314e30 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55de87272a00 con 0x55de873153b0 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de87359cc0 0x55de8735a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de87359cc0 0x55de8735a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33796/0 (socket says 172.21.15.81:33796) 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f4735a00640 1 -- 172.21.15.81:0/3364118880 learned_addr learned my addr 172.21.15.81:0/3364118880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.855+0000 7f4735000640 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87314e30 0x55de873587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4736400640 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de873153b0 0x55de87358ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4735a00640 1 -- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de873153b0 msgr2=0x55de87358ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4735a00640 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de873153b0 0x55de87358ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4735a00640 1 -- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87314e30 msgr2=0x55de873587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4735a00640 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87314e30 0x55de873587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4735a00640 1 -- 172.21.15.81:0/3364118880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de8723b520 con 0x55de87359cc0 2024-09-10T20:41:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4736400640 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de873153b0 0x55de87358ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4735a00640 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de87359cc0 0x55de8735a0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4724063110 tx=0x7f4724062dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b983cffa1389d7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4722000640 1 -- 172.21.15.81:0/3364118880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472406a0e0 con 0x55de87359cc0 2024-09-10T20:41:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4722000640 1 -- 172.21.15.81:0/3364118880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f472406c5d0 con 0x55de87359cc0 2024-09-10T20:41:03.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.856+0000 7f4722000640 1 -- 172.21.15.81:0/3364118880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724011dc0 con 0x55de87359cc0 2024-09-10T20:41:03.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 -- 172.21.15.81:0/3364118880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de87359cc0 msgr2=0x55de8735a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de87359cc0 0x55de8735a0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4724063110 tx=0x7f4724062dd0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 -- 172.21.15.81:0/3364118880 shutdown_connections 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de873153b0 0x55de87358ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87314e30 0x55de873587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 --2- 172.21.15.81:0/3364118880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de87359cc0 0x55de8735a0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 -- 172.21.15.81:0/3364118880 >> 172.21.15.81:0/3364118880 conn(0x55de87310400 msgr2=0x55de87313e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 -- 172.21.15.81:0/3364118880 shutdown_connections 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.857+0000 7f473b2db740 1 -- 172.21.15.81:0/3364118880 wait complete. 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.858+0000 7f473b2db740 1 -- start start 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.858+0000 7f473b2db740 1 Processor -- start 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de873153b0 0x55de87352fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de87359cc0 0x55de8733dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f473b2db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de8733e160 0x55de87354b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f473b2db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de87219330 con 0x55de8733e160 2024-09-10T20:41:03.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55de87276810 con 0x55de873153b0 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55de86fe3620 con 0x55de87359cc0 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f473b2db740 10 client.0 _ll_register_callbacks cb 0x55de8721e420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f4736400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de8733e160 0x55de87354b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f4736400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de8733e160 0x55de87354b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33804/0 (socket says 172.21.15.81:33804) 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f4736400640 1 -- 172.21.15.81:0/386443442 learned_addr learned my addr 172.21.15.81:0/386443442 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f4735000640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de87359cc0 0x55de8733dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.859+0000 7f4735a00640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de873153b0 0x55de87352fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4736400640 1 -- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de87359cc0 msgr2=0x55de8733dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4736400640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de87359cc0 0x55de8733dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4736400640 1 -- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de873153b0 msgr2=0x55de87352fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4736400640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de873153b0 0x55de87352fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4736400640 1 -- 172.21.15.81:0/386443442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de86fd4850 con 0x55de8733e160 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4735a00640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de873153b0 0x55de87352fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:03.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4735000640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de87359cc0 0x55de8733dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4736400640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de8733e160 0x55de87354b80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4730073940 tx=0x7f4728010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2676a77755fef826 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4716a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4716a00640 1 -- 172.21.15.81:0/386443442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728010e50 con 0x55de8733e160 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472406c5d0 con 0x55de8733e160 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4716a00640 1 -- 172.21.15.81:0/386443442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f472800a040 con 0x55de8733e160 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f4716a00640 1 -- 172.21.15.81:0/386443442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f4728012650 con 0x55de8733e160 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f473b2db740 10 client.5115 fetch_fsmap learned FSMap version 18 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.860+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55de8704b6b0 con 0x55de8733e160 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f4716a00640 1 -- 172.21.15.81:0/386443442 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f472406c5d0 con 0x55de8733e160 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f4716a00640 1 -- 172.21.15.81:0/386443442 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f47280128e0 con 0x55de8733e160 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f473b2db740 10 client.5115 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f473b2db740 10 client.5115 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T20:41:03.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f473b2db740 20 client.5115 populate_metadata read hostname 'smithi081' 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f473b2db740 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de87355240 0x55de8736c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f473b2db740 4 client.5115 mds_command: new command op to 4965 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 --> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de87285520 con 0x55de87355240 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.861+0000 7f4735a00640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de87355240 0x55de8736c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.862+0000 7f4735a00640 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de87355240 0x55de8736c8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b390741ed3432d6 server_cookie=1928d4d52ab721ad in_seq=0 out_seq=0 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.862+0000 7f4716a00640 10 client.5115 ms_handle_connect on v2:172.21.15.143:6835/3550323967 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f4716a00640 1 -- 172.21.15.81:0/386443442 <== mds.0 v2:172.21.15.143:6835/3550323967 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de87285520 con 0x55de87355240 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f4716a00640 10 client.5115 handle_command_reply: tid=0 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 client.5115 shutdown 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de8733e160 msgr2=0x55de87354b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de8733e160 0x55de87354b80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4730073940 tx=0x7f4728010730 comp rx=0 tx=0).stop 2024-09-10T20:41:03.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 shutdown_connections 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de8733e160 0x55de87354b80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de87355240 0x55de8736c8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de87359cc0 0x55de8733dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 --2- 172.21.15.81:0/386443442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de873153b0 0x55de87352fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f4716a00640 0 client.5115 ms_handle_reset on v2:172.21.15.143:6835/3550323967 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.863+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 >> 172.21.15.81:0/386443442 conn(0x55de87314e30 msgr2=0x55de8733a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.864+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 shutdown_connections 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.864+0000 7f473b2db740 1 -- 172.21.15.81:0/386443442 wait complete. 2024-09-10T20:41:03.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.864+0000 7f473b2db740 20 client.5115 trim_cache size 0 max 16384 2024-09-10T20:41:03.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.882+0000 7f473b2db740 1 Processor -- start 2024-09-10T20:41:03.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.882+0000 7f473b2db740 1 -- start start 2024-09-10T20:41:03.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f473b2db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de87313ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de87369200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f473b2db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f473015ce40 con 0x55de873153b0 2024-09-10T20:41:03.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4730138ae0 con 0x55de87359cc0 2024-09-10T20:41:03.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f473015c7b0 con 0x55de8733e160 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33820/0 (socket says 172.21.15.81:33820) 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.883+0000 7f4735a00640 1 -- 172.21.15.81:0/4131958533 learned_addr learned my addr 172.21.15.81:0/4131958533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735000640 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de87313ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4736400640 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de87369200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735a00640 1 -- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 msgr2=0x55de87313ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735a00640 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de87313ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735a00640 1 -- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 msgr2=0x55de87369200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735a00640 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de87369200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735a00640 1 -- 172.21.15.81:0/4131958533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de8733ae00 con 0x55de873153b0 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735000640 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de87313ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4735a00640 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733d3a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f472400b690 tx=0x7f472401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ce15f3b0cf3bf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4721600640 1 -- 172.21.15.81:0/4131958533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724098070 con 0x55de873153b0 2024-09-10T20:41:03.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4721600640 1 -- 172.21.15.81:0/4131958533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f472406c5d0 con 0x55de873153b0 2024-09-10T20:41:03.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.884+0000 7f4721600640 1 -- 172.21.15.81:0/4131958533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472405f020 con 0x55de873153b0 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 -- 172.21.15.81:0/4131958533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 msgr2=0x55de8733d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733d3a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f472400b690 tx=0x7f472401e070 comp rx=0 tx=0).stop 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 -- 172.21.15.81:0/4131958533 shutdown_connections 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de87369200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de87313ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 --2- 172.21.15.81:0/4131958533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733d3a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 -- 172.21.15.81:0/4131958533 >> 172.21.15.81:0/4131958533 conn(0x55de87314e30 msgr2=0x55de8733a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 -- 172.21.15.81:0/4131958533 shutdown_connections 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.885+0000 7f473b2db740 1 -- 172.21.15.81:0/4131958533 wait complete. 2024-09-10T20:41:03.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.886+0000 7f473b2db740 1 -- start start 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.886+0000 7f473b2db740 1 Processor -- start 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f473b2db740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de873c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f473b2db740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de873691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f473b2db740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de87337ec0 con 0x55de873153b0 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55de873550c0 con 0x55de87359cc0 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f473b2db740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55de87338510 con 0x55de8733e160 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f473b2db740 10 client.0 _ll_register_callbacks cb 0x7f4728003ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:41:03.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33830/0 (socket says 172.21.15.81:33830) 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 -- 172.21.15.81:0/1195542740 learned_addr learned my addr 172.21.15.81:0/1195542740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4736400640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de873691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735000640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de873c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 -- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 msgr2=0x55de873c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de873c01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 -- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 msgr2=0x55de873691a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de873691a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4735a00640 1 -- 172.21.15.81:0/1195542740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de8733c540 con 0x55de873153b0 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.887+0000 7f4736400640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de873691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f4735a00640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733bba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4724062e80 tx=0x7f4724062dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5c406b13a4afa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f4716a00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:41:03.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f4716a00640 1 -- 172.21.15.81:0/1195542740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724098070 con 0x55de873153b0 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f4716a00640 1 -- 172.21.15.81:0/1195542740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f4724078dc0 con 0x55de873153b0 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472406c5d0 con 0x55de873153b0 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f4716a00640 1 -- 172.21.15.81:0/1195542740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f472405f020 con 0x55de873153b0 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 10 client.5121 fetch_fsmap learned FSMap version 18 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55de87305b20 con 0x55de873153b0 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f4716a00640 1 -- 172.21.15.81:0/1195542740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f472406c5d0 con 0x55de873153b0 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f4716a00640 1 -- 172.21.15.81:0/1195542740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f4724011b60 con 0x55de873153b0 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 10 client.5121 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 10 client.5121 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 20 client.5121 populate_metadata read hostname 'smithi081' 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de873dab30 0x55de873daf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 4 client.5121 mds_command: new command op to 4965 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:41:03.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.888+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 --> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] -- command(tid 0: {"prefix": "status"}) -- 0x55de87280fd0 con 0x55de873dab30 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.889+0000 7f4735000640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de873dab30 0x55de873daf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.889+0000 7f4735000640 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de873dab30 0x55de873daf10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=498ce10cd9e406cd server_cookie=593e856e4a5b7f95 in_seq=0 out_seq=0 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.889+0000 7f4716a00640 10 client.5121 ms_handle_connect on v2:172.21.15.143:6835/3550323967 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f4716a00640 1 -- 172.21.15.81:0/1195542740 <== mds.0 v2:172.21.15.143:6835/3550323967 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55de87280fd0 con 0x55de873dab30 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f4716a00640 10 client.5121 handle_command_reply: tid=0 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 client.5121 shutdown 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 msgr2=0x55de8733bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733bba0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4724062e80 tx=0x7f4724062dd0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 shutdown_connections 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55de87359cc0 0x55de873691a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:6835/3550323967,v1:172.21.15.143:6837/3550323967] conn(0x55de873dab30 0x55de873daf10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55de8733e160 0x55de873c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 --2- 172.21.15.81:0/1195542740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de873153b0 0x55de8733bba0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f4716a00640 0 client.5121 ms_handle_reset on v2:172.21.15.143:6835/3550323967 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 >> 172.21.15.81:0/1195542740 conn(0x55de87314e30 msgr2=0x55de8733a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 shutdown_connections 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 1 -- 172.21.15.81:0/1195542740 wait complete. 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.890+0000 7f473b2db740 20 client.5121 trim_cache size 0 max 16384 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0ea88071-0b16-46b5-b258-7e2fd8f41721", 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4965, 2024-09-10T20:41:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.1226901519999997, 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 18, 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 40, 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 40, 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.579933406 2024-09-10T20:41:03.901 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4710077fa0 msgr2=0x7f471007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4710077fa0 0x7f471007a460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f471c035000 tx=0x7f471c0046c0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 msgr2=0x7f4730149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 0x7f4730149630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f472400fa00 tx=0x7f472400fe00 comp rx=0 tx=0).stop 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 shutdown_connections 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4710077fa0 0x7f471007a460 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4730135c50 0x7f47301360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f47300b0ae0 0x7f47300b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 --2- 172.21.15.81:0/1100471138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4718004800 0x7f4730149630 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 >> 172.21.15.81:0/1100471138 conn(0x7f473006cb50 msgr2=0x7f473006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 shutdown_connections 2024-09-10T20:41:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:03.891+0000 7f4738400640 1 -- 172.21.15.81:0/1100471138 wait complete. 2024-09-10T20:41:03.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:41:04.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 -- 172.21.15.81:0/1339713060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa840cd2f0 msgr2=0x7ffa840721f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:04.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 --2- 172.21.15.81:0/1339713060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa840cd2f0 0x7ffa840721f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009830 tx=0x7ffa7002a4a0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 -- 172.21.15.81:0/1339713060 shutdown_connections 2024-09-10T20:41:04.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 --2- 172.21.15.81:0/1339713060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa840cd2f0 0x7ffa840721f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 --2- 172.21.15.81:0/1339713060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa84157e80 0x7ffa8415dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 -- 172.21.15.81:0/1339713060 >> 172.21.15.81:0/1339713060 conn(0x7ffa8406d500 msgr2=0x7ffa840b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 -- 172.21.15.81:0/1339713060 shutdown_connections 2024-09-10T20:41:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.064+0000 7ffa8b000640 1 -- 172.21.15.81:0/1339713060 wait complete. 2024-09-10T20:41:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.066+0000 7ffa8b000640 1 Processor -- start 2024-09-10T20:41:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.066+0000 7ffa8b000640 1 -- start start 2024-09-10T20:41:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa8b000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa840c8a70 0x7ffa8414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa8b000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa840cd2f0 0x7ffa840b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa8b000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa84157e80 0x7ffa840b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa8b000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8406f7b0 con 0x7ffa840cd2f0 2024-09-10T20:41:04.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa8b000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8406f630 con 0x7ffa84157e80 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa8b000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8406f930 con 0x7ffa840c8a70 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa840cd2f0 0x7ffa840b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa840cd2f0 0x7ffa840b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33838/0 (socket says 172.21.15.81:33838) 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 -- 172.21.15.81:0/2326536359 learned_addr learned my addr 172.21.15.81:0/2326536359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89c00640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa840c8a70 0x7ffa8414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa8a600640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa84157e80 0x7ffa840b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 -- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa840c8a70 msgr2=0x7ffa8414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa840c8a70 0x7ffa8414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 -- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa84157e80 msgr2=0x7ffa840b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa84157e80 0x7ffa840b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.067+0000 7ffa89200640 1 -- 172.21.15.81:0/2326536359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8414d7d0 con 0x7ffa840cd2f0 2024-09-10T20:41:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.068+0000 7ffa89200640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa840cd2f0 0x7ffa840b4b00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009950 tx=0x7ffa70030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.068+0000 7ffa81600640 1 -- 172.21.15.81:0/2326536359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70040070 con 0x7ffa840cd2f0 2024-09-10T20:41:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.068+0000 7ffa81600640 1 -- 172.21.15.81:0/2326536359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa70030d40 con 0x7ffa840cd2f0 2024-09-10T20:41:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.068+0000 7ffa81600640 1 -- 172.21.15.81:0/2326536359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa70004280 con 0x7ffa840cd2f0 2024-09-10T20:41:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.068+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8414fbc0 con 0x7ffa840cd2f0 2024-09-10T20:41:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.068+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa84150180 con 0x7ffa840cd2f0 2024-09-10T20:41:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.069+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa840c90b0 con 0x7ffa840cd2f0 2024-09-10T20:41:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.070+0000 7ffa81600640 1 -- 172.21.15.81:0/2326536359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffa7004c060 con 0x7ffa840cd2f0 2024-09-10T20:41:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.071+0000 7ffa81600640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa64077f70 0x7ffa6407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.071+0000 7ffa81600640 1 -- 172.21.15.81:0/2326536359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ffa700ba820 con 0x7ffa840cd2f0 2024-09-10T20:41:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.072+0000 7ffa89c00640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa64077f70 0x7ffa6407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.073+0000 7ffa89c00640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa64077f70 0x7ffa6407a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffa8414f2c0 tx=0x7ffa78009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:04.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.075+0000 7ffa81600640 1 -- 172.21.15.81:0/2326536359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffa8414d7d0 con 0x7ffa840cd2f0 2024-09-10T20:41:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.299+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffa84162330 con 0x7ffa840cd2f0 2024-09-10T20:41:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.300+0000 7ffa81600640 1 -- 172.21.15.81:0/2326536359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7ffa70083180 con 0x7ffa840cd2f0 2024-09-10T20:41:04.304 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:41:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa64077f70 msgr2=0x7ffa6407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa64077f70 0x7ffa6407a430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffa8414f2c0 tx=0x7ffa78009500 comp rx=0 tx=0).stop 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa840cd2f0 msgr2=0x7ffa840b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa840cd2f0 0x7ffa840b4b00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009950 tx=0x7ffa70030650 comp rx=0 tx=0).stop 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 shutdown_connections 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa64077f70 0x7ffa6407a430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa84157e80 0x7ffa840b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa840cd2f0 0x7ffa840b4b00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 --2- 172.21.15.81:0/2326536359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa840c8a70 0x7ffa8414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 >> 172.21.15.81:0/2326536359 conn(0x7ffa8406d500 msgr2=0x7ffa8406ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.302+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 shutdown_connections 2024-09-10T20:41:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04.303+0000 7ffa8b000640 1 -- 172.21.15.81:0/2326536359 wait complete. 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:41:04.322 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:41:04.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:04.323 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-10T20:41:04.358 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42657sec preferred_lft 42657sec 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 4a:cf:ee:e2:b9:49 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::b40c:4fff:fe85:a68f/64 scope link 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ae:bc:12:01:8a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::acbc:12ff:fe01:8a8b/64 scope link 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 4a:cf:ee:e2:b9:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::48cf:eeff:fee2:b949/64 scope link 2024-09-10T20:41:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:04.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:04.362 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:41:04.452 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-10T20:41:04.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:04.455 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-10T20:41:04.491 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-10T20:41:04.491 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:41:04.492 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:41:04.492 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:41:04.492 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:41:04.492 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:41:04.492 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:41:04.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:41:04.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:41:04.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:41:04.492 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:41:04.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:41:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:41:04.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:04.688 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-10T20:41:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T20:41:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T20:41:04.724 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:41:04.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:04.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-10T20:41:04.823 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T20:41:04.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:41:04.823 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:04.859 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:41:04.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:41:04.859 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:04.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:41:05.030 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:41:05.067 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:41:05.068 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:41:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:05.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:05.070 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:41:05.142 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:41:05.143 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-10T20:41:05.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:41:05.244 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:41:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:41:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:41:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:41:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:41:05.283 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:41:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:05.286 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:05.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:05.287 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:41:05.334 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-10T20:41:05.330+0000 7f51d7c3d480 -1 init, newargv = 0x557c696963f0 newargc=15 2024-09-10T20:41:05.334 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48821]: starting ceph client 2024-09-10T20:41:05.342 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48821]: starting fuse 2024-09-10T20:41:05.366 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-10T20:41:05.366 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-10T20:41:05.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:41:05.366 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-10T20:41:05.366 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-10T20:41:05.366 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-10T20:41:05.366 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-10T20:41:05.366 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:05.366 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-10T20:41:05.367 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-10T20:41:05.368 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:41:05.368 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:05.368 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-10T20:41:05.368 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-10T20:41:05.529 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.48821.asok 2024-09-10T20:41:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:41:05.543 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48821.asok 2024-09-10T20:41:05.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:05.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48821.asok status 2024-09-10T20:41:05.724 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "48821", 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:05.725 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5136, 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5136 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2916552644 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:41:05.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2916552644 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.5136 192.168.0.1:0/2916552644", 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2916552644", 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 18, 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 40, 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-10T20:41:05.727 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:05.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:05.736 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-10T20:41:05.736 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:05.772 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-10T20:41:05.772 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:05.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:05.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:05.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:05.869 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-10T20:41:05.915 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:05.915 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:05.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:05.992 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-10T20:41:06.152 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records in 2024-09-10T20:41:06.152 INFO:teuthology.orchestra.run.smithi081.stderr:6+0 records out 2024-09-10T20:41:06.152 INFO:teuthology.orchestra.run.smithi081.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0807196 s, 77.9 MB/s 2024-09-10T20:41:06.153 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-10T20:41:06.153 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> import json 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> import sys 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> sys.exit(e.errno) 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> print(json.dumps( 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> indent=2)) 2024-09-10T20:41:06.154 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-10T20:41:06.256 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "st_mode": 33188, 2024-09-10T20:41:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "st_ino": 1099511627777, 2024-09-10T20:41:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "st_dev": 41, 2024-09-10T20:41:06.256 INFO:teuthology.orchestra.run.smithi081.stdout: "st_nlink": 1, 2024-09-10T20:41:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "st_uid": 1000, 2024-09-10T20:41:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "st_gid": 1333, 2024-09-10T20:41:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "st_size": 6291456, 2024-09-10T20:41:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "st_atime": 1726000866.0662, 2024-09-10T20:41:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "st_mtime": 1726000866.1176317, 2024-09-10T20:41:06.257 INFO:teuthology.orchestra.run.smithi081.stdout: "st_ctime": 1726000866.1176317 2024-09-10T20:41:06.257 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:06.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:41:06.268 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:06.268 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:06.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:41:06.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 -- 172.21.15.81:0/3378478594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c15c6c0 msgr2=0x7f1f1c073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:06.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 --2- 172.21.15.81:0/3378478594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c15c6c0 0x7f1f1c073b70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009830 tx=0x7f1f0802a480 comp rx=0 tx=0).stop 2024-09-10T20:41:06.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 -- 172.21.15.81:0/3378478594 shutdown_connections 2024-09-10T20:41:06.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 --2- 172.21.15.81:0/3378478594 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c15c6c0 0x7f1f1c073b70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 --2- 172.21.15.81:0/3378478594 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f1c155df0 0x7f1f1c0730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 -- 172.21.15.81:0/3378478594 >> 172.21.15.81:0/3378478594 conn(0x7f1f1c0b1480 msgr2=0x7f1f1c0b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:06.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 -- 172.21.15.81:0/3378478594 shutdown_connections 2024-09-10T20:41:06.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.538+0000 7f1f22400640 1 -- 172.21.15.81:0/3378478594 wait complete. 2024-09-10T20:41:06.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.540+0000 7f1f22400640 1 Processor -- start 2024-09-10T20:41:06.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.540+0000 7f1f22400640 1 -- start start 2024-09-10T20:41:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f22400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f1c0740b0 0x7f1f1c1f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f22400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c155df0 0x7f1f1c1f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f22400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f1c15c6c0 0x7f1f1c1e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f22400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c0cbed0 con 0x7f1f1c0740b0 2024-09-10T20:41:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f22400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c0cbd50 con 0x7f1f1c155df0 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f22400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c0aeba0 con 0x7f1f1c15c6c0 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f21000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f1c0740b0 0x7f1f1c1f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f21000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f1c0740b0 0x7f1f1c1f2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41282/0 (socket says 172.21.15.81:41282) 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.541+0000 7f1f21000640 1 -- 172.21.15.81:0/2544686658 learned_addr learned my addr 172.21.15.81:0/2544686658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f21a00640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f1c15c6c0 0x7f1f1c1e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f1be00640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c155df0 0x7f1f1c1f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f21000640 1 -- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f1c15c6c0 msgr2=0x7f1f1c1e8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f21000640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f1c15c6c0 0x7f1f1c1e8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f21000640 1 -- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c155df0 msgr2=0x7f1f1c1f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f21000640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c155df0 0x7f1f1c1f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f21000640 1 -- 172.21.15.81:0/2544686658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c1f68e0 con 0x7f1f1c0740b0 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f21000640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f1c0740b0 0x7f1f1c1f2320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e9f0 tx=0x7f1f1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:06.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f18c00640 1 -- 172.21.15.81:0/2544686658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000cd80 con 0x7f1f1c0740b0 2024-09-10T20:41:06.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f18c00640 1 -- 172.21.15.81:0/2544686658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f10010430 con 0x7f1f1c0740b0 2024-09-10T20:41:06.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f18c00640 1 -- 172.21.15.81:0/2544686658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10010840 con 0x7f1f1c0740b0 2024-09-10T20:41:06.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c1f29d0 con 0x7f1f1c0740b0 2024-09-10T20:41:06.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.542+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1f2f90 con 0x7f1f1c0740b0 2024-09-10T20:41:06.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.544+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c06c500 con 0x7f1f1c0740b0 2024-09-10T20:41:06.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.545+0000 7f1f18c00640 1 -- 172.21.15.81:0/2544686658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1f100109e0 con 0x7f1f1c0740b0 2024-09-10T20:41:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.546+0000 7f1f18c00640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1efc077fa0 0x7f1efc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.546+0000 7f1f18c00640 1 -- 172.21.15.81:0/2544686658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f1f1009aa60 con 0x7f1f1c0740b0 2024-09-10T20:41:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.547+0000 7f1f1be00640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1efc077fa0 0x7f1efc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:06.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.547+0000 7f1f1be00640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1efc077fa0 0x7f1efc07a460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f08034000 tx=0x7f1f08004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.551+0000 7f1f18c00640 1 -- 172.21.15.81:0/2544686658 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1f1c06c500 con 0x7f1f1c0740b0 2024-09-10T20:41:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.746+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1f1c0af050 con 0x7f1f1c0740b0 2024-09-10T20:41:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.747+0000 7f1f18c00640 1 -- 172.21.15.81:0/2544686658 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f1f1c1f68e0 con 0x7f1f1c0740b0 2024-09-10T20:41:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1efc077fa0 msgr2=0x7f1efc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1efc077fa0 0x7f1efc07a460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f08034000 tx=0x7f1f08004730 comp rx=0 tx=0).stop 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f1c0740b0 msgr2=0x7f1f1c1f2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f1c0740b0 0x7f1f1c1f2320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e9f0 tx=0x7f1f1000eeb0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 shutdown_connections 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1efc077fa0 0x7f1efc07a460 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f1c15c6c0 0x7f1f1c1e8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f1c155df0 0x7f1f1c1f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 --2- 172.21.15.81:0/2544686658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f1c0740b0 0x7f1f1c1f2320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 >> 172.21.15.81:0/2544686658 conn(0x7f1f1c0b1480 msgr2=0x7f1f1c154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.749+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 shutdown_connections 2024-09-10T20:41:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:06.750+0000 7f1f22400640 1 -- 172.21.15.81:0/2544686658 wait complete. 2024-09-10T20:41:06.769 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:06.769 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:06.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:41:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.000+0000 7fcfef200640 1 -- 172.21.15.81:0/1833350358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd0004800 msgr2=0x7fcfd0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.000+0000 7fcfef200640 1 --2- 172.21.15.81:0/1833350358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd0004800 0x7fcfd0004c80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80cf870 tx=0x7fcfd0005830 comp rx=0 tx=0).stop 2024-09-10T20:41:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.000+0000 7fcfee800640 1 -- 172.21.15.81:0/1833350358 reap_dead start 2024-09-10T20:41:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.000+0000 7fcfef200640 1 -- 172.21.15.81:0/1833350358 shutdown_connections 2024-09-10T20:41:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.000+0000 7fcfef200640 1 -- 172.21.15.81:0/1833350358 >> 172.21.15.81:0/1833350358 conn(0x7fcfe80b2200 msgr2=0x7fcfe80cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.000+0000 7fcfef200640 1 -- 172.21.15.81:0/1833350358 shutdown_connections 2024-09-10T20:41:07.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.000+0000 7fcfef200640 1 -- 172.21.15.81:0/1833350358 wait complete. 2024-09-10T20:41:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.001+0000 7fcfef200640 1 Processor -- start 2024-09-10T20:41:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.002+0000 7fcfef200640 1 -- start start 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.002+0000 7fcfef200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfd0004800 0x7fcfe81f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfef200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe80cb8c0 0x7fcfe81f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfef200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe814e850 0x7fcfe814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfef200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81600b0 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfef200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe815ff30 con 0x7fcfe814e850 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfef200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe8160230 con 0x7fcfd0004800 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe80cb8c0 0x7fcfe81f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe80cb8c0 0x7fcfe81f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41288/0 (socket says 172.21.15.81:41288) 2024-09-10T20:41:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 -- 172.21.15.81:0/2107819872 learned_addr learned my addr 172.21.15.81:0/2107819872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 -- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfd0004800 msgr2=0x7fcfe81f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfd0004800 0x7fcfe81f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 -- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe814e850 msgr2=0x7fcfe814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe814e850 0x7fcfe814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 -- 172.21.15.81:0/2107819872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe81f7fe0 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.003+0000 7fcfed400640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe80cb8c0 0x7fcfe81f4e00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80016e0 tx=0x7fcfd8006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.004+0000 7fcfe2000640 1 -- 172.21.15.81:0/2107819872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8041070 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.004+0000 7fcfe2000640 1 -- 172.21.15.81:0/2107819872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfd8006530 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.004+0000 7fcfe2000640 1 -- 172.21.15.81:0/2107819872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8038070 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.004+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe81f82c0 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.004+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe814e330 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.005+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe81f87e0 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.006+0000 7fcfe2000640 1 -- 172.21.15.81:0/2107819872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fcfd8033420 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.007+0000 7fcfe2000640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fcfcc077fd0 0x7fcfcc07a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.007+0000 7fcfe2000640 1 -- 172.21.15.81:0/2107819872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcfd80b9550 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.007+0000 7fcfede00640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fcfcc077fd0 0x7fcfcc07a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:07.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.008+0000 7fcfede00640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fcfcc077fd0 0x7fcfcc07a490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8159d50 tx=0x7fcfdc009550 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:07.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.011+0000 7fcfe2000640 1 -- 172.21.15.81:0/2107819872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fcfe81f87e0 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.204+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcfe814e120 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.205+0000 7fcfe2000640 1 -- 172.21.15.81:0/2107819872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7fcfd8081e20 con 0x7fcfe80cb8c0 2024-09-10T20:41:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-10T20:41:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fcfcc077fd0 msgr2=0x7fcfcc07a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fcfcc077fd0 0x7fcfcc07a490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8159d50 tx=0x7fcfdc009550 comp rx=0 tx=0).stop 2024-09-10T20:41:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe80cb8c0 msgr2=0x7fcfe81f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe80cb8c0 0x7fcfe81f4e00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80016e0 tx=0x7fcfd8006310 comp rx=0 tx=0).stop 2024-09-10T20:41:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 shutdown_connections 2024-09-10T20:41:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fcfcc077fd0 0x7fcfcc07a490 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:07.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcfe814e850 0x7fcfe814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe80cb8c0 0x7fcfe81f4e00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 --2- 172.21.15.81:0/2107819872 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcfd0004800 0x7fcfe81f78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 >> 172.21.15.81:0/2107819872 conn(0x7fcfe80b2200 msgr2=0x7fcfe815d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 shutdown_connections 2024-09-10T20:41:07.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:07.207+0000 7fcfef200640 1 -- 172.21.15.81:0/2107819872 wait complete. 2024-09-10T20:41:07.226 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-10T20:41:07.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:07.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:07.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48821]: fuse finished with error 0 and tester_r 0 2024-09-10T20:41:07.283 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:41:13.385 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:41:13.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:13.386 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T20:41:13.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:13.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.629+0000 7f9e8ee00640 1 -- 172.21.15.81:0/621113991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0064d0 msgr2=0x7f9e6c00cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:13.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.629+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/621113991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0064d0 0x7f9e6c00cad0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9e80005fd0 tx=0x7f9e6c006940 comp rx=0 tx=0).stop 2024-09-10T20:41:13.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.629+0000 7f9e8ee00640 1 -- 172.21.15.81:0/621113991 shutdown_connections 2024-09-10T20:41:13.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.629+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/621113991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0064d0 0x7f9e6c00cad0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:13.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.629+0000 7f9e8ee00640 1 -- 172.21.15.81:0/621113991 >> 172.21.15.81:0/621113991 conn(0x7f9e8806cb50 msgr2=0x7f9e8806cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:13.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.629+0000 7f9e8ee00640 1 -- 172.21.15.81:0/621113991 shutdown_connections 2024-09-10T20:41:13.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.629+0000 7f9e8ee00640 1 -- 172.21.15.81:0/621113991 wait complete. 2024-09-10T20:41:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.630+0000 7f9e8ee00640 1 Processor -- start 2024-09-10T20:41:13.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.631+0000 7f9e8ee00640 1 -- start start 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.631+0000 7f9e8ee00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c0064d0 0x7f9e881f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.631+0000 7f9e8ee00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e88144480 0x7f9e880b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ee00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e881e55c0 0x7f9e881e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ee00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8815d620 con 0x7f9e881e55c0 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ee00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9e880b4bb0 con 0x7f9e6c0064d0 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ee00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8815d7a0 con 0x7f9e88144480 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e881e55c0 0x7f9e881e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:13.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e881e55c0 0x7f9e881e60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41294/0 (socket says 172.21.15.81:41294) 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 -- 172.21.15.81:0/661879813 learned_addr learned my addr 172.21.15.81:0/661879813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e87400640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e88144480 0x7f9e880b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e87e00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c0064d0 0x7f9e881f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 -- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e88144480 msgr2=0x7f9e880b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e88144480 0x7f9e880b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 -- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c0064d0 msgr2=0x7f9e881f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c0064d0 0x7f9e881f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:13.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.632+0000 7f9e8ce00640 1 -- 172.21.15.81:0/661879813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e881e4590 con 0x7f9e881e55c0 2024-09-10T20:41:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.633+0000 7f9e8ce00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e881e55c0 0x7f9e881e60c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000d310 tx=0x7f9e80004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.633+0000 7f9e7fe00640 1 -- 172.21.15.81:0/661879813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80031040 con 0x7f9e881e55c0 2024-09-10T20:41:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.633+0000 7f9e7fe00640 1 -- 172.21.15.81:0/661879813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e8002b6f0 con 0x7f9e881e55c0 2024-09-10T20:41:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.633+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e881e4800 con 0x7f9e881e55c0 2024-09-10T20:41:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.633+0000 7f9e7fe00640 1 -- 172.21.15.81:0/661879813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80009b20 con 0x7f9e881e55c0 2024-09-10T20:41:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.633+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881e4dc0 con 0x7f9e881e55c0 2024-09-10T20:41:13.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.634+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8815a810 con 0x7f9e881e55c0 2024-09-10T20:41:13.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.635+0000 7f9e7fe00640 1 -- 172.21.15.81:0/661879813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9e80004460 con 0x7f9e881e55c0 2024-09-10T20:41:13.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.636+0000 7f9e7fe00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e68077fa0 0x7f9e6807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:13.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.636+0000 7f9e7fe00640 1 -- 172.21.15.81:0/661879813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f9e800b9f70 con 0x7f9e881e55c0 2024-09-10T20:41:13.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.637+0000 7f9e87e00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e68077fa0 0x7f9e6807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:13.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.637+0000 7f9e87e00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e68077fa0 0x7f9e6807a460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9e78000c00 tx=0x7f9e78006b70 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:13.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.640+0000 7f9e7fe00640 1 -- 172.21.15.81:0/661879813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9e80046060 con 0x7f9e881e55c0 2024-09-10T20:41:13.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.866+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e880aeaa0 con 0x7f9e881e55c0 2024-09-10T20:41:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.867+0000 7f9e7fe00640 1 -- 172.21.15.81:0/661879813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f9e80082840 con 0x7f9e881e55c0 2024-09-10T20:41:13.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:13.871 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-10T20:41:00:792626+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4956,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3968194636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3968194636},{"type":"v1","addr":"172.21.15.81:6834","nonce":3968194636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4959,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1543508951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1543508951},{"type":"v1","addr":"172.21.15.81:6835","nonce":1543508951}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4962,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3499520261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3499520261},{"type":"v1","addr":"172.21.15.143:6836","nonce":3499520261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:00.279039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4965":{"gid":4965,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.143:6837/3550323967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":3550323967},{"type":"v1","addr":"172.21.15.143:6837","nonce":3550323967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4965,"qdb_cluster":[4965]},"id":2}]} 2024-09-10T20:41:13.871 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-10T20:41:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e68077fa0 msgr2=0x7f9e6807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:13.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e68077fa0 0x7f9e6807a460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9e78000c00 tx=0x7f9e78006b70 comp rx=0 tx=0).stop 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e881e55c0 msgr2=0x7f9e881e60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e881e55c0 0x7f9e881e60c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000d310 tx=0x7f9e80004270 comp rx=0 tx=0).stop 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 shutdown_connections 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e68077fa0 0x7f9e6807a460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e881e55c0 0x7f9e881e60c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e88144480 0x7f9e880b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 --2- 172.21.15.81:0/661879813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e6c0064d0 0x7f9e881f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 >> 172.21.15.81:0/661879813 conn(0x7f9e8806cb50 msgr2=0x7f9e880ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.869+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 shutdown_connections 2024-09-10T20:41:13.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:13.870+0000 7f9e8ee00640 1 -- 172.21.15.81:0/661879813 wait complete. 2024-09-10T20:41:13.889 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-10T20:41:14.081 INFO:teuthology.orchestra.run.smithi143.stdout:{"message":"","return_code":0} 2024-09-10T20:41:14.082 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-10T20:41:14.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T20:41:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.237+0000 7f755ae00640 1 -- 172.21.15.81:0/3189005504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75540d0900 msgr2=0x7f75540b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.237+0000 7f755ae00640 1 --2- 172.21.15.81:0/3189005504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75540d0900 0x7f75540b33a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f75540b6630 tx=0x7f754c02aac0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.238+0000 7f755ae00640 1 -- 172.21.15.81:0/3189005504 shutdown_connections 2024-09-10T20:41:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.238+0000 7f755ae00640 1 --2- 172.21.15.81:0/3189005504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75540d0900 0x7f75540b33a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.238+0000 7f755ae00640 1 --2- 172.21.15.81:0/3189005504 >> v2:172.21.15.143:3300/0 conn(0x7f755415db30 0x7f75540cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.238+0000 7f755ae00640 1 -- 172.21.15.81:0/3189005504 >> 172.21.15.81:0/3189005504 conn(0x7f75540d3a40 msgr2=0x7f75540d3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.238+0000 7f755ae00640 1 -- 172.21.15.81:0/3189005504 shutdown_connections 2024-09-10T20:41:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.238+0000 7f755ae00640 1 -- 172.21.15.81:0/3189005504 wait complete. 2024-09-10T20:41:14.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.239+0000 7f755ae00640 1 Processor -- start 2024-09-10T20:41:14.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.239+0000 7f755ae00640 1 -- start start 2024-09-10T20:41:14.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.240+0000 7f755ae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75540d0900 0x7f75540ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.240+0000 7f755ae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f755415db30 0x7f755409e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.240+0000 7f755ae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755409e5f0 0x7f75540b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.240+0000 7f755ae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75540d4720 con 0x7f755409e5f0 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.240+0000 7f755ae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75540d45a0 con 0x7f755415db30 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.240+0000 7f755ae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75540d48a0 con 0x7f75540d0900 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755409e5f0 0x7f75540b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755409e5f0 0x7f75540b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41312/0 (socket says 172.21.15.81:41312) 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 -- 172.21.15.81:0/519624840 learned_addr learned my addr 172.21.15.81:0/519624840 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f7559a00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75540d0900 0x7f75540ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f7559000640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f755415db30 0x7f755409e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 -- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75540d0900 msgr2=0x7f75540ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75540d0900 0x7f75540ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 -- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f755415db30 msgr2=0x7f755409e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f755415db30 0x7f755409e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 -- 172.21.15.81:0/519624840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75540ca610 con 0x7f755409e5f0 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.241+0000 7f755a400640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755409e5f0 0x7f75540b59f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f754c02b0b0 tx=0x7f754c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.242+0000 7f7551600640 1 -- 172.21.15.81:0/519624840 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c044070 con 0x7f755409e5f0 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.242+0000 7f7551600640 1 -- 172.21.15.81:0/519624840 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f754c003e50 con 0x7f755409e5f0 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.242+0000 7f7551600640 1 -- 172.21.15.81:0/519624840 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0044b0 con 0x7f755409e5f0 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.242+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75541f8bf0 con 0x7f755409e5f0 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.242+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75541f4ba0 con 0x7f755409e5f0 2024-09-10T20:41:14.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.243+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75540b3c10 con 0x7f755409e5f0 2024-09-10T20:41:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.244+0000 7f7551600640 1 -- 172.21.15.81:0/519624840 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f754c004650 con 0x7f755409e5f0 2024-09-10T20:41:14.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.245+0000 7f7551600640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7534077f70 0x7f753407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.245+0000 7f7551600640 1 -- 172.21.15.81:0/519624840 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f754c0ba560 con 0x7f755409e5f0 2024-09-10T20:41:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.245+0000 7f7559a00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7534077f70 0x7f753407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.246+0000 7f7559a00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7534077f70 0x7f753407a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7548009b30 tx=0x7f7548005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:14.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.249+0000 7f7551600640 1 -- 172.21.15.81:0/519624840 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f75541f8bf0 con 0x7f755409e5f0 2024-09-10T20:41:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.468+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f75540b3380 con 0x7f755409e5f0 2024-09-10T20:41:14.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T20:41:14.469+0000 7f54aae00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T20:41:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.471+0000 7f7551600640 1 -- 172.21.15.81:0/519624840 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f754c032030 con 0x7f755409e5f0 2024-09-10T20:41:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.474+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7534077f70 msgr2=0x7f753407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.474+0000 7f755ae00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7534077f70 0x7f753407a430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7548009b30 tx=0x7f7548005f90 comp rx=0 tx=0).stop 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.474+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755409e5f0 msgr2=0x7f75540b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.474+0000 7f755ae00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755409e5f0 0x7f75540b59f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f754c02b0b0 tx=0x7f754c003ce0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 shutdown_connections 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7534077f70 0x7f753407a430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755409e5f0 0x7f75540b59f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f755415db30 0x7f755409e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 --2- 172.21.15.81:0/519624840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75540d0900 0x7f75540ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 >> 172.21.15.81:0/519624840 conn(0x7f75540d3a40 msgr2=0x7f75540b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 shutdown_connections 2024-09-10T20:41:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:14.475+0000 7f755ae00640 1 -- 172.21.15.81:0/519624840 wait complete. 2024-09-10T20:41:14.486 INFO:tasks.ceph.mds.d.smithi143.stderr: -3847> 2024-09-10T20:41:02.114+0000 7fcc12000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:41:14.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:41:14.501 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:41:14.536 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-09-10T20:41:14.595 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-10T20:41:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:41:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-10T20:41:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-10T20:41:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-10T20:41:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 30 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:41:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:41:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: mon down mkfs grace = 300 2024-09-10T20:41:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.605 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-10T20:41:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-10T20:41:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-10T20:41:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2024-09-10T20:41:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = False 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.607 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.608 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-09-10T20:41:14.609 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.81,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-09-10T20:41:14.610 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.611 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:41:14.612 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.613 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 30 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.614 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.615 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-09-10T20:41:14.616 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2024-09-10T20:41:14.617 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = False 2024-09-10T20:41:14.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:41:14.634 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-10T20:41:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.730 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-10T20:41:14.731 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-10T20:41:14.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-10T20:41:14.733 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T20:41:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 30 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-10T20:41:14.735 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.736 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:41:14.737 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:41:14.737 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:41:14.737 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: mon down mkfs grace = 300 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-09-10T20:41:14.738 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = False 2024-09-10T20:41:14.739 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = False 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.769 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.770 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.771 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.81,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-09-10T20:41:14.772 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-09-10T20:41:14.773 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-09-10T20:41:14.774 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:41:14.775 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 30 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-09-10T20:41:14.776 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T20:41:14.777 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = "" 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-09-10T20:41:14.778 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-09-10T20:41:14.779 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-09-10T20:41:14.779 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-09-10T20:41:14.779 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-09-10T20:41:14.779 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-09-10T20:41:14.779 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2024-09-10T20:41:14.779 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = False 2024-09-10T20:41:14.779 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = False 2024-09-10T20:41:14.795 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T20:41:14.795 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T20:41:14.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T20:41:14.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:41:14.796 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T20:41:14.796 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T20:41:14.796 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T20:41:14.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:41:14.796 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T20:41:14.796 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T20:41:14.797 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T20:41:14.797 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:41:14.797 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T20:41:14.797 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T20:41:14.797 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T20:41:14.797 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:41:14.811 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T20:41:14.811 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T20:41:14.812 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T20:41:14.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T20:41:14.813 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T20:41:14.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T20:41:14.855 INFO:tasks.ceph.mds.b:Started 2024-09-10T20:41:14.856 DEBUG:teuthology.parallel:result is None 2024-09-10T20:41:14.857 INFO:tasks.ceph.mds.a:Started 2024-09-10T20:41:14.857 DEBUG:teuthology.parallel:result is None 2024-09-10T20:41:14.859 INFO:tasks.ceph.mds.c:Started 2024-09-10T20:41:14.859 DEBUG:teuthology.parallel:result is None 2024-09-10T20:41:14.981 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-09-10T20:41:14.985 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-10T20:41:14.986 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-10T20:41:17.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-10T20:41:17.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:41:17.567 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:41:20.812 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T20:41:20.812 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T20:41:20.817 INFO:tasks.ceph.mds.d:Started 2024-09-10T20:41:20.817 DEBUG:teuthology.parallel:result is None 2024-09-10T20:41:20.817 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T20:41:20.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.895+0000 7f19b831cf40 1 Processor -- start 2024-09-10T20:41:20.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.896+0000 7f19b831cf40 1 -- start start 2024-09-10T20:41:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.896+0000 7f19b831cf40 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad557c6d0 0x559ad55aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.896+0000 7f19b831cf40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad55c8e30 0x559ad55c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.896+0000 7f19b831cf40 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad56565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.896+0000 7f19b831cf40 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559ad54ccc60 con 0x559ad5651e00 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.896+0000 7f19b831cf40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559ad552b1d0 con 0x559ad55c8e30 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.896+0000 7f19b831cf40 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559ad5655790 con 0x559ad557c6d0 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad56565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad56565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49264/0 (socket says 172.21.15.81:49264) 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 -- 172.21.15.81:0/105206352 learned_addr learned my addr 172.21.15.81:0/105206352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b5600640 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad557c6d0 0x559ad55aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b4c00640 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad55c8e30 0x559ad55c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 -- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad557c6d0 msgr2=0x559ad55aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad557c6d0 0x559ad55aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 -- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad55c8e30 msgr2=0x559ad55c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad55c8e30 0x559ad55c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 -- 172.21.15.81:0/105206352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ad55ac190 con 0x559ad5651e00 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.897+0000 7f19b6000640 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad56565c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19b000a550 tx=0x7f19b0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd237fa3d6ad31b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19af400640 1 -- 172.21.15.81:0/105206352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0064030 con 0x559ad5651e00 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19af400640 1 -- 172.21.15.81:0/105206352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19b0004020 con 0x559ad5651e00 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19af400640 1 -- 172.21.15.81:0/105206352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0004290 con 0x559ad5651e00 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 -- 172.21.15.81:0/105206352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 msgr2=0x559ad56565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad56565c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19b000a550 tx=0x7f19b0003330 comp rx=0 tx=0).stop 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 -- 172.21.15.81:0/105206352 shutdown_connections 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad56565c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad55c8e30 0x559ad55c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 --2- 172.21.15.81:0/105206352 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad557c6d0 0x559ad55aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 -- 172.21.15.81:0/105206352 >> 172.21.15.81:0/105206352 conn(0x559ad55caa80 msgr2=0x559ad5657660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 -- 172.21.15.81:0/105206352 shutdown_connections 2024-09-10T20:41:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.898+0000 7f19b831cf40 1 -- 172.21.15.81:0/105206352 wait complete. 2024-09-10T20:41:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.899+0000 7f19b831cf40 1 Processor -- start 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.899+0000 7f19b831cf40 1 -- start start 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b831cf40 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad557c6d0 0x559ad5652e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b831cf40 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad55c8e30 0x559ad56523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b831cf40 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad5633340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b831cf40 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559ad56439c0 con 0x559ad5651e00 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b831cf40 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559ad55ca490 con 0x559ad557c6d0 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b831cf40 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559ad55ac430 con 0x559ad55c8e30 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad5633340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b4c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad55c8e30 0x559ad56523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b6000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad5633340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49276/0 (socket says 172.21.15.81:49276) 2024-09-10T20:41:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 learned_addr learned my addr 172.21.15.81:0/872139334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.900+0000 7f19b5600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad557c6d0 0x559ad5652e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad55c8e30 msgr2=0x559ad56523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559ad55c8e30 0x559ad56523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad557c6d0 msgr2=0x559ad5652e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559ad557c6d0 0x559ad5652e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ad56539e0 con 0x559ad5651e00 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad5633340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f19b000a550 tx=0x7f19b004dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19ae000640 1 -- 172.21.15.81:0/872139334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b0064070 con 0x559ad5651e00 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19ae000640 1 -- 172.21.15.81:0/872139334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19b006e070 con 0x559ad5651e00 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.901+0000 7f19ae000640 1 -- 172.21.15.81:0/872139334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b004de60 con 0x559ad5651e00 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.902+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ad5653420 con 0x559ad5651e00 2024-09-10T20:41:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.902+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ad5650490 con 0x559ad5651e00 2024-09-10T20:41:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.904+0000 7f19ae000640 1 -- 172.21.15.81:0/872139334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f19b0069a00 con 0x559ad5651e00 2024-09-10T20:41:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.905+0000 7f19ae000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1998076980 0x7f1998078e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.905+0000 7f19ae000640 1 -- 172.21.15.81:0/872139334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6187+0+0 (secure 0 0 0) 0x7f19b00de450 con 0x559ad5651e00 2024-09-10T20:41:20.910 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: using slow linear search 2024-09-10T20:41:20.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.905+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1998076980 0x7f1998078e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.905+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x559ad5651140 0x559ad55c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.905+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:1 5.0 5:00000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x559ad5651140 2024-09-10T20:41:20.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.906+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x559ad5651140 0x559ad55c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.906+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1998076980 0x7f1998078e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c6a0 tx=0x7f19a800e040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.906+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x559ad5651140 0x559ad55c9a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.907+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 1 ==== osd_op_reply(1 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a400e040 con 0x559ad5651140 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.907+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f19a4012430 0x7f19a4012870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.907+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:2 5.10 5:08000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19a4012430 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.907+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f19a4012430 0x7f19a4012870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.908+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f19a4012430 0x7f19a4012870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.908+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 1 ==== osd_op_reply(2 [pgnls start_epoch 44 out=177b] v40'10 uv10 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.908+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f19a800ab90 0x7f19a800b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.908+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:3 5.8 5:10000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19a800ab90 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.909+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f19a800ab90 0x7f19a800b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.909+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f19a800ab90 0x7f19a800b440 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.909+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== osd_op_reply(3 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x7f19a800ab90 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.909+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7f19a400e2d0 0x7f19a400e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.910+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:4 5.18 5:18000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19a400e2d0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.910+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7f19a400e2d0 0x7f19a400e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.910+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7f19a400e2d0 0x7f19a400e710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.910+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.1 v2:172.21.15.81:6810/310566059 1 ==== osd_op_reply(4 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b000b040 con 0x7f19a400e2d0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.911+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f19b00a6ba0 0x7f19b00a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.911+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:5 5.4 5:20000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19b00a6ba0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.911+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f19b00a6ba0 0x7f19b00a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.911+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f19b00a6ba0 0x7f19b00a5610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.912+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== osd_op_reply(5 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a6ba0 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.912+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:6 5.14 5:28000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x559ad5651140 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.912+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 2 ==== osd_op_reply(6 [pgnls start_epoch 44 out=149b] v40'20 uv20 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.912+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7f19a40228c0 0x7f19a40212e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.912+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:7 5.c 5:30000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19a40228c0 2024-09-10T20:41:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.913+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7f19a40228c0 0x7f19a40212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.913+0000 7f19b4c00640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7f19a40228c0 0x7f19a40212e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.914+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== osd_op_reply(7 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x7f19a40228c0 2024-09-10T20:41:20.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.914+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:8 5.1c 5:38000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19a4012430 2024-09-10T20:41:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.914+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 2 ==== osd_op_reply(8 [pgnls start_epoch 44 out=73b] v39'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.914+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:9 5.2 5:40000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19b00a6ba0 2024-09-10T20:41:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.914+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.0 v2:172.21.15.81:6800/4080460515 2 ==== osd_op_reply(9 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a6ba0 2024-09-10T20:41:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.914+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:10 5.12 5:48000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x559ad5633c50 con 0x7f19a800ab90 2024-09-10T20:41:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.915+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.6 v2:172.21.15.143:6818/294800477 2 ==== osd_op_reply(10 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x7f19a800ab90 2024-09-10T20:41:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.915+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:11 5.a 5:50000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a800ab90 2024-09-10T20:41:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.915+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.6 v2:172.21.15.143:6818/294800477 3 ==== osd_op_reply(11 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x7f19a800ab90 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.915+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:12 5.1a 5:58000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a400e2d0 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.916+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.1 v2:172.21.15.81:6810/310566059 2 ==== osd_op_reply(12 [pgnls start_epoch 44 out=49b] v39'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b000b040 con 0x7f19a400e2d0 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.916+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f19b00af900 0x7f19b00a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.916+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:13 5.6 5:60000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00af900 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.916+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f19b00af900 0x7f19b00a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.917+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f19b00af900 0x7f19b00a4d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.917+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(13 [pgnls start_epoch 44 out=77b] v40'4 uv4 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x7f19b000b040 con 0x7f19b00af900 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.917+0000 7f19b6000640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f19b00a7bc0 0x7f19b00c0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.917+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:14 5.16 5:68000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00a7bc0 2024-09-10T20:41:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.917+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f19b00a7bc0 0x7f19b00c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:20.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.918+0000 7f19b5600640 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f19b00a7bc0 0x7f19b00c0040 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:20.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.918+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 1 ==== osd_op_reply(14 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.918+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:15 5.e 5:70000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00a7bc0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.919+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 2 ==== osd_op_reply(15 [pgnls start_epoch 44 out=73b] v39'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.919+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:16 5.1e 5:78000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a800ab90 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.919+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.6 v2:172.21.15.143:6818/294800477 4 ==== osd_op_reply(16 [pgnls start_epoch 44 out=49b] v39'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x7f19a800ab90 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.919+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:17 5.1 5:80000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00a7bc0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.919+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 3 ==== osd_op_reply(17 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.919+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:18 5.11 5:88000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00a7bc0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.920+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 4 ==== osd_op_reply(18 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.920+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:19 5.9 5:90000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a400e2d0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.920+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.1 v2:172.21.15.81:6810/310566059 3 ==== osd_op_reply(19 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b000b040 con 0x7f19a400e2d0 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.920+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:20 5.19 5:98000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x559ad5651140 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.920+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 3 ==== osd_op_reply(20 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.920+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:21 5.5 5:a0000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00af900 2024-09-10T20:41:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.921+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== osd_op_reply(21 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b000b040 con 0x7f19b00af900 2024-09-10T20:41:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.921+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:22 5.15 5:a8000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00a7bc0 2024-09-10T20:41:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.921+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 5 ==== osd_op_reply(22 [pgnls start_epoch 44 out=97b] v39'3 uv3 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.921+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:23 5.d 5:b0000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00af900 2024-09-10T20:41:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.922+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.7 v2:172.21.15.143:6810/3238341229 3 ==== osd_op_reply(23 [pgnls start_epoch 44 out=74b] v39'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19b000b040 con 0x7f19b00af900 2024-09-10T20:41:20.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.922+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:24 5.1d 5:b8000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x559ad5651140 2024-09-10T20:41:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.922+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 4 ==== osd_op_reply(24 [pgnls start_epoch 44 out=73b] v39'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.922+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:25 5.3 5:c0000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x559ad5651140 2024-09-10T20:41:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.923+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 5 ==== osd_op_reply(25 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.923+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:26 5.13 5:c8000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x559ad5651140 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.923+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 6 ==== osd_op_reply(26 [pgnls start_epoch 44 out=98b] v40'3 uv3 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.923+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:27 5.b 5:d0000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a40228c0 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.924+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== osd_op_reply(27 [pgnls start_epoch 44 out=76b] v40'3 uv3 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x7f19a401f040 con 0x7f19a40228c0 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.924+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:28 5.1b 5:d8000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a4012430 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.924+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 3 ==== osd_op_reply(28 [pgnls start_epoch 44 out=49b] v39'1 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.924+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:29 5.7 5:e0000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19b00a7bc0 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.924+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 6 ==== osd_op_reply(29 [pgnls start_epoch 44 out=73b] v39'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.924+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:30 5.17 5:e8000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x559ad5651140 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 7 ==== osd_op_reply(30 [pgnls start_epoch 44 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:31 5.f 5:f0000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a400e2d0 2024-09-10T20:41:20.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.1 v2:172.21.15.81:6810/310566059 4 ==== osd_op_reply(31 [pgnls start_epoch 44 out=73b] v39'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x7f19b000b040 con 0x7f19a400e2d0 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:32 5.1f 5:f8000000:%01:::head [pgnls start_epoch 44 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e44) -- 0x7f19a4026040 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 4 ==== osd_op_reply(32 [pgnls start_epoch 44 out=101b] v40'6 uv6 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:33 5.10 5:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56f5610 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:34 5.10 5:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56f61e0 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:35 5.10 5:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56f8ae0 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:36 5.10 5:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56f9330 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.925+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:37 5.10 5:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56f9b80 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:38 5.14 5:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fa3d0 con 0x559ad5651140 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:39 5.14 5:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fac20 con 0x559ad5651140 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:40 5.14 5:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fb470 con 0x559ad5651140 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:41 5.14 5:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fbe90 con 0x559ad5651140 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:42 5.1c 5:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fc930 con 0x7f19a4012430 2024-09-10T20:41:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:43 5.6 5:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fd4b0 con 0x7f19b00af900 2024-09-10T20:41:20.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:44 5.e 5:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fdf60 con 0x7f19b00a7bc0 2024-09-10T20:41:20.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:45 5.15 5:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fea70 con 0x7f19b00a7bc0 2024-09-10T20:41:20.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:46 5.15 5:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56ff5b0 con 0x7f19b00a7bc0 2024-09-10T20:41:20.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:47 5.d 5:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad57000a0 con 0x7f19b00af900 2024-09-10T20:41:20.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.926+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:48 5.1d 5:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad5700a00 con 0x559ad5651140 2024-09-10T20:41:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.928+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 7 ==== osd_op_reply(45 604.00000000 [delete] v44'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.928+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:49 5.13 5:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56ff5b0 con 0x559ad5651140 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.928+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.7 v2:172.21.15.143:6810/3238341229 4 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v44'5 uv5 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f19b000b040 con 0x7f19b00af900 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.928+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 8 ==== osd_op_reply(48 605.00000000 [delete] v44'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 8 ==== osd_op_reply(44 608.00000000 [delete] v44'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:50 5.13 5:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fea30 con 0x559ad5651140 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:51 5.b 5:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad5700570 con 0x7f19a40228c0 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:52 5.7 5:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad5701290 con 0x7f19b00a7bc0 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 5 ==== osd_op_reply(42 607.00000000 [delete] v44'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 9 ==== osd_op_reply(46 500.00000000 [delete] v44'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:53 5.f 5:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad56fea30 con 0x7f19a400e2d0 2024-09-10T20:41:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:54 5.1f 5:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad5701290 con 0x7f19a4012430 2024-09-10T20:41:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.929+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 9 ==== osd_op_reply(38 1.00000000.inode [delete] v44'21 uv21 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.930+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 10 ==== osd_op_reply(39 200.00000000 [delete] v44'22 uv22 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.930+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 11 ==== osd_op_reply(40 200.00000001 [delete] v44'23 uv23 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.930+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:55 5.1f 5:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e44) -- 0x559ad5700570 con 0x7f19a4012430 2024-09-10T20:41:20.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.930+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.7 v2:172.21.15.143:6810/3238341229 5 ==== osd_op_reply(47 mds_snaptable [delete] v44'2 uv2 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f19b000b040 con 0x7f19b00af900 2024-09-10T20:41:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.930+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 6 ==== osd_op_reply(33 601.00000000 [delete] v44'11 uv11 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.930+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 12 ==== osd_op_reply(41 606.00000000 [delete] v44'24 uv24 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.931+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 13 ==== osd_op_reply(49 mds0_inotable [delete] v44'4 uv4 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.931+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 7 ==== osd_op_reply(34 602.00000000 [delete] v44'12 uv12 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.931+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 8 ==== osd_op_reply(35 10000000000.00000000 [delete] v44'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.3 v2:172.21.15.81:6808/906295494 10 ==== osd_op_reply(52 609.00000000 [delete] v44'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19b00a7bc0 2024-09-10T20:41:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 9 ==== osd_op_reply(36 600.00000000 [delete] v44'14 uv14 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 10 ==== osd_op_reply(37 603.00000000 [delete] v44'15 uv15 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.5 v2:172.21.15.143:6802/1659339177 3 ==== osd_op_reply(51 mds0_sessionmap [delete] v44'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x7f19a40228c0 2024-09-10T20:41:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b4c00640 1 -- 172.21.15.81:0/872139334 <== osd.4 v2:172.21.15.143:6826/4019230190 14 ==== osd_op_reply(50 100.00000000 [delete] v44'5 uv5 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19a401f040 con 0x559ad5651140 2024-09-10T20:41:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 <== osd.1 v2:172.21.15.81:6810/310566059 5 ==== osd_op_reply(53 400.00000000 [delete] v44'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x7f19b000b040 con 0x7f19a400e2d0 2024-09-10T20:41:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 11 ==== osd_op_reply(54 100.00000000.inode [delete] v44'7 uv7 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b5600640 1 -- 172.21.15.81:0/872139334 <== osd.2 v2:172.21.15.81:6809/2010302829 12 ==== osd_op_reply(55 1.00000000 [delete] v44'8 uv8 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x7f19a800a460 con 0x7f19a4012430 2024-09-10T20:41:20.944 INFO:teuthology.orchestra.run.smithi081.stdout:Removed 23 objects 2024-09-10T20:41:20.944 INFO:teuthology.orchestra.run.smithi081.stdout:successfully purged pool cephfs_metadata 2024-09-10T20:41:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f19b00a6ba0 msgr2=0x7f19b00a5610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f19b00a6ba0 0x7f19b00a5610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7f19a400e2d0 msgr2=0x7f19a400e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7f19a400e2d0 0x7f19a400e710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f19a4012430 msgr2=0x7f19a4012870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f19a4012430 0x7f19a4012870 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f19b00a7bc0 msgr2=0x7f19b00c0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f19b00a7bc0 0x7f19b00c0040 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x559ad5651140 msgr2=0x559ad55c9a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x559ad5651140 0x559ad55c9a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7f19a40228c0 msgr2=0x7f19a40212e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7f19a40228c0 0x7f19a40212e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f19a800ab90 msgr2=0x7f19a800b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f19a800ab90 0x7f19a800b440 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f19b00af900 msgr2=0x7f19b00a4d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7f19b00af900 0x7f19b00a4d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 reap_dead start 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 reap_dead start 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b6000640 1 -- 172.21.15.81:0/872139334 reap_dead start 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1998076980 msgr2=0x7f1998078e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1998076980 0x7f1998078e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19a800c6a0 tx=0x7f19a800e040 comp rx=0 tx=0).stop 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 msgr2=0x559ad5633340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.932+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad5633340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f19b000a550 tx=0x7f19b004dc30 comp rx=0 tx=0).stop 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.933+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 shutdown_connections 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.933+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1998076980 0x7f1998078e40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.933+0000 7f19b831cf40 1 --2- 172.21.15.81:0/872139334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559ad5651e00 0x559ad5633340 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.933+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 >> 172.21.15.81:0/872139334 conn(0x559ad55caa80 msgr2=0x559ad55b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.933+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 shutdown_connections 2024-09-10T20:41:20.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:20.933+0000 7f19b831cf40 1 -- 172.21.15.81:0/872139334 wait complete. 2024-09-10T20:41:20.949 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'recovery_fs' 2024-09-10T20:41:20.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create recovery_fs_metadata --pg_num_min 64 2024-09-10T20:41:20.956 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-09-10T20:41:21.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.109+0000 7ffabde00640 1 -- 172.21.15.81:0/2375151666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa9c003a00 msgr2=0x7ffa9c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.109+0000 7ffabde00640 1 --2- 172.21.15.81:0/2375151666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa9c003a00 0x7ffa9c003e20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009b50 tx=0x7ffa9c005830 comp rx=0 tx=0).stop 2024-09-10T20:41:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.109+0000 7ffab7400640 1 -- 172.21.15.81:0/2375151666 reap_dead start 2024-09-10T20:41:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.109+0000 7ffabde00640 1 -- 172.21.15.81:0/2375151666 shutdown_connections 2024-09-10T20:41:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.109+0000 7ffabde00640 1 -- 172.21.15.81:0/2375151666 >> 172.21.15.81:0/2375151666 conn(0x7ffab8069020 msgr2=0x7ffab806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.109+0000 7ffabde00640 1 -- 172.21.15.81:0/2375151666 shutdown_connections 2024-09-10T20:41:21.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.109+0000 7ffabde00640 1 -- 172.21.15.81:0/2375151666 wait complete. 2024-09-10T20:41:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.111+0000 7ffabde00640 1 Processor -- start 2024-09-10T20:41:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.111+0000 7ffabde00640 1 -- start start 2024-09-10T20:41:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffabde00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c003a00 0x7ffab81431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffabde00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab8142cb0 0x7ffab815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffabde00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab815b3d0 0x7ffab81f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffabde00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffab815c4b0 con 0x7ffab815b3d0 2024-09-10T20:41:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffabde00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffab815c330 con 0x7ffa9c003a00 2024-09-10T20:41:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffabde00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffab8145430 con 0x7ffab8142cb0 2024-09-10T20:41:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab815b3d0 0x7ffab81f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab815b3d0 0x7ffab81f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49302/0 (socket says 172.21.15.81:49302) 2024-09-10T20:41:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 -- 172.21.15.81:0/1107930020 learned_addr learned my addr 172.21.15.81:0/1107930020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 -- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab8142cb0 msgr2=0x7ffab815ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab8142cb0 0x7ffab815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 -- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c003a00 msgr2=0x7ffab81431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c003a00 0x7ffab81431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 -- 172.21.15.81:0/1107930020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80725b0 con 0x7ffab815b3d0 2024-09-10T20:41:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.112+0000 7ffab7400640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab815b3d0 0x7ffab81f4d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ffab0005fd0 tx=0x7ffab0010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.113+0000 7ffaaf400640 1 -- 172.21.15.81:0/1107930020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0003e40 con 0x7ffab815b3d0 2024-09-10T20:41:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.113+0000 7ffaaf400640 1 -- 172.21.15.81:0/1107930020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffab0015070 con 0x7ffab815b3d0 2024-09-10T20:41:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.113+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab8072890 con 0x7ffab815b3d0 2024-09-10T20:41:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.113+0000 7ffaaf400640 1 -- 172.21.15.81:0/1107930020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab000e8f0 con 0x7ffab815b3d0 2024-09-10T20:41:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.113+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab8072e50 con 0x7ffab815b3d0 2024-09-10T20:41:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.114+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab8144ef0 con 0x7ffab815b3d0 2024-09-10T20:41:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.115+0000 7ffaaf400640 1 -- 172.21.15.81:0/1107930020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffab000ea90 con 0x7ffab815b3d0 2024-09-10T20:41:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.116+0000 7ffaaf400640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa98077fa0 0x7ffa9807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.116+0000 7ffaaf400640 1 -- 172.21.15.81:0/1107930020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6187+0+0 (secure 0 0 0) 0x7ffab009a590 con 0x7ffab815b3d0 2024-09-10T20:41:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.117+0000 7ffab6a00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa98077fa0 0x7ffa9807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.117+0000 7ffab6a00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa98077fa0 0x7ffa9807a460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8035000 tx=0x7ffaa8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.120+0000 7ffaaf400640 1 -- 172.21.15.81:0/1107930020 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffab0062f40 con 0x7ffab815b3d0 2024-09-10T20:41:21.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:21.302+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64} v 0) -- 0x7ffab80cc280 con 0x7ffab815b3d0 2024-09-10T20:41:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.963+0000 7ffaaf400640 1 -- 172.21.15.81:0/1107930020 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64}]=0 pool 'recovery_fs_metadata' created v46) ==== 148+0+0 (secure 0 0 0) 0x7ffab0062840 con 0x7ffab815b3d0 2024-09-10T20:41:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'recovery_fs_metadata' created 2024-09-10T20:41:22.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.967+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa98077fa0 msgr2=0x7ffa9807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.967+0000 7ffabde00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa98077fa0 0x7ffa9807a460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8035000 tx=0x7ffaa8004730 comp rx=0 tx=0).stop 2024-09-10T20:41:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.967+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab815b3d0 msgr2=0x7ffab81f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.967+0000 7ffabde00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab815b3d0 0x7ffab81f4d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ffab0005fd0 tx=0x7ffab0010e50 comp rx=0 tx=0).stop 2024-09-10T20:41:22.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 shutdown_connections 2024-09-10T20:41:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa98077fa0 0x7ffa9807a460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffab815b3d0 0x7ffab81f4d30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffab8142cb0 0x7ffab815ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 --2- 172.21.15.81:0/1107930020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa9c003a00 0x7ffab81431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 >> 172.21.15.81:0/1107930020 conn(0x7ffab8069020 msgr2=0x7ffab80b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 shutdown_connections 2024-09-10T20:41:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:22.968+0000 7ffabde00640 1 -- 172.21.15.81:0/1107930020 wait complete. 2024-09-10T20:41:22.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T20:41:23.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.161+0000 7f835c000640 1 -- 172.21.15.81:0/2515390539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c004800 msgr2=0x7f833c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.161+0000 7f835c000640 1 --2- 172.21.15.81:0/2515390539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c004800 0x7f833c004c80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f834000c6e0 tx=0x7f833c005830 comp rx=0 tx=0).stop 2024-09-10T20:41:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.161+0000 7f835c000640 1 -- 172.21.15.81:0/2515390539 shutdown_connections 2024-09-10T20:41:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.161+0000 7f835c000640 1 --2- 172.21.15.81:0/2515390539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c004800 0x7f833c004c80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.161+0000 7f835c000640 1 -- 172.21.15.81:0/2515390539 >> 172.21.15.81:0/2515390539 conn(0x7f8354069020 msgr2=0x7f835406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.161+0000 7f835c000640 1 -- 172.21.15.81:0/2515390539 shutdown_connections 2024-09-10T20:41:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.161+0000 7f835c000640 1 -- 172.21.15.81:0/2515390539 wait complete. 2024-09-10T20:41:23.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.163+0000 7f835c000640 1 Processor -- start 2024-09-10T20:41:23.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.163+0000 7f835c000640 1 -- start start 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f835c000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833c004800 0x7f835413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f835c000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83541f1660 0x7f83541f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f835c000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83541f58b0 0x7f83541f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f835c000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f835406f7f0 con 0x7f83541f1660 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f835c000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f83540ccca0 con 0x7f83541f58b0 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f835c000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f835406f970 con 0x7f833c004800 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f8358c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83541f1660 0x7f83541f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f8358c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83541f1660 0x7f83541f1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49320/0 (socket says 172.21.15.81:49320) 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f8358c00640 1 -- 172.21.15.81:0/2482969240 learned_addr learned my addr 172.21.15.81:0/2482969240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f8359600640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833c004800 0x7f835413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.164+0000 7f835a000640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83541f58b0 0x7f83541f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8358c00640 1 -- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833c004800 msgr2=0x7f835413e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8358c00640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833c004800 0x7f835413e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8358c00640 1 -- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83541f58b0 msgr2=0x7f83541f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8358c00640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83541f58b0 0x7f83541f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8358c00640 1 -- 172.21.15.81:0/2482969240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835413b880 con 0x7f83541f1660 2024-09-10T20:41:23.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8358c00640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83541f1660 0x7f83541f1ae0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f834000c800 tx=0x7f8340006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:23.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8351600640 1 -- 172.21.15.81:0/2482969240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340004830 con 0x7f83541f1660 2024-09-10T20:41:23.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8351600640 1 -- 172.21.15.81:0/2482969240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8340039070 con 0x7f83541f1660 2024-09-10T20:41:23.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835413bb60 con 0x7f83541f1660 2024-09-10T20:41:23.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.165+0000 7f8351600640 1 -- 172.21.15.81:0/2482969240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340004d80 con 0x7f83541f1660 2024-09-10T20:41:23.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.166+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835413c400 con 0x7f83541f1660 2024-09-10T20:41:23.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.167+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83540cf4c0 con 0x7f83541f1660 2024-09-10T20:41:23.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.168+0000 7f8351600640 1 -- 172.21.15.81:0/2482969240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8340033470 con 0x7f83541f1660 2024-09-10T20:41:23.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.169+0000 7f8351600640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8334077fa0 0x7f833407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.169+0000 7f8351600640 1 -- 172.21.15.81:0/2482969240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6562+0+0 (secure 0 0 0) 0x7f83400b9ad0 con 0x7f83541f1660 2024-09-10T20:41:23.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.169+0000 7f8359600640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8334077fa0 0x7f833407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.170+0000 7f8359600640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8334077fa0 0x7f833407a460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83480058c0 tx=0x7f834800d490 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:23.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.173+0000 7f8351600640 1 -- 172.21.15.81:0/2482969240 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f834004a060 con 0x7f83541f1660 2024-09-10T20:41:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.360+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f83540b35b0 con 0x7f83541f1660 2024-09-10T20:41:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.360+0000 7f8351600640 1 -- 172.21.15.81:0/2482969240 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' already exists v46) ==== 177+0+0 (secure 0 0 0) 0x7f8340082320 con 0x7f83541f1660 2024-09-10T20:41:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' already exists 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.362+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8334077fa0 msgr2=0x7f833407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.362+0000 7f835c000640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8334077fa0 0x7f833407a460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83480058c0 tx=0x7f834800d490 comp rx=0 tx=0).stop 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.362+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83541f1660 msgr2=0x7f83541f1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.362+0000 7f835c000640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83541f1660 0x7f83541f1ae0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f834000c800 tx=0x7f8340006380 comp rx=0 tx=0).stop 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 shutdown_connections 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8334077fa0 0x7f833407a460 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f83541f58b0 0x7f83541f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83541f1660 0x7f83541f1ae0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 --2- 172.21.15.81:0/2482969240 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833c004800 0x7f835413e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 >> 172.21.15.81:0/2482969240 conn(0x7f8354069020 msgr2=0x7f83540b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 shutdown_connections 2024-09-10T20:41:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.363+0000 7f835c000640 1 -- 172.21.15.81:0/2482969240 wait complete. 2024-09-10T20:41:23.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new recovery_fs recovery_fs_metadata cephfs_data --recover --allow-dangerous-metadata-overlay 2024-09-10T20:41:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 -- 172.21.15.81:0/652723962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 msgr2=0x7febdc0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 --2- 172.21.15.81:0/652723962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 0x7febdc0cb1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febd4009830 tx=0x7febd402a3f0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 -- 172.21.15.81:0/652723962 shutdown_connections 2024-09-10T20:41:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 --2- 172.21.15.81:0/652723962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 0x7febdc0cb1a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 --2- 172.21.15.81:0/652723962 >> v2:172.21.15.143:3300/0 conn(0x7febdc0af140 0x7febdc0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 -- 172.21.15.81:0/652723962 >> 172.21.15.81:0/652723962 conn(0x7febdc0cc480 msgr2=0x7febdc0cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 -- 172.21.15.81:0/652723962 shutdown_connections 2024-09-10T20:41:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.541+0000 7febdbe00640 1 -- 172.21.15.81:0/652723962 wait complete. 2024-09-10T20:41:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.542+0000 7febdbe00640 1 Processor -- start 2024-09-10T20:41:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.543+0000 7febdbe00640 1 -- start start 2024-09-10T20:41:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.543+0000 7febdbe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febdc0af140 0x7febdc0c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.543+0000 7febdbe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 0x7febdc1f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.543+0000 7febdbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febdc15f020 0x7febdc0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.543+0000 7febdbe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7febdc0cb6e0 con 0x7febdc15f020 2024-09-10T20:41:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.543+0000 7febdbe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7febdc0cd2d0 con 0x7febdc0af140 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.543+0000 7febdbe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7febdc0cb860 con 0x7febdc0b51b0 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febdc15f020 0x7febdc0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febdc15f020 0x7febdc0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49336/0 (socket says 172.21.15.81:49336) 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 -- 172.21.15.81:0/412745485 learned_addr learned my addr 172.21.15.81:0/412745485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febda000640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 0x7febdc1f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdaa00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febdc0af140 0x7febdc0c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 -- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 msgr2=0x7febdc1f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 0x7febdc1f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 -- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febdc0af140 msgr2=0x7febdc0c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febdc0af140 0x7febdc0c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.544+0000 7febdb400640 1 -- 172.21.15.81:0/412745485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc1f5360 con 0x7febdc15f020 2024-09-10T20:41:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.545+0000 7febdb400640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febdc15f020 0x7febdc0b0570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febd402a9e0 tx=0x7febd4032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.545+0000 7febd2a00640 1 -- 172.21.15.81:0/412745485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd4040070 con 0x7febdc15f020 2024-09-10T20:41:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.545+0000 7febd2a00640 1 -- 172.21.15.81:0/412745485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febd4005310 con 0x7febdc15f020 2024-09-10T20:41:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.545+0000 7febd2a00640 1 -- 172.21.15.81:0/412745485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd40047a0 con 0x7febdc15f020 2024-09-10T20:41:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.545+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febdc0ae480 con 0x7febdc15f020 2024-09-10T20:41:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.545+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febdc0cdd00 con 0x7febdc15f020 2024-09-10T20:41:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.546+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febdc0cbd50 con 0x7febdc15f020 2024-09-10T20:41:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.547+0000 7febd2a00640 1 -- 172.21.15.81:0/412745485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7febd4004940 con 0x7febdc15f020 2024-09-10T20:41:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.548+0000 7febd2a00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7febbc077f70 0x7febbc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.549+0000 7febd2a00640 1 -- 172.21.15.81:0/412745485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6562+0+0 (secure 0 0 0) 0x7febd40bb3b0 con 0x7febdc15f020 2024-09-10T20:41:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.549+0000 7febdaa00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7febbc077f70 0x7febbc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.549+0000 7febdaa00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7febbc077f70 0x7febbc07a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7febcc001e40 tx=0x7febcc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.553+0000 7febd2a00640 1 -- 172.21.15.81:0/412745485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7febdc1f5360 con 0x7febdc15f020 2024-09-10T20:41:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.769+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true} v 0) -- 0x7febdc0b4610 con 0x7febdc15f020 2024-09-10T20:41:23.982 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T20:41:23.978+0000 7f54ae000640 -1 log_channel(cluster) log [ERR] : Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2024-09-10T20:41:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.989+0000 7febd2a00640 1 -- 172.21.15.81:0/412745485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true}]=0 new fs with metadata pool 7 and data pool 6 v23) ==== 241+0+0 (secure 0 0 0) 0x7febd4083ab0 con 0x7febdc15f020 2024-09-10T20:41:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 7 and data pool 6 2024-09-10T20:41:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.993+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7febbc077f70 msgr2=0x7febbc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.993+0000 7febdbe00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7febbc077f70 0x7febbc07a430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7febcc001e40 tx=0x7febcc009040 comp rx=0 tx=0).stop 2024-09-10T20:41:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.993+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febdc15f020 msgr2=0x7febdc0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.993+0000 7febdbe00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febdc15f020 0x7febdc0b0570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febd402a9e0 tx=0x7febd4032b90 comp rx=0 tx=0).stop 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 shutdown_connections 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7febbc077f70 0x7febbc07a430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febdc15f020 0x7febdc0b0570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febdc0b51b0 0x7febdc1f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 --2- 172.21.15.81:0/412745485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febdc0af140 0x7febdc0c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 >> 172.21.15.81:0/412745485 conn(0x7febdc0cc480 msgr2=0x7febdc072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 shutdown_connections 2024-09-10T20:41:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:23.994+0000 7febdbe00640 1 -- 172.21.15.81:0/412745485 wait complete. 2024-09-10T20:41:24.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:24.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.174+0000 7f4c6c200640 1 -- 172.21.15.81:0/3809410818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640b3d80 msgr2=0x7f4c6415ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.174+0000 7f4c6c200640 1 --2- 172.21.15.81:0/3809410818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640b3d80 0x7f4c6415ffc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009860 tx=0x7f4c5802a510 comp rx=0 tx=0).stop 2024-09-10T20:41:24.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.174+0000 7f4c6c200640 1 -- 172.21.15.81:0/3809410818 shutdown_connections 2024-09-10T20:41:24.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.174+0000 7f4c6c200640 1 --2- 172.21.15.81:0/3809410818 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c640b3d80 0x7f4c6415ffc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.174+0000 7f4c6c200640 1 -- 172.21.15.81:0/3809410818 >> 172.21.15.81:0/3809410818 conn(0x7f4c640b1ea0 msgr2=0x7f4c640b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:24.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.174+0000 7f4c6c200640 1 -- 172.21.15.81:0/3809410818 shutdown_connections 2024-09-10T20:41:24.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.174+0000 7f4c6c200640 1 -- 172.21.15.81:0/3809410818 wait complete. 2024-09-10T20:41:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.176+0000 7f4c6c200640 1 Processor -- start 2024-09-10T20:41:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.176+0000 7f4c6c200640 1 -- start start 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c6c200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c6406ecd0 0x7f4c640735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c6c200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c640b3d80 0x7f4c640ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c6c200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c6415bfd0 0x7f4c640c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c6c200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c64152eb0 con 0x7f4c6406ecd0 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c6c200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4c64152d30 con 0x7f4c640b3d80 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c6c200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6406f180 con 0x7f4c6415bfd0 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c6406ecd0 0x7f4c640735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c6406ecd0 0x7f4c640735b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49338/0 (socket says 172.21.15.81:49338) 2024-09-10T20:41:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 -- 172.21.15.81:0/421930153 learned_addr learned my addr 172.21.15.81:0/421930153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c68e00640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c640b3d80 0x7f4c640ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c6a200640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c6415bfd0 0x7f4c640c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 -- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c6415bfd0 msgr2=0x7f4c640c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c6415bfd0 0x7f4c640c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 -- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c640b3d80 msgr2=0x7f4c640ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c640b3d80 0x7f4c640ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c69800640 1 -- 172.21.15.81:0/421930153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c641f7f60 con 0x7f4c6406ecd0 2024-09-10T20:41:24.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.177+0000 7f4c68e00640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c640b3d80 0x7f4c640ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:24.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.178+0000 7f4c69800640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c6406ecd0 0x7f4c640735b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009980 tx=0x7f4c58032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:24.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.178+0000 7f4c61600640 1 -- 172.21.15.81:0/421930153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58040070 con 0x7f4c6406ecd0 2024-09-10T20:41:24.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.178+0000 7f4c61600640 1 -- 172.21.15.81:0/421930153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c580038e0 con 0x7f4c6406ecd0 2024-09-10T20:41:24.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.178+0000 7f4c61600640 1 -- 172.21.15.81:0/421930153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58003d30 con 0x7f4c6406ecd0 2024-09-10T20:41:24.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.178+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c641f8240 con 0x7f4c6406ecd0 2024-09-10T20:41:24.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.178+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c641f8800 con 0x7f4c6406ecd0 2024-09-10T20:41:24.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.179+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c641f45b0 con 0x7f4c6406ecd0 2024-09-10T20:41:24.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.180+0000 7f4c61600640 1 -- 172.21.15.81:0/421930153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4c5804d030 con 0x7f4c6406ecd0 2024-09-10T20:41:24.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.181+0000 7f4c61600640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4c44077f70 0x7f4c4407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.181+0000 7f4c61600640 1 -- 172.21.15.81:0/421930153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6640+0+0 (secure 0 0 0) 0x7f4c580bb560 con 0x7f4c6406ecd0 2024-09-10T20:41:24.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.182+0000 7f4c68e00640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4c44077f70 0x7f4c4407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.183+0000 7f4c68e00640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4c44077f70 0x7f4c4407a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4c6415bbb0 tx=0x7f4c50009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.185+0000 7f4c61600640 1 -- 172.21.15.81:0/421930153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4c58083c40 con 0x7f4c6406ecd0 2024-09-10T20:41:24.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-10T20:41:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.370+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c6415ffc0 con 0x7f4c6406ecd0 2024-09-10T20:41:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.372+0000 7f4c61600640 1 -- 172.21.15.81:0/421930153 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+19036 (secure 0 0 0) 0x7f4c5808a070 con 0x7f4c6406ecd0 2024-09-10T20:41:24.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:24.377 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:23.771896+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-10T20:41:21.973646+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4c44077f70 msgr2=0x7f4c4407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4c44077f70 0x7f4c4407a430 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4c6415bbb0 tx=0x7f4c50009040 comp rx=0 tx=0).stop 2024-09-10T20:41:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c6406ecd0 msgr2=0x7f4c640735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c6406ecd0 0x7f4c640735b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009980 tx=0x7f4c58032b90 comp rx=0 tx=0).stop 2024-09-10T20:41:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 shutdown_connections 2024-09-10T20:41:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4c44077f70 0x7f4c4407a430 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c6415bfd0 0x7f4c640c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c640b3d80 0x7f4c640ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 --2- 172.21.15.81:0/421930153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c6406ecd0 0x7f4c640735b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 >> 172.21.15.81:0/421930153 conn(0x7f4c640b1ea0 msgr2=0x7f4c640b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 shutdown_connections 2024-09-10T20:41:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.374+0000 7f4c6c200640 1 -- 172.21.15.81:0/421930153 wait complete. 2024-09-10T20:41:24.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 -- 172.21.15.81:0/2452959770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9901453e0 msgr2=0x7fa9900cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 --2- 172.21.15.81:0/2452959770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9901453e0 0x7fa9900cd5a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa99006d270 tx=0x7fa98002aa30 comp rx=0 tx=0).stop 2024-09-10T20:41:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 -- 172.21.15.81:0/2452959770 shutdown_connections 2024-09-10T20:41:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 --2- 172.21.15.81:0/2452959770 >> v2:172.21.15.143:3300/0 conn(0x7fa99006ed70 0x7fa9900b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 --2- 172.21.15.81:0/2452959770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9901453e0 0x7fa9900cd5a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 -- 172.21.15.81:0/2452959770 >> 172.21.15.81:0/2452959770 conn(0x7fa990068f90 msgr2=0x7fa99006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 -- 172.21.15.81:0/2452959770 shutdown_connections 2024-09-10T20:41:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.546+0000 7fa997a00640 1 -- 172.21.15.81:0/2452959770 wait complete. 2024-09-10T20:41:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.548+0000 7fa997a00640 1 Processor -- start 2024-09-10T20:41:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.548+0000 7fa997a00640 1 -- start start 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa997a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa99006ed70 0x7fa9901f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa997a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9900ceff0 0x7fa9901e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa997a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9901453e0 0x7fa9901e5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa997a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9900b3f10 con 0x7fa99006ed70 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa997a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa9900b3d90 con 0x7fa9900ceff0 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa997a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa9900b4090 con 0x7fa9901453e0 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa99006ed70 0x7fa9901f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa99006ed70 0x7fa9901f80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49346/0 (socket says 172.21.15.81:49346) 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 -- 172.21.15.81:0/2309594260 learned_addr learned my addr 172.21.15.81:0/2309594260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa98fe00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9900ceff0 0x7fa9901e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995a00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9901453e0 0x7fa9901e5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 -- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9901453e0 msgr2=0x7fa9901e5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9901453e0 0x7fa9901e5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 -- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9900ceff0 msgr2=0x7fa9901e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9900ceff0 0x7fa9901e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa995000640 1 -- 172.21.15.81:0/2309594260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9901f8f20 con 0x7fa99006ed70 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.549+0000 7fa98fe00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9900ceff0 0x7fa9901e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.550+0000 7fa995000640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa99006ed70 0x7fa9901f80a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa980009d60 tx=0x7fa980003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.550+0000 7fa98cc00640 1 -- 172.21.15.81:0/2309594260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980033050 con 0x7fa99006ed70 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.550+0000 7fa98cc00640 1 -- 172.21.15.81:0/2309594260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9800044f0 con 0x7fa99006ed70 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.550+0000 7fa98cc00640 1 -- 172.21.15.81:0/2309594260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980038450 con 0x7fa99006ed70 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.550+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9901f8960 con 0x7fa99006ed70 2024-09-10T20:41:24.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.550+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9901e5590 con 0x7fa99006ed70 2024-09-10T20:41:24.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.551+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9900b3640 con 0x7fa99006ed70 2024-09-10T20:41:24.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.552+0000 7fa98cc00640 1 -- 172.21.15.81:0/2309594260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa980040070 con 0x7fa99006ed70 2024-09-10T20:41:24.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.553+0000 7fa98cc00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa96c077f70 0x7fa96c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.553+0000 7fa98cc00640 1 -- 172.21.15.81:0/2309594260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6640+0+0 (secure 0 0 0) 0x7fa9800bb580 con 0x7fa99006ed70 2024-09-10T20:41:24.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.554+0000 7fa98fe00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa96c077f70 0x7fa96c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.554+0000 7fa98fe00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa96c077f70 0x7fa96c07a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa9900741f0 tx=0x7fa978009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:24.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.558+0000 7fa98cc00640 1 -- 172.21.15.81:0/2309594260 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa980083c60 con 0x7fa99006ed70 2024-09-10T20:41:24.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.742+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa990074450 con 0x7fa99006ed70 2024-09-10T20:41:24.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.744+0000 7fa98cc00640 1 -- 172.21.15.81:0/2309594260 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+19036 (secure 0 0 0) 0x7fa98008c380 con 0x7fa99006ed70 2024-09-10T20:41:24.749 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:24.749 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:23.771896+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-10T20:41:21.973646+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa96c077f70 msgr2=0x7fa96c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa96c077f70 0x7fa96c07a430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa9900741f0 tx=0x7fa978009040 comp rx=0 tx=0).stop 2024-09-10T20:41:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa99006ed70 msgr2=0x7fa9901f80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa99006ed70 0x7fa9901f80a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa980009d60 tx=0x7fa980003f10 comp rx=0 tx=0).stop 2024-09-10T20:41:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 shutdown_connections 2024-09-10T20:41:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa96c077f70 0x7fa96c07a430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa9901453e0 0x7fa9901e5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa9900ceff0 0x7fa9901e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 --2- 172.21.15.81:0/2309594260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa99006ed70 0x7fa9901f80a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 >> 172.21.15.81:0/2309594260 conn(0x7fa990068f90 msgr2=0x7fa9900b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 shutdown_connections 2024-09-10T20:41:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.746+0000 7fa997a00640 1 -- 172.21.15.81:0/2309594260 wait complete. 2024-09-10T20:41:24.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs standby_count_wanted 0 2024-09-10T20:41:24.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 -- 172.21.15.81:0/3401226527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 msgr2=0x7ff20406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 --2- 172.21.15.81:0/3401226527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff20406eab0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff20415f5a0 tx=0x7ff1f002a5f0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 -- 172.21.15.81:0/3401226527 shutdown_connections 2024-09-10T20:41:24.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 --2- 172.21.15.81:0/3401226527 >> v2:172.21.15.143:3300/0 conn(0x7ff20415d3f0 0x7ff20415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 --2- 172.21.15.81:0/3401226527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff20406eab0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 -- 172.21.15.81:0/3401226527 >> 172.21.15.81:0/3401226527 conn(0x7ff204069020 msgr2=0x7ff20406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:24.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 -- 172.21.15.81:0/3401226527 shutdown_connections 2024-09-10T20:41:24.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.924+0000 7ff209600640 1 -- 172.21.15.81:0/3401226527 wait complete. 2024-09-10T20:41:24.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.926+0000 7ff209600640 1 Processor -- start 2024-09-10T20:41:24.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.926+0000 7ff209600640 1 -- start start 2024-09-10T20:41:24.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff209600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff2041f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff209600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2041453c0 0x7ff2041530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff209600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff20415d3f0 0x7ff204153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff209600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff20415ded0 con 0x7ff20406e660 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff209600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff20415dd50 con 0x7ff2041453c0 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff209600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff20415e050 con 0x7ff20415d3f0 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff2041f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff2041f7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41120/0 (socket says 172.21.15.81:41120) 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 -- 172.21.15.81:0/1556635769 learned_addr learned my addr 172.21.15.81:0/1556635769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 -- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff20415d3f0 msgr2=0x7ff204153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff20415d3f0 0x7ff204153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 -- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2041453c0 msgr2=0x7ff2041530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:24.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2041453c0 0x7ff2041530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:24.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.927+0000 7ff202a00640 1 -- 172.21.15.81:0/1556635769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2041e7de0 con 0x7ff20406e660 2024-09-10T20:41:24.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.928+0000 7ff202a00640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff2041f7810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c530 tx=0x7ff1f400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:24.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.928+0000 7ff1faa00640 1 -- 172.21.15.81:0/1556635769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4017070 con 0x7ff20406e660 2024-09-10T20:41:24.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.928+0000 7ff1faa00640 1 -- 172.21.15.81:0/1556635769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1f40036e0 con 0x7ff20406e660 2024-09-10T20:41:24.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.928+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff204132e30 con 0x7ff20406e660 2024-09-10T20:41:24.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.928+0000 7ff1faa00640 1 -- 172.21.15.81:0/1556635769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4003b30 con 0x7ff20406e660 2024-09-10T20:41:24.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.928+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2041e7080 con 0x7ff20406e660 2024-09-10T20:41:24.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.929+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2040ce6b0 con 0x7ff20406e660 2024-09-10T20:41:24.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.930+0000 7ff1faa00640 1 -- 172.21.15.81:0/1556635769 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff1f4003cd0 con 0x7ff20406e660 2024-09-10T20:41:24.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.931+0000 7ff1faa00640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff1e4077fa0 0x7ff1e407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:24.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.931+0000 7ff1faa00640 1 -- 172.21.15.81:0/1556635769 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6640+0+0 (secure 0 0 0) 0x7ff1f40997c0 con 0x7ff20406e660 2024-09-10T20:41:24.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.932+0000 7ff202000640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff1e4077fa0 0x7ff1e407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:24.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.932+0000 7ff202000640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff1e4077fa0 0x7ff1e407a460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0033000 tx=0x7ff1f00046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:24.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:24.935+0000 7ff1faa00640 1 -- 172.21.15.81:0/1556635769 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff2040ce6b0 con 0x7ff20406e660 2024-09-10T20:41:25.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:25.156+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff20415e520 con 0x7ff20406e660 2024-09-10T20:41:26.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.001+0000 7ff1faa00640 1 -- 172.21.15.81:0/1556635769 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7ff1f4061fb0 con 0x7ff20406e660 2024-09-10T20:41:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff1e4077fa0 msgr2=0x7ff1e407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff1e4077fa0 0x7ff1e407a460 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0033000 tx=0x7ff1f00046c0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 msgr2=0x7ff2041f7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff2041f7810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c530 tx=0x7ff1f400c9f0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 shutdown_connections 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff1e4077fa0 0x7ff1e407a460 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff20415d3f0 0x7ff204153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2041453c0 0x7ff2041530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 --2- 172.21.15.81:0/1556635769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff20406e660 0x7ff2041f7810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 >> 172.21.15.81:0/1556635769 conn(0x7ff204069020 msgr2=0x7ff2040b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 shutdown_connections 2024-09-10T20:41:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.004+0000 7ff209600640 1 -- 172.21.15.81:0/1556635769 wait complete. 2024-09-10T20:41:26.027 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T20:41:26.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs allow_standby_replay false 2024-09-10T20:41:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.184+0000 7fbd66e00640 1 -- 172.21.15.81:0/2317966206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd60145350 msgr2=0x7fbd600cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.184+0000 7fbd66e00640 1 --2- 172.21.15.81:0/2317966206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd60145350 0x7fbd600cd5a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009830 tx=0x7fbd5002a3f0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.184+0000 7fbd66e00640 1 -- 172.21.15.81:0/2317966206 shutdown_connections 2024-09-10T20:41:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.184+0000 7fbd66e00640 1 --2- 172.21.15.81:0/2317966206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd60145350 0x7fbd600cd5a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.184+0000 7fbd66e00640 1 -- 172.21.15.81:0/2317966206 >> 172.21.15.81:0/2317966206 conn(0x7fbd60069020 msgr2=0x7fbd6006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.184+0000 7fbd66e00640 1 -- 172.21.15.81:0/2317966206 shutdown_connections 2024-09-10T20:41:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.184+0000 7fbd66e00640 1 -- 172.21.15.81:0/2317966206 wait complete. 2024-09-10T20:41:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.186+0000 7fbd66e00640 1 Processor -- start 2024-09-10T20:41:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.186+0000 7fbd66e00640 1 -- start start 2024-09-10T20:41:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd66e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd6006ed70 0x7fbd6013b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd66e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600cf090 0x7fbd600ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd66e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd60145350 0x7fbd600adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd66e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600b42f0 con 0x7fbd600cf090 2024-09-10T20:41:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd66e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbd600b4170 con 0x7fbd60145350 2024-09-10T20:41:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd66e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbd600b4470 con 0x7fbd6006ed70 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd57400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600cf090 0x7fbd600ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd57400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600cf090 0x7fbd600ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41138/0 (socket says 172.21.15.81:41138) 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd57400640 1 -- 172.21.15.81:0/785496992 learned_addr learned my addr 172.21.15.81:0/785496992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd5fe00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd6006ed70 0x7fbd6013b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.187+0000 7fbd64e00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd60145350 0x7fbd600adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd57400640 1 -- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd6006ed70 msgr2=0x7fbd6013b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd57400640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd6006ed70 0x7fbd6013b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd57400640 1 -- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd60145350 msgr2=0x7fbd600adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd57400640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd60145350 0x7fbd600adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd57400640 1 -- 172.21.15.81:0/785496992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd60073ce0 con 0x7fbd600cf090 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd57400640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600cf090 0x7fbd600ad8a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c500 tx=0x7fbd4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd5cc00640 1 -- 172.21.15.81:0/785496992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48017070 con 0x7fbd600cf090 2024-09-10T20:41:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd5cc00640 1 -- 172.21.15.81:0/785496992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd480035f0 con 0x7fbd600cf090 2024-09-10T20:41:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6013fc20 con 0x7fbd600cf090 2024-09-10T20:41:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd5cc00640 1 -- 172.21.15.81:0/785496992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48003a40 con 0x7fbd600cf090 2024-09-10T20:41:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.188+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd601401e0 con 0x7fbd600cf090 2024-09-10T20:41:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.189+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd600b4980 con 0x7fbd600cf090 2024-09-10T20:41:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.190+0000 7fbd5cc00640 1 -- 172.21.15.81:0/785496992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbd48003be0 con 0x7fbd600cf090 2024-09-10T20:41:26.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.191+0000 7fbd5cc00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbd3c077f70 0x7fbd3c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:26.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.191+0000 7fbd5cc00640 1 -- 172.21.15.81:0/785496992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7fbd480998c0 con 0x7fbd600cf090 2024-09-10T20:41:26.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.192+0000 7fbd5fe00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbd3c077f70 0x7fbd3c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.192+0000 7fbd5fe00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbd3c077f70 0x7fbd3c07a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd50034000 tx=0x7fbd50004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.195+0000 7fbd5cc00640 1 -- 172.21.15.81:0/785496992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbd48062030 con 0x7fbd600cf090 2024-09-10T20:41:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:26.413+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbd6006fdd0 con 0x7fbd600cf090 2024-09-10T20:41:27.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.008+0000 7fbd5cc00640 1 -- 172.21.15.81:0/785496992 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 127+0+0 (secure 0 0 0) 0x7fbd48061930 con 0x7fbd600cf090 2024-09-10T20:41:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbd3c077f70 msgr2=0x7fbd3c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbd3c077f70 0x7fbd3c07a430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbd50034000 tx=0x7fbd50004730 comp rx=0 tx=0).stop 2024-09-10T20:41:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600cf090 msgr2=0x7fbd600ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600cf090 0x7fbd600ad8a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c500 tx=0x7fbd4800c9c0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 shutdown_connections 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbd3c077f70 0x7fbd3c07a430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd60145350 0x7fbd600adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd600cf090 0x7fbd600ad8a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 --2- 172.21.15.81:0/785496992 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbd6006ed70 0x7fbd6013b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 >> 172.21.15.81:0/785496992 conn(0x7fbd60069020 msgr2=0x7fbd600b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 shutdown_connections 2024-09-10T20:41:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.011+0000 7fbd66e00640 1 -- 172.21.15.81:0/785496992 wait complete. 2024-09-10T20:41:27.034 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'recovery_fs' 2024-09-10T20:41:27.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.187+0000 7f7fb5200640 1 -- 172.21.15.81:0/905650981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 msgr2=0x7f7fb00d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.187+0000 7f7fb5200640 1 --2- 172.21.15.81:0/905650981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00d47e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00cad20 tx=0x7f7fa002a5f0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.188+0000 7f7fb5200640 1 -- 172.21.15.81:0/905650981 shutdown_connections 2024-09-10T20:41:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.188+0000 7f7fb5200640 1 --2- 172.21.15.81:0/905650981 >> v2:172.21.15.143:3300/0 conn(0x7f7fb00d2450 0x7f7fb00b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.188+0000 7f7fb5200640 1 --2- 172.21.15.81:0/905650981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00d47e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.188+0000 7f7fb5200640 1 -- 172.21.15.81:0/905650981 >> 172.21.15.81:0/905650981 conn(0x7f7fb00d3cc0 msgr2=0x7f7fb00d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.188+0000 7f7fb5200640 1 -- 172.21.15.81:0/905650981 shutdown_connections 2024-09-10T20:41:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.188+0000 7f7fb5200640 1 -- 172.21.15.81:0/905650981 wait complete. 2024-09-10T20:41:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.189+0000 7f7fb5200640 1 Processor -- start 2024-09-10T20:41:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.190+0000 7f7fb5200640 1 -- start start 2024-09-10T20:41:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.190+0000 7f7fb5200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb00cf240 0x7f7fb0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.190+0000 7f7fb5200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb00d2450 0x7f7fb014d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.190+0000 7f7fb5200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.190+0000 7f7fb5200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb00b4d60 con 0x7f7fb015df60 2024-09-10T20:41:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.190+0000 7f7fb5200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb00b4be0 con 0x7f7fb00d2450 2024-09-10T20:41:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fb5200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb00b4ee0 con 0x7f7fb00cf240 2024-09-10T20:41:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41166/0 (socket says 172.21.15.81:41166) 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 -- 172.21.15.81:0/1166415994 learned_addr learned my addr 172.21.15.81:0/1166415994 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7faf400640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb00cf240 0x7f7fb0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 -- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb00cf240 msgr2=0x7f7fb0150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7faea00640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb00d2450 0x7f7fb014d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb00cf240 0x7f7fb0150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 -- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb00d2450 msgr2=0x7f7fb014d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb00d2450 0x7f7fb014d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 -- 172.21.15.81:0/1166415994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb01f82e0 con 0x7f7fb015df60 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7faf400640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb00cf240 0x7f7fb0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7faea00640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb00d2450 0x7f7fb014d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.191+0000 7f7fafe00640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00ccdd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800ead0 tx=0x7f7fa800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.192+0000 7f7fa7400640 1 -- 172.21.15.81:0/1166415994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800cde0 con 0x7f7fb015df60 2024-09-10T20:41:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.192+0000 7f7fa7400640 1 -- 172.21.15.81:0/1166415994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fa8004c10 con 0x7f7fb015df60 2024-09-10T20:41:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.192+0000 7f7fa7400640 1 -- 172.21.15.81:0/1166415994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8005020 con 0x7f7fb015df60 2024-09-10T20:41:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.192+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb01f85c0 con 0x7f7fb015df60 2024-09-10T20:41:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.192+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb01f8b80 con 0x7f7fb015df60 2024-09-10T20:41:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.193+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb008d320 con 0x7f7fb015df60 2024-09-10T20:41:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.194+0000 7f7fa7400640 1 -- 172.21.15.81:0/1166415994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7fa800f040 con 0x7f7fb015df60 2024-09-10T20:41:27.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.195+0000 7f7fa7400640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7f90077f70 0x7f7f9007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.196+0000 7f7fa7400640 1 -- 172.21.15.81:0/1166415994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f7fa809a750 con 0x7f7fb015df60 2024-09-10T20:41:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.196+0000 7f7faf400640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7f90077f70 0x7f7f9007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.197+0000 7f7faf400640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7f90077f70 0x7f7f9007a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0033000 tx=0x7f7fa0004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.200+0000 7f7fa7400640 1 -- 172.21.15.81:0/1166415994 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7fb008d320 con 0x7f7fb015df60 2024-09-10T20:41:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.417+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fb00c8d70 con 0x7f7fb015df60 2024-09-10T20:41:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.418+0000 7f7fa7400640 1 -- 172.21.15.81:0/1166415994 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+6519 (secure 0 0 0) 0x7f7fb00c8d70 con 0x7f7fb015df60 2024-09-10T20:41:27.423 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:27.424 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-10T20:41:27:003995+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":25,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:26.416089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-10T20:41:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-10T20:41:27.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7f90077f70 msgr2=0x7f7f9007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7f90077f70 0x7f7f9007a430 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0033000 tx=0x7f7fa0004730 comp rx=0 tx=0).stop 2024-09-10T20:41:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 msgr2=0x7f7fb00ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00ccdd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800ead0 tx=0x7f7fa800ef90 comp rx=0 tx=0).stop 2024-09-10T20:41:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 shutdown_connections 2024-09-10T20:41:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7f90077f70 0x7f7f9007a430 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb015df60 0x7f7fb00ccdd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7fb00d2450 0x7f7fb014d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 --2- 172.21.15.81:0/1166415994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7fb00cf240 0x7f7fb0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 >> 172.21.15.81:0/1166415994 conn(0x7f7fb00d3cc0 msgr2=0x7f7fb00d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 shutdown_connections 2024-09-10T20:41:27.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.420+0000 7f7fb5200640 1 -- 172.21.15.81:0/1166415994 wait complete. 2024-09-10T20:41:27.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.596+0000 7f78dda00640 1 -- 172.21.15.81:0/1683324915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d80cf1b0 msgr2=0x7f78d80b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.596+0000 7f78dda00640 1 --2- 172.21.15.81:0/1683324915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d80cf1b0 0x7f78d80b3c00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f78d0005fd0 tx=0x7f78d002a8b0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.596+0000 7f78dda00640 1 -- 172.21.15.81:0/1683324915 shutdown_connections 2024-09-10T20:41:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.596+0000 7f78dda00640 1 --2- 172.21.15.81:0/1683324915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d80cf1b0 0x7f78d80b3c00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.596+0000 7f78dda00640 1 -- 172.21.15.81:0/1683324915 >> 172.21.15.81:0/1683324915 conn(0x7f78d8068f90 msgr2=0x7f78d806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:27.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.596+0000 7f78dda00640 1 -- 172.21.15.81:0/1683324915 shutdown_connections 2024-09-10T20:41:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.596+0000 7f78dda00640 1 -- 172.21.15.81:0/1683324915 wait complete. 2024-09-10T20:41:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.598+0000 7f78dda00640 1 Processor -- start 2024-09-10T20:41:27.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.598+0000 7f78dda00640 1 -- start start 2024-09-10T20:41:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78dda00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78d80cf1b0 0x7f78d81f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78dda00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78d81441d0 0x7f78d813c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78dda00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d815eda0 0x7f78d813d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78dda00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8072980 con 0x7f78d815eda0 2024-09-10T20:41:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78dda00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f78d8072800 con 0x7f78d81441d0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78dda00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f78d8072b00 con 0x7f78d80cf1b0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d815eda0 0x7f78d813d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d815eda0 0x7f78d813d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41184/0 (socket says 172.21.15.81:41184) 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 -- 172.21.15.81:0/2151556563 learned_addr learned my addr 172.21.15.81:0/2151556563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d6a00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78d80cf1b0 0x7f78d81f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d6000640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78d81441d0 0x7f78d813c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 -- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78d80cf1b0 msgr2=0x7f78d81f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78d80cf1b0 0x7f78d81f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 -- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78d81441d0 msgr2=0x7f78d813c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78d81441d0 0x7f78d813c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.599+0000 7f78d7400640 1 -- 172.21.15.81:0/2151556563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d815b210 con 0x7f78d815eda0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.600+0000 7f78d7400640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d815eda0 0x7f78d813d3a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009cd0 tx=0x7f78d0031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.600+0000 7f78cea00640 1 -- 172.21.15.81:0/2151556563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0040070 con 0x7f78d815eda0 2024-09-10T20:41:27.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.600+0000 7f78cea00640 1 -- 172.21.15.81:0/2151556563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78d0004040 con 0x7f78d815eda0 2024-09-10T20:41:27.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.600+0000 7f78cea00640 1 -- 172.21.15.81:0/2151556563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0004450 con 0x7f78d815eda0 2024-09-10T20:41:27.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.600+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d815ba70 con 0x7f78d815eda0 2024-09-10T20:41:27.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.600+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d815b4b0 con 0x7f78d815eda0 2024-09-10T20:41:27.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.601+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d8072fb0 con 0x7f78d815eda0 2024-09-10T20:41:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.602+0000 7f78cea00640 1 -- 172.21.15.81:0/2151556563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f78d00045f0 con 0x7f78d815eda0 2024-09-10T20:41:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.603+0000 7f78cea00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.603+0000 7f78cea00640 1 -- 172.21.15.81:0/2151556563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f78d00bba30 con 0x7f78d815eda0 2024-09-10T20:41:27.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.603+0000 7f78d6a00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.604+0000 7f78d6a00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f78b8077f70 0x7f78b807a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78d813ede0 tx=0x7f78c8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:27.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.607+0000 7f78cea00640 1 -- 172.21.15.81:0/2151556563 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f78d00841a0 con 0x7f78d815eda0 2024-09-10T20:41:27.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.790+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78d815be10 con 0x7f78d815eda0 2024-09-10T20:41:27.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.792+0000 7f78cea00640 1 -- 172.21.15.81:0/2151556563 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+19023 (secure 0 0 0) 0x7f78d0083aa0 con 0x7f78d815eda0 2024-09-10T20:41:27.797 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:27.797 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":48,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:24.989816+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-10T20:41:21.973646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:27.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f78b8077f70 msgr2=0x7f78b807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f78b8077f70 0x7f78b807a430 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f78d813ede0 tx=0x7f78c8009040 comp rx=0 tx=0).stop 2024-09-10T20:41:27.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d815eda0 msgr2=0x7f78d813d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d815eda0 0x7f78d813d3a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009cd0 tx=0x7f78d0031760 comp rx=0 tx=0).stop 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 shutdown_connections 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f78b8077f70 0x7f78b807a430 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d815eda0 0x7f78d813d3a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78d81441d0 0x7f78d813c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 --2- 172.21.15.81:0/2151556563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78d80cf1b0 0x7f78d81f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 >> 172.21.15.81:0/2151556563 conn(0x7f78d8068f90 msgr2=0x7f78d815d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 shutdown_connections 2024-09-10T20:41:27.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.794+0000 7f78dda00640 1 -- 172.21.15.81:0/2151556563 wait complete. 2024-09-10T20:41:27.815 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:41:27.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.968+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1516124724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80d2450 msgr2=0x7f2dc80d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.968+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1516124724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80d2450 0x7f2dc80d47e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005fd0 tx=0x7f2db402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.968+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1516124724 shutdown_connections 2024-09-10T20:41:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.968+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1516124724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80d2450 0x7f2dc80d47e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.968+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1516124724 >> 172.21.15.81:0/1516124724 conn(0x7f2dc80d3cc0 msgr2=0x7f2dc80d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.968+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1516124724 shutdown_connections 2024-09-10T20:41:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.968+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1516124724 wait complete. 2024-09-10T20:41:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.969+0000 7f2dc7e00640 1 Processor -- start 2024-09-10T20:41:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.969+0000 7f2dc7e00640 1 -- start start 2024-09-10T20:41:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.970+0000 7f2dc7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80cf240 0x7f2dc81551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.970+0000 7f2dc7e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dc80d2450 0x7f2dc8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.970+0000 7f2dc7e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dc815df60 0x7f2dc815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.970+0000 7f2dc7e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc80b4f10 con 0x7f2dc80cf240 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.970+0000 7f2dc7e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc80b4d90 con 0x7f2dc80d2450 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.970+0000 7f2dc7e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc80b5090 con 0x7f2dc815df60 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.970+0000 7f2dc6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80cf240 0x7f2dc81551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80cf240 0x7f2dc81551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41202/0 (socket says 172.21.15.81:41202) 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 -- 172.21.15.81:0/1969946725 learned_addr learned my addr 172.21.15.81:0/1969946725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6000640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dc80d2450 0x7f2dc8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc7400640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dc815df60 0x7f2dc815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 -- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dc815df60 msgr2=0x7f2dc815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dc815df60 0x7f2dc815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 -- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dc80d2450 msgr2=0x7f2dc8157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dc80d2450 0x7f2dc8157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 -- 172.21.15.81:0/1969946725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc815c0d0 con 0x7f2dc80cf240 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6000640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dc80d2450 0x7f2dc8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc6a00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80cf240 0x7f2dc81551e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c3a0 tx=0x7f2db800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dbea00640 1 -- 172.21.15.81:0/1969946725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8017070 con 0x7f2dc80cf240 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dbea00640 1 -- 172.21.15.81:0/1969946725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db80053c0 con 0x7f2dc80cf240 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc8154700 con 0x7f2dc80cf240 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.971+0000 7f2dbea00640 1 -- 172.21.15.81:0/1969946725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8003850 con 0x7f2dc80cf240 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.972+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc8155720 con 0x7f2dc80cf240 2024-09-10T20:41:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.973+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc80d47e0 con 0x7f2dc80cf240 2024-09-10T20:41:27.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.974+0000 7f2dbea00640 1 -- 172.21.15.81:0/1969946725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2db80039f0 con 0x7f2dc80cf240 2024-09-10T20:41:27.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.975+0000 7f2dbea00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2da8077f70 0x7f2da807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:27.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.975+0000 7f2dbea00640 1 -- 172.21.15.81:0/1969946725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f2db8099740 con 0x7f2dc80cf240 2024-09-10T20:41:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.975+0000 7f2dc6000640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2da8077f70 0x7f2da807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:27.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.976+0000 7f2dc6000640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2da8077f70 0x7f2da807a430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2db4033000 tx=0x7f2db4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:27.979+0000 7f2dbea00640 1 -- 172.21.15.81:0/1969946725 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2db8061ea0 con 0x7f2dc80cf240 2024-09-10T20:41:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.160+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2dc8155a10 con 0x7f2da8077f70 2024-09-10T20:41:28.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.167+0000 7f2dbea00640 1 -- 172.21.15.81:0/1969946725 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332032 (secure 0 0 0) 0x7f2dc8155a10 con 0x7f2da8077f70 2024-09-10T20:41:28.176 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2da8077f70 msgr2=0x7f2da807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2da8077f70 0x7f2da807a430 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2db4033000 tx=0x7f2db4004730 comp rx=0 tx=0).stop 2024-09-10T20:41:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80cf240 msgr2=0x7f2dc81551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80cf240 0x7f2dc81551e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c3a0 tx=0x7f2db800c860 comp rx=0 tx=0).stop 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 shutdown_connections 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2da8077f70 0x7f2da807a430 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2dc815df60 0x7f2dc815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2dc80d2450 0x7f2dc8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 --2- 172.21.15.81:0/1969946725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc80cf240 0x7f2dc81551e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 >> 172.21.15.81:0/1969946725 conn(0x7f2dc80d3cc0 msgr2=0x7f2dc80d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 shutdown_connections 2024-09-10T20:41:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.172+0000 7f2dc7e00640 1 -- 172.21.15.81:0/1969946725 wait complete. 2024-09-10T20:41:28.192 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-10T20:41:27.868584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":203,"num_write_kb":7813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661,"ondisk_log_size":661,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233960,"kb_used_data":17708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740760,"statfs":{"total":773094113280,"available":772854538240,"internally_reserved":0,"allocated":18132992,"data_stored":15718463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.904965"},"pg_stats":[{"pgid":"6.3f","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002280+0000","last_change":"2024-09-10T20:40:57.808566+0000","last_active":"2024-09-10T20:41:25.002280+0000","last_peered":"2024-09-10T20:41:25.002280+0000","last_clean":"2024-09-10T20:41:25.002280+0000","last_became_active":"2024-09-10T20:40:57.808299+0000","last_became_peered":"2024-09-10T20:40:57.808299+0000","last_unstale":"2024-09-10T20:41:25.002280+0000","last_undegraded":"2024-09-10T20:41:25.002280+0000","last_fullsized":"2024-09-10T20:41:25.002280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:11.202752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.785246+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.784969+0000","last_became_peered":"2024-09-10T20:40:57.784969+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:26.513133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002056+0000","last_change":"2024-09-10T20:40:57.798413+0000","last_active":"2024-09-10T20:41:25.002056+0000","last_peered":"2024-09-10T20:41:25.002056+0000","last_clean":"2024-09-10T20:41:25.002056+0000","last_became_active":"2024-09-10T20:40:57.798085+0000","last_became_peered":"2024-09-10T20:40:57.798085+0000","last_unstale":"2024-09-10T20:41:25.002056+0000","last_undegraded":"2024-09-10T20:41:25.002056+0000","last_fullsized":"2024-09-10T20:41:25.002056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:33.904500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002674+0000","last_change":"2024-09-10T20:40:57.793918+0000","last_active":"2024-09-10T20:41:25.002674+0000","last_peered":"2024-09-10T20:41:25.002674+0000","last_clean":"2024-09-10T20:41:25.002674+0000","last_became_active":"2024-09-10T20:40:57.793335+0000","last_became_peered":"2024-09-10T20:40:57.793335+0000","last_unstale":"2024-09-10T20:41:25.002674+0000","last_undegraded":"2024-09-10T20:41:25.002674+0000","last_fullsized":"2024-09-10T20:41:25.002674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:12.740619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"40'4","reported_seq":30,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985310+0000","last_change":"2024-09-10T20:40:57.802056+0000","last_active":"2024-09-10T20:41:23.985310+0000","last_peered":"2024-09-10T20:41:23.985310+0000","last_clean":"2024-09-10T20:41:23.985310+0000","last_became_active":"2024-09-10T20:40:57.801252+0000","last_became_peered":"2024-09-10T20:40:57.801252+0000","last_unstale":"2024-09-10T20:41:23.985310+0000","last_undegraded":"2024-09-10T20:41:23.985310+0000","last_fullsized":"2024-09-10T20:41:23.985310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:43.552747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295818+0000","last_change":"2024-09-10T20:40:57.781646+0000","last_active":"2024-09-10T20:41:25.295818+0000","last_peered":"2024-09-10T20:41:25.295818+0000","last_clean":"2024-09-10T20:41:25.295818+0000","last_became_active":"2024-09-10T20:40:57.781350+0000","last_became_peered":"2024-09-10T20:40:57.781350+0000","last_unstale":"2024-09-10T20:41:25.295818+0000","last_undegraded":"2024-09-10T20:41:25.295818+0000","last_fullsized":"2024-09-10T20:41:25.295818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.959912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001962+0000","last_change":"2024-09-10T20:40:57.797129+0000","last_active":"2024-09-10T20:41:25.001962+0000","last_peered":"2024-09-10T20:41:25.001962+0000","last_clean":"2024-09-10T20:41:25.001962+0000","last_became_active":"2024-09-10T20:40:57.796854+0000","last_became_peered":"2024-09-10T20:40:57.796854+0000","last_unstale":"2024-09-10T20:41:25.001962+0000","last_undegraded":"2024-09-10T20:41:25.001962+0000","last_fullsized":"2024-09-10T20:41:25.001962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:43.327598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001457+0000","last_change":"2024-09-10T20:40:57.808609+0000","last_active":"2024-09-10T20:41:25.001457+0000","last_peered":"2024-09-10T20:41:25.001457+0000","last_clean":"2024-09-10T20:41:25.001457+0000","last_became_active":"2024-09-10T20:40:57.807999+0000","last_became_peered":"2024-09-10T20:40:57.807999+0000","last_unstale":"2024-09-10T20:41:25.001457+0000","last_undegraded":"2024-09-10T20:41:25.001457+0000","last_fullsized":"2024-09-10T20:41:25.001457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"40'11","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987894+0000","last_change":"2024-09-10T20:40:57.802618+0000","last_active":"2024-09-10T20:41:23.987894+0000","last_peered":"2024-09-10T20:41:23.987894+0000","last_clean":"2024-09-10T20:41:23.987894+0000","last_became_active":"2024-09-10T20:40:57.801991+0000","last_became_peered":"2024-09-10T20:40:57.801991+0000","last_unstale":"2024-09-10T20:41:23.987894+0000","last_undegraded":"2024-09-10T20:41:23.987894+0000","last_fullsized":"2024-09-10T20:41:23.987894+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:57.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002527+0000","last_change":"2024-09-10T20:40:57.805178+0000","last_active":"2024-09-10T20:41:25.002527+0000","last_peered":"2024-09-10T20:41:25.002527+0000","last_clean":"2024-09-10T20:41:25.002527+0000","last_became_active":"2024-09-10T20:40:57.804919+0000","last_became_peered":"2024-09-10T20:40:57.804919+0000","last_unstale":"2024-09-10T20:41:25.002527+0000","last_undegraded":"2024-09-10T20:41:25.002527+0000","last_fullsized":"2024-09-10T20:41:25.002527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:34.267791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267431+0000","last_change":"2024-09-10T20:40:57.797147+0000","last_active":"2024-09-10T20:41:25.267431+0000","last_peered":"2024-09-10T20:41:25.267431+0000","last_clean":"2024-09-10T20:41:25.267431+0000","last_became_active":"2024-09-10T20:40:57.796910+0000","last_became_peered":"2024-09-10T20:40:57.796910+0000","last_unstale":"2024-09-10T20:41:25.267431+0000","last_undegraded":"2024-09-10T20:41:25.267431+0000","last_fullsized":"2024-09-10T20:41:25.267431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:43.015903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"40'7","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986521+0000","last_change":"2024-09-10T20:40:57.804510+0000","last_active":"2024-09-10T20:41:23.986521+0000","last_peered":"2024-09-10T20:41:23.986521+0000","last_clean":"2024-09-10T20:41:23.986521+0000","last_became_active":"2024-09-10T20:40:57.804220+0000","last_became_peered":"2024-09-10T20:40:57.804220+0000","last_unstale":"2024-09-10T20:41:23.986521+0000","last_undegraded":"2024-09-10T20:41:23.986521+0000","last_fullsized":"2024-09-10T20:41:23.986521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:55.727449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002169+0000","last_change":"2024-09-10T20:40:57.795473+0000","last_active":"2024-09-10T20:41:25.002169+0000","last_peered":"2024-09-10T20:41:25.002169+0000","last_clean":"2024-09-10T20:41:25.002169+0000","last_became_active":"2024-09-10T20:40:57.795179+0000","last_became_peered":"2024-09-10T20:40:57.795179+0000","last_unstale":"2024-09-10T20:41:25.002169+0000","last_undegraded":"2024-09-10T20:41:25.002169+0000","last_fullsized":"2024-09-10T20:41:25.002169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"40'8","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991972+0000","last_change":"2024-09-10T20:40:57.801649+0000","last_active":"2024-09-10T20:41:23.991972+0000","last_peered":"2024-09-10T20:41:23.991972+0000","last_clean":"2024-09-10T20:41:23.991972+0000","last_became_active":"2024-09-10T20:40:57.797096+0000","last_became_peered":"2024-09-10T20:40:57.797096+0000","last_unstale":"2024-09-10T20:41:23.991972+0000","last_undegraded":"2024-09-10T20:41:23.991972+0000","last_fullsized":"2024-09-10T20:41:23.991972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:05.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023428+0000","last_change":"2024-09-10T20:40:57.779842+0000","last_active":"2024-09-10T20:41:25.023428+0000","last_peered":"2024-09-10T20:41:25.023428+0000","last_clean":"2024-09-10T20:41:25.023428+0000","last_became_active":"2024-09-10T20:40:57.779564+0000","last_became_peered":"2024-09-10T20:40:57.779564+0000","last_unstale":"2024-09-10T20:41:25.023428+0000","last_undegraded":"2024-09-10T20:41:25.023428+0000","last_fullsized":"2024-09-10T20:41:25.023428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:23.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001997+0000","last_change":"2024-09-10T20:40:57.806288+0000","last_active":"2024-09-10T20:41:25.001997+0000","last_peered":"2024-09-10T20:41:25.001997+0000","last_clean":"2024-09-10T20:41:25.001997+0000","last_became_active":"2024-09-10T20:40:57.804491+0000","last_became_peered":"2024-09-10T20:40:57.804491+0000","last_unstale":"2024-09-10T20:41:25.001997+0000","last_undegraded":"2024-09-10T20:41:25.001997+0000","last_fullsized":"2024-09-10T20:41:25.001997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:18.810090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024138+0000","last_change":"2024-09-10T20:40:57.781946+0000","last_active":"2024-09-10T20:41:25.024138+0000","last_peered":"2024-09-10T20:41:25.024138+0000","last_clean":"2024-09-10T20:41:25.024138+0000","last_became_active":"2024-09-10T20:40:57.781711+0000","last_became_peered":"2024-09-10T20:40:57.781711+0000","last_unstale":"2024-09-10T20:41:25.024138+0000","last_undegraded":"2024-09-10T20:41:25.024138+0000","last_fullsized":"2024-09-10T20:41:25.024138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:57.437327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023982+0000","last_change":"2024-09-10T20:40:57.781131+0000","last_active":"2024-09-10T20:41:25.023982+0000","last_peered":"2024-09-10T20:41:25.023982+0000","last_clean":"2024-09-10T20:41:25.023982+0000","last_became_active":"2024-09-10T20:40:57.780857+0000","last_became_peered":"2024-09-10T20:40:57.780857+0000","last_unstale":"2024-09-10T20:41:25.023982+0000","last_undegraded":"2024-09-10T20:41:25.023982+0000","last_fullsized":"2024-09-10T20:41:25.023982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:18.298699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972503+0000","last_change":"2024-09-10T20:40:57.799870+0000","last_active":"2024-09-10T20:41:22.972503+0000","last_peered":"2024-09-10T20:41:22.972503+0000","last_clean":"2024-09-10T20:41:22.972503+0000","last_became_active":"2024-09-10T20:40:57.799593+0000","last_became_peered":"2024-09-10T20:40:57.799593+0000","last_unstale":"2024-09-10T20:41:22.972503+0000","last_undegraded":"2024-09-10T20:41:22.972503+0000","last_fullsized":"2024-09-10T20:41:22.972503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:27.031641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267232+0000","last_change":"2024-09-10T20:40:57.788576+0000","last_active":"2024-09-10T20:41:25.267232+0000","last_peered":"2024-09-10T20:41:25.267232+0000","last_clean":"2024-09-10T20:41:25.267232+0000","last_became_active":"2024-09-10T20:40:57.788342+0000","last_became_peered":"2024-09-10T20:40:57.788342+0000","last_unstale":"2024-09-10T20:41:25.267232+0000","last_undegraded":"2024-09-10T20:41:25.267232+0000","last_fullsized":"2024-09-10T20:41:25.267232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:56.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"40'11","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267138+0000","last_change":"2024-09-10T20:40:57.797333+0000","last_active":"2024-09-10T20:41:25.267138+0000","last_peered":"2024-09-10T20:41:25.267138+0000","last_clean":"2024-09-10T20:41:25.267138+0000","last_became_active":"2024-09-10T20:40:57.794482+0000","last_became_peered":"2024-09-10T20:40:57.794482+0000","last_unstale":"2024-09-10T20:41:25.267138+0000","last_undegraded":"2024-09-10T20:41:25.267138+0000","last_fullsized":"2024-09-10T20:41:25.267138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:33.113187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267051+0000","last_change":"2024-09-10T20:40:57.785890+0000","last_active":"2024-09-10T20:41:25.267051+0000","last_peered":"2024-09-10T20:41:25.267051+0000","last_clean":"2024-09-10T20:41:25.267051+0000","last_became_active":"2024-09-10T20:40:57.785582+0000","last_became_peered":"2024-09-10T20:40:57.785582+0000","last_unstale":"2024-09-10T20:41:25.267051+0000","last_undegraded":"2024-09-10T20:41:25.267051+0000","last_fullsized":"2024-09-10T20:41:25.267051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:51.491322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023468+0000","last_change":"2024-09-10T20:40:57.786174+0000","last_active":"2024-09-10T20:41:25.023468+0000","last_peered":"2024-09-10T20:41:25.023468+0000","last_clean":"2024-09-10T20:41:25.023468+0000","last_became_active":"2024-09-10T20:40:57.785175+0000","last_became_peered":"2024-09-10T20:40:57.785175+0000","last_unstale":"2024-09-10T20:41:25.023468+0000","last_undegraded":"2024-09-10T20:41:25.023468+0000","last_fullsized":"2024-09-10T20:41:25.023468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:23.271959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001563+0000","last_change":"2024-09-10T20:40:57.808222+0000","last_active":"2024-09-10T20:41:25.001563+0000","last_peered":"2024-09-10T20:41:25.001563+0000","last_clean":"2024-09-10T20:41:25.001563+0000","last_became_active":"2024-09-10T20:40:57.807578+0000","last_became_peered":"2024-09-10T20:40:57.807578+0000","last_unstale":"2024-09-10T20:41:25.001563+0000","last_undegraded":"2024-09-10T20:41:25.001563+0000","last_fullsized":"2024-09-10T20:41:25.001563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:25.893234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"40'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995400+0000","last_change":"2024-09-10T20:40:57.803089+0000","last_active":"2024-09-10T20:41:23.995400+0000","last_peered":"2024-09-10T20:41:23.995400+0000","last_clean":"2024-09-10T20:41:23.995400+0000","last_became_active":"2024-09-10T20:40:57.802606+0000","last_became_peered":"2024-09-10T20:40:57.802606+0000","last_unstale":"2024-09-10T20:41:23.995400+0000","last_undegraded":"2024-09-10T20:41:23.995400+0000","last_fullsized":"2024-09-10T20:41:23.995400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002118+0000","last_change":"2024-09-10T20:40:57.804633+0000","last_active":"2024-09-10T20:41:25.002118+0000","last_peered":"2024-09-10T20:41:25.002118+0000","last_clean":"2024-09-10T20:41:25.002118+0000","last_became_active":"2024-09-10T20:40:57.804388+0000","last_became_peered":"2024-09-10T20:40:57.804388+0000","last_unstale":"2024-09-10T20:41:25.002118+0000","last_undegraded":"2024-09-10T20:41:25.002118+0000","last_fullsized":"2024-09-10T20:41:25.002118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:17.686400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267480+0000","last_change":"2024-09-10T20:40:57.790304+0000","last_active":"2024-09-10T20:41:25.267480+0000","last_peered":"2024-09-10T20:41:25.267480+0000","last_clean":"2024-09-10T20:41:25.267480+0000","last_became_active":"2024-09-10T20:40:57.790064+0000","last_became_peered":"2024-09-10T20:40:57.790064+0000","last_unstale":"2024-09-10T20:41:25.267480+0000","last_undegraded":"2024-09-10T20:41:25.267480+0000","last_fullsized":"2024-09-10T20:41:25.267480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:03.995020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002320+0000","last_change":"2024-09-10T20:40:57.811854+0000","last_active":"2024-09-10T20:41:25.002320+0000","last_peered":"2024-09-10T20:41:25.002320+0000","last_clean":"2024-09-10T20:41:25.002320+0000","last_became_active":"2024-09-10T20:40:57.811532+0000","last_became_peered":"2024-09-10T20:40:57.811532+0000","last_unstale":"2024-09-10T20:41:25.002320+0000","last_undegraded":"2024-09-10T20:41:25.002320+0000","last_fullsized":"2024-09-10T20:41:25.002320+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:39.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023478+0000","last_change":"2024-09-10T20:40:57.783995+0000","last_active":"2024-09-10T20:41:25.023478+0000","last_peered":"2024-09-10T20:41:25.023478+0000","last_clean":"2024-09-10T20:41:25.023478+0000","last_became_active":"2024-09-10T20:40:57.782195+0000","last_became_peered":"2024-09-10T20:40:57.782195+0000","last_unstale":"2024-09-10T20:41:25.023478+0000","last_undegraded":"2024-09-10T20:41:25.023478+0000","last_fullsized":"2024-09-10T20:41:25.023478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:53.576166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023603+0000","last_change":"2024-09-10T20:40:57.778945+0000","last_active":"2024-09-10T20:41:25.023603+0000","last_peered":"2024-09-10T20:41:25.023603+0000","last_clean":"2024-09-10T20:41:25.023603+0000","last_became_active":"2024-09-10T20:40:57.778659+0000","last_became_peered":"2024-09-10T20:40:57.778659+0000","last_unstale":"2024-09-10T20:41:25.023603+0000","last_undegraded":"2024-09-10T20:41:25.023603+0000","last_fullsized":"2024-09-10T20:41:25.023603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:42.767732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"40'12","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002065+0000","last_change":"2024-09-10T20:40:57.796477+0000","last_active":"2024-09-10T20:41:25.002065+0000","last_peered":"2024-09-10T20:41:25.002065+0000","last_clean":"2024-09-10T20:41:25.002065+0000","last_became_active":"2024-09-10T20:40:57.796191+0000","last_became_peered":"2024-09-10T20:40:57.796191+0000","last_unstale":"2024-09-10T20:41:25.002065+0000","last_undegraded":"2024-09-10T20:41:25.002065+0000","last_fullsized":"2024-09-10T20:41:25.002065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:00.682250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001687+0000","last_change":"2024-09-10T20:40:57.813103+0000","last_active":"2024-09-10T20:41:25.001687+0000","last_peered":"2024-09-10T20:41:25.001687+0000","last_clean":"2024-09-10T20:41:25.001687+0000","last_became_active":"2024-09-10T20:40:57.812863+0000","last_became_peered":"2024-09-10T20:40:57.812863+0000","last_unstale":"2024-09-10T20:41:25.001687+0000","last_undegraded":"2024-09-10T20:41:25.001687+0000","last_fullsized":"2024-09-10T20:41:25.001687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:03.255660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969555+0000","last_change":"2024-09-10T20:41:22.969555+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969555+0000","last_undegraded":"2024-09-10T20:41:22.969555+0000","last_fullsized":"2024-09-10T20:41:22.969555+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023852+0000","last_change":"2024-09-10T20:40:57.806845+0000","last_active":"2024-09-10T20:41:25.023852+0000","last_peered":"2024-09-10T20:41:25.023852+0000","last_clean":"2024-09-10T20:41:25.023852+0000","last_became_active":"2024-09-10T20:40:57.806562+0000","last_became_peered":"2024-09-10T20:40:57.806562+0000","last_unstale":"2024-09-10T20:41:25.023852+0000","last_undegraded":"2024-09-10T20:41:25.023852+0000","last_fullsized":"2024-09-10T20:41:25.023852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:32.177438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"44'8","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995550+0000","last_change":"2024-09-10T20:40:56.787360+0000","last_active":"2024-09-10T20:41:23.995550+0000","last_peered":"2024-09-10T20:41:23.995550+0000","last_clean":"2024-09-10T20:41:23.995550+0000","last_became_active":"2024-09-10T20:40:56.787113+0000","last_became_peered":"2024-09-10T20:40:56.787113+0000","last_unstale":"2024-09-10T20:41:23.995550+0000","last_undegraded":"2024-09-10T20:41:23.995550+0000","last_fullsized":"2024-09-10T20:41:23.995550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.999843+0000","last_change":"2024-09-10T20:41:23.997577+0000","last_active":"2024-09-10T20:41:23.999843+0000","last_peered":"2024-09-10T20:41:23.999843+0000","last_clean":"2024-09-10T20:41:23.999843+0000","last_became_active":"2024-09-10T20:41:23.997315+0000","last_became_peered":"2024-09-10T20:41:23.997315+0000","last_unstale":"2024-09-10T20:41:23.999843+0000","last_undegraded":"2024-09-10T20:41:23.999843+0000","last_fullsized":"2024-09-10T20:41:23.999843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:49.348851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296022+0000","last_change":"2024-09-10T20:40:57.794642+0000","last_active":"2024-09-10T20:41:25.296022+0000","last_peered":"2024-09-10T20:41:25.296022+0000","last_clean":"2024-09-10T20:41:25.296022+0000","last_became_active":"2024-09-10T20:40:57.794432+0000","last_became_peered":"2024-09-10T20:40:57.794432+0000","last_unstale":"2024-09-10T20:41:25.296022+0000","last_undegraded":"2024-09-10T20:41:25.296022+0000","last_fullsized":"2024-09-10T20:41:25.296022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:59.893364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296194+0000","last_change":"2024-09-10T20:40:56.790001+0000","last_active":"2024-09-10T20:41:25.296194+0000","last_peered":"2024-09-10T20:41:25.296194+0000","last_clean":"2024-09-10T20:41:25.296194+0000","last_became_active":"2024-09-10T20:40:56.789708+0000","last_became_peered":"2024-09-10T20:40:56.789708+0000","last_unstale":"2024-09-10T20:41:25.296194+0000","last_undegraded":"2024-09-10T20:41:25.296194+0000","last_fullsized":"2024-09-10T20:41:25.296194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:56.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267602+0000","last_change":"2024-09-10T20:41:24.001301+0000","last_active":"2024-09-10T20:41:25.267602+0000","last_peered":"2024-09-10T20:41:25.267602+0000","last_clean":"2024-09-10T20:41:25.267602+0000","last_became_active":"2024-09-10T20:41:24.000986+0000","last_became_peered":"2024-09-10T20:41:24.000986+0000","last_unstale":"2024-09-10T20:41:25.267602+0000","last_undegraded":"2024-09-10T20:41:25.267602+0000","last_fullsized":"2024-09-10T20:41:25.267602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:45.971209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024106+0000","last_change":"2024-09-10T20:40:57.804223+0000","last_active":"2024-09-10T20:41:25.024106+0000","last_peered":"2024-09-10T20:41:25.024106+0000","last_clean":"2024-09-10T20:41:25.024106+0000","last_became_active":"2024-09-10T20:40:57.800934+0000","last_became_peered":"2024-09-10T20:40:57.800934+0000","last_unstale":"2024-09-10T20:41:25.024106+0000","last_undegraded":"2024-09-10T20:41:25.024106+0000","last_fullsized":"2024-09-10T20:41:25.024106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:43.140106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"44'3","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002486+0000","last_change":"2024-09-10T20:40:56.798617+0000","last_active":"2024-09-10T20:41:25.002486+0000","last_peered":"2024-09-10T20:41:25.002486+0000","last_clean":"2024-09-10T20:41:25.002486+0000","last_became_active":"2024-09-10T20:40:56.798233+0000","last_became_peered":"2024-09-10T20:40:56.798233+0000","last_unstale":"2024-09-10T20:41:25.002486+0000","last_undegraded":"2024-09-10T20:41:25.002486+0000","last_fullsized":"2024-09-10T20:41:25.002486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:55.548605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003712+0000","last_change":"2024-09-10T20:41:23.999098+0000","last_active":"2024-09-10T20:41:24.003712+0000","last_peered":"2024-09-10T20:41:24.003712+0000","last_clean":"2024-09-10T20:41:24.003712+0000","last_became_active":"2024-09-10T20:41:23.998720+0000","last_became_peered":"2024-09-10T20:41:23.998720+0000","last_unstale":"2024-09-10T20:41:24.003712+0000","last_undegraded":"2024-09-10T20:41:24.003712+0000","last_fullsized":"2024-09-10T20:41:24.003712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:31.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296273+0000","last_change":"2024-09-10T20:40:57.790493+0000","last_active":"2024-09-10T20:41:25.296273+0000","last_peered":"2024-09-10T20:41:25.296273+0000","last_clean":"2024-09-10T20:41:25.296273+0000","last_became_active":"2024-09-10T20:40:57.789768+0000","last_became_peered":"2024-09-10T20:40:57.789768+0000","last_unstale":"2024-09-10T20:41:25.296273+0000","last_undegraded":"2024-09-10T20:41:25.296273+0000","last_fullsized":"2024-09-10T20:41:25.296273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.004069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"44'3","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995056+0000","last_change":"2024-09-10T20:40:56.798645+0000","last_active":"2024-09-10T20:41:23.995056+0000","last_peered":"2024-09-10T20:41:23.995056+0000","last_clean":"2024-09-10T20:41:23.995056+0000","last_became_active":"2024-09-10T20:40:56.798325+0000","last_became_peered":"2024-09-10T20:40:56.798325+0000","last_unstale":"2024-09-10T20:41:23.995056+0000","last_undegraded":"2024-09-10T20:41:23.995056+0000","last_fullsized":"2024-09-10T20:41:23.995056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:18.678416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023770+0000","last_change":"2024-09-10T20:41:23.999199+0000","last_active":"2024-09-10T20:41:25.023770+0000","last_peered":"2024-09-10T20:41:25.023770+0000","last_clean":"2024-09-10T20:41:25.023770+0000","last_became_active":"2024-09-10T20:41:23.998893+0000","last_became_peered":"2024-09-10T20:41:23.998893+0000","last_unstale":"2024-09-10T20:41:25.023770+0000","last_undegraded":"2024-09-10T20:41:25.023770+0000","last_fullsized":"2024-09-10T20:41:25.023770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.712353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001816+0000","last_change":"2024-09-10T20:40:57.792035+0000","last_active":"2024-09-10T20:41:25.001816+0000","last_peered":"2024-09-10T20:41:25.001816+0000","last_clean":"2024-09-10T20:41:25.001816+0000","last_became_active":"2024-09-10T20:40:57.791743+0000","last_became_peered":"2024-09-10T20:40:57.791743+0000","last_unstale":"2024-09-10T20:41:25.001816+0000","last_undegraded":"2024-09-10T20:41:25.001816+0000","last_fullsized":"2024-09-10T20:41:25.001816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:35.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995191+0000","last_change":"2024-09-10T20:40:56.778488+0000","last_active":"2024-09-10T20:41:23.995191+0000","last_peered":"2024-09-10T20:41:23.995191+0000","last_clean":"2024-09-10T20:41:23.995191+0000","last_became_active":"2024-09-10T20:40:56.778241+0000","last_became_peered":"2024-09-10T20:40:56.778241+0000","last_unstale":"2024-09-10T20:41:23.995191+0000","last_undegraded":"2024-09-10T20:41:23.995191+0000","last_fullsized":"2024-09-10T20:41:23.995191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002542+0000","last_change":"2024-09-10T20:41:23.996850+0000","last_active":"2024-09-10T20:41:25.002542+0000","last_peered":"2024-09-10T20:41:25.002542+0000","last_clean":"2024-09-10T20:41:25.002542+0000","last_became_active":"2024-09-10T20:41:23.996537+0000","last_became_peered":"2024-09-10T20:41:23.996537+0000","last_unstale":"2024-09-10T20:41:25.002542+0000","last_undegraded":"2024-09-10T20:41:25.002542+0000","last_fullsized":"2024-09-10T20:41:25.002542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:09.881621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267021+0000","last_change":"2024-09-10T20:40:57.787640+0000","last_active":"2024-09-10T20:41:25.267021+0000","last_peered":"2024-09-10T20:41:25.267021+0000","last_clean":"2024-09-10T20:41:25.267021+0000","last_became_active":"2024-09-10T20:40:57.787374+0000","last_became_peered":"2024-09-10T20:40:57.787374+0000","last_unstale":"2024-09-10T20:41:25.267021+0000","last_undegraded":"2024-09-10T20:41:25.267021+0000","last_fullsized":"2024-09-10T20:41:25.267021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.579080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002354+0000","last_change":"2024-09-10T20:40:56.799544+0000","last_active":"2024-09-10T20:41:25.002354+0000","last_peered":"2024-09-10T20:41:25.002354+0000","last_clean":"2024-09-10T20:41:25.002354+0000","last_became_active":"2024-09-10T20:40:56.799273+0000","last_became_peered":"2024-09-10T20:40:56.799273+0000","last_unstale":"2024-09-10T20:41:25.002354+0000","last_undegraded":"2024-09-10T20:41:25.002354+0000","last_fullsized":"2024-09-10T20:41:25.002354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:24.776937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001061+0000","last_change":"2024-09-10T20:41:24.000751+0000","last_active":"2024-09-10T20:41:25.001061+0000","last_peered":"2024-09-10T20:41:25.001061+0000","last_clean":"2024-09-10T20:41:25.001061+0000","last_became_active":"2024-09-10T20:41:24.000476+0000","last_became_peered":"2024-09-10T20:41:24.000476+0000","last_unstale":"2024-09-10T20:41:25.001061+0000","last_undegraded":"2024-09-10T20:41:25.001061+0000","last_fullsized":"2024-09-10T20:41:25.001061+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:50.959302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023652+0000","last_change":"2024-09-10T20:40:57.790412+0000","last_active":"2024-09-10T20:41:25.023652+0000","last_peered":"2024-09-10T20:41:25.023652+0000","last_clean":"2024-09-10T20:41:25.023652+0000","last_became_active":"2024-09-10T20:40:57.788308+0000","last_became_peered":"2024-09-10T20:40:57.788308+0000","last_unstale":"2024-09-10T20:41:25.023652+0000","last_undegraded":"2024-09-10T20:41:25.023652+0000","last_fullsized":"2024-09-10T20:41:25.023652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.492132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001391+0000","last_change":"2024-09-10T20:40:56.795211+0000","last_active":"2024-09-10T20:41:25.001391+0000","last_peered":"2024-09-10T20:41:25.001391+0000","last_clean":"2024-09-10T20:41:25.001391+0000","last_became_active":"2024-09-10T20:40:56.794869+0000","last_became_peered":"2024-09-10T20:40:56.794869+0000","last_unstale":"2024-09-10T20:41:25.001391+0000","last_undegraded":"2024-09-10T20:41:25.001391+0000","last_fullsized":"2024-09-10T20:41:25.001391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:54.724711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023595+0000","last_change":"2024-09-10T20:41:23.992976+0000","last_active":"2024-09-10T20:41:25.023595+0000","last_peered":"2024-09-10T20:41:25.023595+0000","last_clean":"2024-09-10T20:41:25.023595+0000","last_became_active":"2024-09-10T20:41:23.992286+0000","last_became_peered":"2024-09-10T20:41:23.992286+0000","last_unstale":"2024-09-10T20:41:25.023595+0000","last_undegraded":"2024-09-10T20:41:25.023595+0000","last_fullsized":"2024-09-10T20:41:25.023595+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:38.417982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.799569+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.799219+0000","last_became_peered":"2024-09-10T20:40:57.799219+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:29.475021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002246+0000","last_change":"2024-09-10T20:40:56.779639+0000","last_active":"2024-09-10T20:41:25.002246+0000","last_peered":"2024-09-10T20:41:25.002246+0000","last_clean":"2024-09-10T20:41:25.002246+0000","last_became_active":"2024-09-10T20:40:56.779311+0000","last_became_peered":"2024-09-10T20:40:56.779311+0000","last_unstale":"2024-09-10T20:41:25.002246+0000","last_undegraded":"2024-09-10T20:41:25.002246+0000","last_fullsized":"2024-09-10T20:41:25.002246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:39.771929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023992+0000","last_change":"2024-09-10T20:41:24.003499+0000","last_active":"2024-09-10T20:41:25.023992+0000","last_peered":"2024-09-10T20:41:25.023992+0000","last_clean":"2024-09-10T20:41:25.023992+0000","last_became_active":"2024-09-10T20:41:24.003230+0000","last_became_peered":"2024-09-10T20:41:24.003230+0000","last_unstale":"2024-09-10T20:41:25.023992+0000","last_undegraded":"2024-09-10T20:41:25.023992+0000","last_fullsized":"2024-09-10T20:41:25.023992+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:49.321950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'11","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002775+0000","last_change":"2024-09-10T20:40:57.793647+0000","last_active":"2024-09-10T20:41:25.002775+0000","last_peered":"2024-09-10T20:41:25.002775+0000","last_clean":"2024-09-10T20:41:25.002775+0000","last_became_active":"2024-09-10T20:40:57.792950+0000","last_became_peered":"2024-09-10T20:40:57.792950+0000","last_unstale":"2024-09-10T20:41:25.002775+0000","last_undegraded":"2024-09-10T20:41:25.002775+0000","last_fullsized":"2024-09-10T20:41:25.002775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:17.034966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002385+0000","last_change":"2024-09-10T20:40:56.799456+0000","last_active":"2024-09-10T20:41:25.002385+0000","last_peered":"2024-09-10T20:41:25.002385+0000","last_clean":"2024-09-10T20:41:25.002385+0000","last_became_active":"2024-09-10T20:40:56.799162+0000","last_became_peered":"2024-09-10T20:40:56.799162+0000","last_unstale":"2024-09-10T20:41:25.002385+0000","last_undegraded":"2024-09-10T20:41:25.002385+0000","last_fullsized":"2024-09-10T20:41:25.002385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:44.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969265+0000","last_change":"2024-09-10T20:41:22.969265+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969265+0000","last_undegraded":"2024-09-10T20:41:22.969265+0000","last_fullsized":"2024-09-10T20:41:22.969265+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'6","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995073+0000","last_change":"2024-09-10T20:40:57.802645+0000","last_active":"2024-09-10T20:41:23.995073+0000","last_peered":"2024-09-10T20:41:23.995073+0000","last_clean":"2024-09-10T20:41:23.995073+0000","last_became_active":"2024-09-10T20:40:57.802283+0000","last_became_peered":"2024-09-10T20:40:57.802283+0000","last_unstale":"2024-09-10T20:41:23.995073+0000","last_undegraded":"2024-09-10T20:41:23.995073+0000","last_fullsized":"2024-09-10T20:41:23.995073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:17.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023984+0000","last_change":"2024-09-10T20:40:56.787551+0000","last_active":"2024-09-10T20:41:25.023984+0000","last_peered":"2024-09-10T20:41:25.023984+0000","last_clean":"2024-09-10T20:41:25.023984+0000","last_became_active":"2024-09-10T20:40:56.786720+0000","last_became_peered":"2024-09-10T20:40:56.786720+0000","last_unstale":"2024-09-10T20:41:25.023984+0000","last_undegraded":"2024-09-10T20:41:25.023984+0000","last_fullsized":"2024-09-10T20:41:25.023984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:58.890626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002375+0000","last_change":"2024-09-10T20:41:23.994183+0000","last_active":"2024-09-10T20:41:25.002375+0000","last_peered":"2024-09-10T20:41:25.002375+0000","last_clean":"2024-09-10T20:41:25.002375+0000","last_became_active":"2024-09-10T20:41:23.993219+0000","last_became_peered":"2024-09-10T20:41:23.993219+0000","last_unstale":"2024-09-10T20:41:25.002375+0000","last_undegraded":"2024-09-10T20:41:25.002375+0000","last_fullsized":"2024-09-10T20:41:25.002375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:55.786567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002227+0000","last_change":"2024-09-10T20:40:57.805104+0000","last_active":"2024-09-10T20:41:25.002227+0000","last_peered":"2024-09-10T20:41:25.002227+0000","last_clean":"2024-09-10T20:41:25.002227+0000","last_became_active":"2024-09-10T20:40:57.804894+0000","last_became_peered":"2024-09-10T20:40:57.804894+0000","last_unstale":"2024-09-10T20:41:25.002227+0000","last_undegraded":"2024-09-10T20:41:25.002227+0000","last_fullsized":"2024-09-10T20:41:25.002227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:02.247029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"44'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024048+0000","last_change":"2024-09-10T20:40:56.798785+0000","last_active":"2024-09-10T20:41:25.024048+0000","last_peered":"2024-09-10T20:41:25.024048+0000","last_clean":"2024-09-10T20:41:25.024048+0000","last_became_active":"2024-09-10T20:40:56.798390+0000","last_became_peered":"2024-09-10T20:40:56.798390+0000","last_unstale":"2024-09-10T20:41:25.024048+0000","last_undegraded":"2024-09-10T20:41:25.024048+0000","last_fullsized":"2024-09-10T20:41:25.024048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:39.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002349+0000","last_change":"2024-09-10T20:41:23.993848+0000","last_active":"2024-09-10T20:41:25.002349+0000","last_peered":"2024-09-10T20:41:25.002349+0000","last_clean":"2024-09-10T20:41:25.002349+0000","last_became_active":"2024-09-10T20:41:23.993558+0000","last_became_peered":"2024-09-10T20:41:23.993558+0000","last_unstale":"2024-09-10T20:41:25.002349+0000","last_undegraded":"2024-09-10T20:41:25.002349+0000","last_fullsized":"2024-09-10T20:41:25.002349+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:05.240195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002434+0000","last_change":"2024-09-10T20:40:57.807154+0000","last_active":"2024-09-10T20:41:25.002434+0000","last_peered":"2024-09-10T20:41:25.002434+0000","last_clean":"2024-09-10T20:41:25.002434+0000","last_became_active":"2024-09-10T20:40:57.806970+0000","last_became_peered":"2024-09-10T20:40:57.806970+0000","last_unstale":"2024-09-10T20:41:25.002434+0000","last_undegraded":"2024-09-10T20:41:25.002434+0000","last_fullsized":"2024-09-10T20:41:25.002434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:40.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"44'24","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002928+0000","last_change":"2024-09-10T20:40:56.798461+0000","last_active":"2024-09-10T20:41:25.002928+0000","last_peered":"2024-09-10T20:41:25.002928+0000","last_clean":"2024-09-10T20:41:25.002928+0000","last_became_active":"2024-09-10T20:40:56.798136+0000","last_became_peered":"2024-09-10T20:40:56.798136+0000","last_unstale":"2024-09-10T20:41:25.002928+0000","last_undegraded":"2024-09-10T20:41:25.002928+0000","last_fullsized":"2024-09-10T20:41:25.002928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:08.271880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.998155+0000","last_change":"2024-09-10T20:41:23.994788+0000","last_active":"2024-09-10T20:41:23.998155+0000","last_peered":"2024-09-10T20:41:23.998155+0000","last_clean":"2024-09-10T20:41:23.998155+0000","last_became_active":"2024-09-10T20:41:23.994527+0000","last_became_peered":"2024-09-10T20:41:23.994527+0000","last_unstale":"2024-09-10T20:41:23.998155+0000","last_undegraded":"2024-09-10T20:41:23.998155+0000","last_fullsized":"2024-09-10T20:41:23.998155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001987+0000","last_change":"2024-09-10T20:40:57.800593+0000","last_active":"2024-09-10T20:41:25.001987+0000","last_peered":"2024-09-10T20:41:25.001987+0000","last_clean":"2024-09-10T20:41:25.001987+0000","last_became_active":"2024-09-10T20:40:57.796067+0000","last_became_peered":"2024-09-10T20:40:57.796067+0000","last_unstale":"2024-09-10T20:41:25.001987+0000","last_undegraded":"2024-09-10T20:41:25.001987+0000","last_fullsized":"2024-09-10T20:41:25.001987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:13.660313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"44'5","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001700+0000","last_change":"2024-09-10T20:40:56.798892+0000","last_active":"2024-09-10T20:41:25.001700+0000","last_peered":"2024-09-10T20:41:25.001700+0000","last_clean":"2024-09-10T20:41:25.001700+0000","last_became_active":"2024-09-10T20:40:56.798574+0000","last_became_peered":"2024-09-10T20:40:56.798574+0000","last_unstale":"2024-09-10T20:41:25.001700+0000","last_undegraded":"2024-09-10T20:41:25.001700+0000","last_fullsized":"2024-09-10T20:41:25.001700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:12.809899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003719+0000","last_change":"2024-09-10T20:41:23.997814+0000","last_active":"2024-09-10T20:41:24.003719+0000","last_peered":"2024-09-10T20:41:24.003719+0000","last_clean":"2024-09-10T20:41:24.003719+0000","last_became_active":"2024-09-10T20:41:23.997261+0000","last_became_peered":"2024-09-10T20:41:23.997261+0000","last_unstale":"2024-09-10T20:41:24.003719+0000","last_undegraded":"2024-09-10T20:41:24.003719+0000","last_fullsized":"2024-09-10T20:41:24.003719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:33.403127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295687+0000","last_change":"2024-09-10T20:40:57.789344+0000","last_active":"2024-09-10T20:41:25.295687+0000","last_peered":"2024-09-10T20:41:25.295687+0000","last_clean":"2024-09-10T20:41:25.295687+0000","last_became_active":"2024-09-10T20:40:57.789092+0000","last_became_peered":"2024-09-10T20:40:57.789092+0000","last_unstale":"2024-09-10T20:41:25.295687+0000","last_undegraded":"2024-09-10T20:41:25.295687+0000","last_fullsized":"2024-09-10T20:41:25.295687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.377370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295848+0000","last_change":"2024-09-10T20:40:56.787899+0000","last_active":"2024-09-10T20:41:25.295848+0000","last_peered":"2024-09-10T20:41:25.295848+0000","last_clean":"2024-09-10T20:41:25.295848+0000","last_became_active":"2024-09-10T20:40:56.787509+0000","last_became_peered":"2024-09-10T20:40:56.787509+0000","last_unstale":"2024-09-10T20:41:25.295848+0000","last_undegraded":"2024-09-10T20:41:25.295848+0000","last_fullsized":"2024-09-10T20:41:25.295848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.249527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995941+0000","last_change":"2024-09-10T20:41:23.993761+0000","last_active":"2024-09-10T20:41:23.995941+0000","last_peered":"2024-09-10T20:41:23.995941+0000","last_clean":"2024-09-10T20:41:23.995941+0000","last_became_active":"2024-09-10T20:41:23.993477+0000","last_became_peered":"2024-09-10T20:41:23.993477+0000","last_unstale":"2024-09-10T20:41:23.995941+0000","last_undegraded":"2024-09-10T20:41:23.995941+0000","last_fullsized":"2024-09-10T20:41:23.995941+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:35.482106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267196+0000","last_change":"2024-09-10T20:40:57.786588+0000","last_active":"2024-09-10T20:41:25.267196+0000","last_peered":"2024-09-10T20:41:25.267196+0000","last_clean":"2024-09-10T20:41:25.267196+0000","last_became_active":"2024-09-10T20:40:57.786296+0000","last_became_peered":"2024-09-10T20:40:57.786296+0000","last_unstale":"2024-09-10T20:41:25.267196+0000","last_undegraded":"2024-09-10T20:41:25.267196+0000","last_fullsized":"2024-09-10T20:41:25.267196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:36.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023573+0000","last_change":"2024-09-10T20:40:56.783758+0000","last_active":"2024-09-10T20:41:25.023573+0000","last_peered":"2024-09-10T20:41:25.023573+0000","last_clean":"2024-09-10T20:41:25.023573+0000","last_became_active":"2024-09-10T20:40:56.783512+0000","last_became_peered":"2024-09-10T20:40:56.783512+0000","last_unstale":"2024-09-10T20:41:25.023573+0000","last_undegraded":"2024-09-10T20:41:25.023573+0000","last_fullsized":"2024-09-10T20:41:25.023573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:39.374632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002192+0000","last_change":"2024-09-10T20:41:24.000925+0000","last_active":"2024-09-10T20:41:25.002192+0000","last_peered":"2024-09-10T20:41:25.002192+0000","last_clean":"2024-09-10T20:41:25.002192+0000","last_became_active":"2024-09-10T20:41:23.999216+0000","last_became_peered":"2024-09-10T20:41:23.999216+0000","last_unstale":"2024-09-10T20:41:25.002192+0000","last_undegraded":"2024-09-10T20:41:25.002192+0000","last_fullsized":"2024-09-10T20:41:25.002192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:36.479766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'15","reported_seq":41,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985588+0000","last_change":"2024-09-10T20:40:57.801745+0000","last_active":"2024-09-10T20:41:23.985588+0000","last_peered":"2024-09-10T20:41:23.985588+0000","last_clean":"2024-09-10T20:41:23.985588+0000","last_became_active":"2024-09-10T20:40:57.801484+0000","last_became_peered":"2024-09-10T20:40:57.801484+0000","last_unstale":"2024-09-10T20:41:23.985588+0000","last_undegraded":"2024-09-10T20:41:23.985588+0000","last_fullsized":"2024-09-10T20:41:23.985588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:10.503000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"44'15","reported_seq":43,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991869+0000","last_change":"2024-09-10T20:40:56.779692+0000","last_active":"2024-09-10T20:41:23.991869+0000","last_peered":"2024-09-10T20:41:23.991869+0000","last_clean":"2024-09-10T20:41:23.991869+0000","last_became_active":"2024-09-10T20:40:56.779447+0000","last_became_peered":"2024-09-10T20:40:56.779447+0000","last_unstale":"2024-09-10T20:41:23.991869+0000","last_undegraded":"2024-09-10T20:41:23.991869+0000","last_fullsized":"2024-09-10T20:41:23.991869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:15.261201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002291+0000","last_change":"2024-09-10T20:41:23.999605+0000","last_active":"2024-09-10T20:41:25.002291+0000","last_peered":"2024-09-10T20:41:25.002291+0000","last_clean":"2024-09-10T20:41:25.002291+0000","last_became_active":"2024-09-10T20:41:23.998539+0000","last_became_peered":"2024-09-10T20:41:23.998539+0000","last_unstale":"2024-09-10T20:41:25.002291+0000","last_undegraded":"2024-09-10T20:41:25.002291+0000","last_fullsized":"2024-09-10T20:41:25.002291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:26.825035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295947+0000","last_change":"2024-09-10T20:40:57.795777+0000","last_active":"2024-09-10T20:41:25.295947+0000","last_peered":"2024-09-10T20:41:25.295947+0000","last_clean":"2024-09-10T20:41:25.295947+0000","last_became_active":"2024-09-10T20:40:57.795521+0000","last_became_peered":"2024-09-10T20:40:57.795521+0000","last_unstale":"2024-09-10T20:41:25.295947+0000","last_undegraded":"2024-09-10T20:41:25.295947+0000","last_fullsized":"2024-09-10T20:41:25.295947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:15.958954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"44'2","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002456+0000","last_change":"2024-09-10T20:40:56.792708+0000","last_active":"2024-09-10T20:41:25.002456+0000","last_peered":"2024-09-10T20:41:25.002456+0000","last_clean":"2024-09-10T20:41:25.002456+0000","last_became_active":"2024-09-10T20:40:56.792427+0000","last_became_peered":"2024-09-10T20:40:56.792427+0000","last_unstale":"2024-09-10T20:41:25.002456+0000","last_undegraded":"2024-09-10T20:41:25.002456+0000","last_fullsized":"2024-09-10T20:41:25.002456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:40.781428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.008364+0000","last_change":"2024-09-10T20:41:24.005055+0000","last_active":"2024-09-10T20:41:24.008364+0000","last_peered":"2024-09-10T20:41:24.008364+0000","last_clean":"2024-09-10T20:41:24.008364+0000","last_became_active":"2024-09-10T20:41:24.004760+0000","last_became_peered":"2024-09-10T20:41:24.004760+0000","last_unstale":"2024-09-10T20:41:24.008364+0000","last_undegraded":"2024-09-10T20:41:24.008364+0000","last_fullsized":"2024-09-10T20:41:24.008364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:40.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002465+0000","last_change":"2024-09-10T20:40:57.805292+0000","last_active":"2024-09-10T20:41:25.002465+0000","last_peered":"2024-09-10T20:41:25.002465+0000","last_clean":"2024-09-10T20:41:25.002465+0000","last_became_active":"2024-09-10T20:40:57.804999+0000","last_became_peered":"2024-09-10T20:40:57.804999+0000","last_unstale":"2024-09-10T20:41:25.002465+0000","last_undegraded":"2024-09-10T20:41:25.002465+0000","last_fullsized":"2024-09-10T20:41:25.002465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:56.651005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024199+0000","last_change":"2024-09-10T20:40:56.798769+0000","last_active":"2024-09-10T20:41:25.024199+0000","last_peered":"2024-09-10T20:41:25.024199+0000","last_clean":"2024-09-10T20:41:25.024199+0000","last_became_active":"2024-09-10T20:40:56.798317+0000","last_became_peered":"2024-09-10T20:40:56.798317+0000","last_unstale":"2024-09-10T20:41:25.024199+0000","last_undegraded":"2024-09-10T20:41:25.024199+0000","last_fullsized":"2024-09-10T20:41:25.024199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:25.510395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003862+0000","last_change":"2024-09-10T20:41:23.999829+0000","last_active":"2024-09-10T20:41:24.003862+0000","last_peered":"2024-09-10T20:41:24.003862+0000","last_clean":"2024-09-10T20:41:24.003862+0000","last_became_active":"2024-09-10T20:41:23.999579+0000","last_became_peered":"2024-09-10T20:41:23.999579+0000","last_unstale":"2024-09-10T20:41:24.003862+0000","last_undegraded":"2024-09-10T20:41:24.003862+0000","last_fullsized":"2024-09-10T20:41:24.003862+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002530+0000","last_change":"2024-09-10T20:40:57.795506+0000","last_active":"2024-09-10T20:41:25.002530+0000","last_peered":"2024-09-10T20:41:25.002530+0000","last_clean":"2024-09-10T20:41:25.002530+0000","last_became_active":"2024-09-10T20:40:57.795238+0000","last_became_peered":"2024-09-10T20:40:57.795238+0000","last_unstale":"2024-09-10T20:41:25.002530+0000","last_undegraded":"2024-09-10T20:41:25.002530+0000","last_fullsized":"2024-09-10T20:41:25.002530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"44'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986466+0000","last_change":"2024-09-10T20:40:56.792843+0000","last_active":"2024-09-10T20:41:23.986466+0000","last_peered":"2024-09-10T20:41:23.986466+0000","last_clean":"2024-09-10T20:41:23.986466+0000","last_became_active":"2024-09-10T20:40:56.792439+0000","last_became_peered":"2024-09-10T20:40:56.792439+0000","last_unstale":"2024-09-10T20:41:23.986466+0000","last_undegraded":"2024-09-10T20:41:23.986466+0000","last_fullsized":"2024-09-10T20:41:23.986466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:49.054542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003682+0000","last_change":"2024-09-10T20:41:23.997742+0000","last_active":"2024-09-10T20:41:24.003682+0000","last_peered":"2024-09-10T20:41:24.003682+0000","last_clean":"2024-09-10T20:41:24.003682+0000","last_became_active":"2024-09-10T20:41:23.997137+0000","last_became_peered":"2024-09-10T20:41:23.997137+0000","last_unstale":"2024-09-10T20:41:24.003682+0000","last_undegraded":"2024-09-10T20:41:24.003682+0000","last_fullsized":"2024-09-10T20:41:24.003682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:12.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'9","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972839+0000","last_change":"2024-09-10T20:40:57.798663+0000","last_active":"2024-09-10T20:41:22.972839+0000","last_peered":"2024-09-10T20:41:22.972839+0000","last_clean":"2024-09-10T20:41:22.972839+0000","last_became_active":"2024-09-10T20:40:57.798333+0000","last_became_peered":"2024-09-10T20:40:57.798333+0000","last_unstale":"2024-09-10T20:41:22.972839+0000","last_undegraded":"2024-09-10T20:41:22.972839+0000","last_fullsized":"2024-09-10T20:41:22.972839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:22.259106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972259+0000","last_change":"2024-09-10T20:40:56.789841+0000","last_active":"2024-09-10T20:41:22.972259+0000","last_peered":"2024-09-10T20:41:22.972259+0000","last_clean":"2024-09-10T20:41:22.972259+0000","last_became_active":"2024-09-10T20:40:56.789524+0000","last_became_peered":"2024-09-10T20:40:56.789524+0000","last_unstale":"2024-09-10T20:41:22.972259+0000","last_undegraded":"2024-09-10T20:41:22.972259+0000","last_fullsized":"2024-09-10T20:41:22.972259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:06.139874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969239+0000","last_change":"2024-09-10T20:41:22.969239+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969239+0000","last_undegraded":"2024-09-10T20:41:22.969239+0000","last_fullsized":"2024-09-10T20:41:22.969239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023403+0000","last_change":"2024-09-10T20:40:57.779901+0000","last_active":"2024-09-10T20:41:25.023403+0000","last_peered":"2024-09-10T20:41:25.023403+0000","last_clean":"2024-09-10T20:41:25.023403+0000","last_became_active":"2024-09-10T20:40:57.779489+0000","last_became_peered":"2024-09-10T20:40:57.779489+0000","last_unstale":"2024-09-10T20:41:25.023403+0000","last_undegraded":"2024-09-10T20:41:25.023403+0000","last_fullsized":"2024-09-10T20:41:25.023403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.265123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"44'4","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.971719+0000","last_change":"2024-09-10T20:40:56.787107+0000","last_active":"2024-09-10T20:41:22.971719+0000","last_peered":"2024-09-10T20:41:22.971719+0000","last_clean":"2024-09-10T20:41:22.971719+0000","last_became_active":"2024-09-10T20:40:56.786778+0000","last_became_peered":"2024-09-10T20:40:56.786778+0000","last_unstale":"2024-09-10T20:41:22.971719+0000","last_undegraded":"2024-09-10T20:41:22.971719+0000","last_fullsized":"2024-09-10T20:41:22.971719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:21.098826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969341+0000","last_change":"2024-09-10T20:41:22.969341+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969341+0000","last_undegraded":"2024-09-10T20:41:22.969341+0000","last_fullsized":"2024-09-10T20:41:22.969341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"40'2","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001262+0000","last_change":"2024-09-10T20:40:57.805036+0000","last_active":"2024-09-10T20:41:25.001262+0000","last_peered":"2024-09-10T20:41:25.001262+0000","last_clean":"2024-09-10T20:41:25.001262+0000","last_became_active":"2024-09-10T20:40:57.804826+0000","last_became_peered":"2024-09-10T20:40:57.804826+0000","last_unstale":"2024-09-10T20:41:25.001262+0000","last_undegraded":"2024-09-10T20:41:25.001262+0000","last_fullsized":"2024-09-10T20:41:25.001262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:26.742701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295936+0000","last_change":"2024-09-10T20:40:56.792580+0000","last_active":"2024-09-10T20:41:25.295936+0000","last_peered":"2024-09-10T20:41:25.295936+0000","last_clean":"2024-09-10T20:41:25.295936+0000","last_became_active":"2024-09-10T20:40:56.792296+0000","last_became_peered":"2024-09-10T20:40:56.792296+0000","last_unstale":"2024-09-10T20:41:25.295936+0000","last_undegraded":"2024-09-10T20:41:25.295936+0000","last_fullsized":"2024-09-10T20:41:25.295936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:34.728794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295921+0000","last_change":"2024-09-10T20:41:23.999776+0000","last_active":"2024-09-10T20:41:25.295921+0000","last_peered":"2024-09-10T20:41:25.295921+0000","last_clean":"2024-09-10T20:41:25.295921+0000","last_became_active":"2024-09-10T20:41:23.999315+0000","last_became_peered":"2024-09-10T20:41:23.999315+0000","last_unstale":"2024-09-10T20:41:25.295921+0000","last_undegraded":"2024-09-10T20:41:25.295921+0000","last_fullsized":"2024-09-10T20:41:25.295921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:22.338151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267170+0000","last_change":"2024-09-10T20:40:57.798757+0000","last_active":"2024-09-10T20:41:25.267170+0000","last_peered":"2024-09-10T20:41:25.267170+0000","last_clean":"2024-09-10T20:41:25.267170+0000","last_became_active":"2024-09-10T20:40:57.796635+0000","last_became_peered":"2024-09-10T20:40:57.796635+0000","last_unstale":"2024-09-10T20:41:25.267170+0000","last_undegraded":"2024-09-10T20:41:25.267170+0000","last_fullsized":"2024-09-10T20:41:25.267170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:19.855245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002083+0000","last_change":"2024-09-10T20:40:56.779612+0000","last_active":"2024-09-10T20:41:25.002083+0000","last_peered":"2024-09-10T20:41:25.002083+0000","last_clean":"2024-09-10T20:41:25.002083+0000","last_became_active":"2024-09-10T20:40:56.779319+0000","last_became_peered":"2024-09-10T20:40:56.779319+0000","last_unstale":"2024-09-10T20:41:25.002083+0000","last_undegraded":"2024-09-10T20:41:25.002083+0000","last_fullsized":"2024-09-10T20:41:25.002083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:20.129458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001203+0000","last_change":"2024-09-10T20:41:24.002621+0000","last_active":"2024-09-10T20:41:25.001203+0000","last_peered":"2024-09-10T20:41:25.001203+0000","last_clean":"2024-09-10T20:41:25.001203+0000","last_became_active":"2024-09-10T20:41:24.001969+0000","last_became_peered":"2024-09-10T20:41:24.001969+0000","last_unstale":"2024-09-10T20:41:25.001203+0000","last_undegraded":"2024-09-10T20:41:25.001203+0000","last_fullsized":"2024-09-10T20:41:25.001203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:38.113389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001137+0000","last_change":"2024-09-10T20:40:57.794987+0000","last_active":"2024-09-10T20:41:25.001137+0000","last_peered":"2024-09-10T20:41:25.001137+0000","last_clean":"2024-09-10T20:41:25.001137+0000","last_became_active":"2024-09-10T20:40:57.794701+0000","last_became_peered":"2024-09-10T20:40:57.794701+0000","last_unstale":"2024-09-10T20:41:25.001137+0000","last_undegraded":"2024-09-10T20:41:25.001137+0000","last_fullsized":"2024-09-10T20:41:25.001137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:35.070564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295553+0000","last_change":"2024-09-10T20:40:56.796619+0000","last_active":"2024-09-10T20:41:25.295553+0000","last_peered":"2024-09-10T20:41:25.295553+0000","last_clean":"2024-09-10T20:41:25.295553+0000","last_became_active":"2024-09-10T20:40:56.796334+0000","last_became_peered":"2024-09-10T20:40:56.796334+0000","last_unstale":"2024-09-10T20:41:25.295553+0000","last_undegraded":"2024-09-10T20:41:25.295553+0000","last_fullsized":"2024-09-10T20:41:25.295553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:18.035879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024094+0000","last_change":"2024-09-10T20:41:24.002545+0000","last_active":"2024-09-10T20:41:25.024094+0000","last_peered":"2024-09-10T20:41:25.024094+0000","last_clean":"2024-09-10T20:41:25.024094+0000","last_became_active":"2024-09-10T20:41:24.002269+0000","last_became_peered":"2024-09-10T20:41:24.002269+0000","last_unstale":"2024-09-10T20:41:25.024094+0000","last_undegraded":"2024-09-10T20:41:25.024094+0000","last_fullsized":"2024-09-10T20:41:25.024094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:29.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"40'9","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987145+0000","last_change":"2024-09-10T20:40:57.797064+0000","last_active":"2024-09-10T20:41:23.987145+0000","last_peered":"2024-09-10T20:41:23.987145+0000","last_clean":"2024-09-10T20:41:23.987145+0000","last_became_active":"2024-09-10T20:40:57.796778+0000","last_became_peered":"2024-09-10T20:40:57.796778+0000","last_unstale":"2024-09-10T20:41:23.987145+0000","last_undegraded":"2024-09-10T20:41:23.987145+0000","last_fullsized":"2024-09-10T20:41:23.987145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:13.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024157+0000","last_change":"2024-09-10T20:40:56.781802+0000","last_active":"2024-09-10T20:41:25.024157+0000","last_peered":"2024-09-10T20:41:25.024157+0000","last_clean":"2024-09-10T20:41:25.024157+0000","last_became_active":"2024-09-10T20:40:56.781430+0000","last_became_peered":"2024-09-10T20:40:56.781430+0000","last_unstale":"2024-09-10T20:41:25.024157+0000","last_undegraded":"2024-09-10T20:41:25.024157+0000","last_fullsized":"2024-09-10T20:41:25.024157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:52.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002451+0000","last_change":"2024-09-10T20:41:23.999122+0000","last_active":"2024-09-10T20:41:25.002451+0000","last_peered":"2024-09-10T20:41:25.002451+0000","last_clean":"2024-09-10T20:41:25.002451+0000","last_became_active":"2024-09-10T20:41:23.996737+0000","last_became_peered":"2024-09-10T20:41:23.996737+0000","last_unstale":"2024-09-10T20:41:25.002451+0000","last_undegraded":"2024-09-10T20:41:25.002451+0000","last_fullsized":"2024-09-10T20:41:25.002451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:04.584893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267543+0000","last_change":"2024-09-10T20:40:57.797088+0000","last_active":"2024-09-10T20:41:25.267543+0000","last_peered":"2024-09-10T20:41:25.267543+0000","last_clean":"2024-09-10T20:41:25.267543+0000","last_became_active":"2024-09-10T20:40:57.796516+0000","last_became_peered":"2024-09-10T20:40:57.796516+0000","last_unstale":"2024-09-10T20:41:25.267543+0000","last_undegraded":"2024-09-10T20:41:25.267543+0000","last_fullsized":"2024-09-10T20:41:25.267543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:23.886368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"44'5","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987209+0000","last_change":"2024-09-10T20:40:56.792746+0000","last_active":"2024-09-10T20:41:23.987209+0000","last_peered":"2024-09-10T20:41:23.987209+0000","last_clean":"2024-09-10T20:41:23.987209+0000","last_became_active":"2024-09-10T20:40:56.792409+0000","last_became_peered":"2024-09-10T20:40:56.792409+0000","last_unstale":"2024-09-10T20:41:23.987209+0000","last_undegraded":"2024-09-10T20:41:23.987209+0000","last_fullsized":"2024-09-10T20:41:23.987209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:11.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024072+0000","last_change":"2024-09-10T20:41:24.001797+0000","last_active":"2024-09-10T20:41:25.024072+0000","last_peered":"2024-09-10T20:41:25.024072+0000","last_clean":"2024-09-10T20:41:25.024072+0000","last_became_active":"2024-09-10T20:41:24.001549+0000","last_became_peered":"2024-09-10T20:41:24.001549+0000","last_unstale":"2024-09-10T20:41:25.024072+0000","last_undegraded":"2024-09-10T20:41:25.024072+0000","last_fullsized":"2024-09-10T20:41:25.024072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:51.657538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972657+0000","last_change":"2024-09-10T20:40:57.780255+0000","last_active":"2024-09-10T20:41:22.972657+0000","last_peered":"2024-09-10T20:41:22.972657+0000","last_clean":"2024-09-10T20:41:22.972657+0000","last_became_active":"2024-09-10T20:40:57.779962+0000","last_became_peered":"2024-09-10T20:40:57.779962+0000","last_unstale":"2024-09-10T20:41:22.972657+0000","last_undegraded":"2024-09-10T20:41:22.972657+0000","last_fullsized":"2024-09-10T20:41:22.972657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:32.285607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986598+0000","last_change":"2024-09-10T20:40:56.800962+0000","last_active":"2024-09-10T20:41:23.986598+0000","last_peered":"2024-09-10T20:41:23.986598+0000","last_clean":"2024-09-10T20:41:23.986598+0000","last_became_active":"2024-09-10T20:40:56.800727+0000","last_became_peered":"2024-09-10T20:40:56.800727+0000","last_unstale":"2024-09-10T20:41:23.986598+0000","last_undegraded":"2024-09-10T20:41:23.986598+0000","last_fullsized":"2024-09-10T20:41:23.986598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:52.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.005439+0000","last_change":"2024-09-10T20:41:24.001291+0000","last_active":"2024-09-10T20:41:24.005439+0000","last_peered":"2024-09-10T20:41:24.005439+0000","last_clean":"2024-09-10T20:41:24.005439+0000","last_became_active":"2024-09-10T20:41:24.000871+0000","last_became_peered":"2024-09-10T20:41:24.000871+0000","last_unstale":"2024-09-10T20:41:24.005439+0000","last_undegraded":"2024-09-10T20:41:24.005439+0000","last_fullsized":"2024-09-10T20:41:24.005439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:45.607883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"40'8","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.984817+0000","last_change":"2024-09-10T20:40:57.793540+0000","last_active":"2024-09-10T20:41:23.984817+0000","last_peered":"2024-09-10T20:41:23.984817+0000","last_clean":"2024-09-10T20:41:23.984817+0000","last_became_active":"2024-09-10T20:40:57.793231+0000","last_became_peered":"2024-09-10T20:40:57.793231+0000","last_unstale":"2024-09-10T20:41:23.984817+0000","last_undegraded":"2024-09-10T20:41:23.984817+0000","last_fullsized":"2024-09-10T20:41:23.984817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:43.458885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001847+0000","last_change":"2024-09-10T20:40:56.795661+0000","last_active":"2024-09-10T20:41:25.001847+0000","last_peered":"2024-09-10T20:41:25.001847+0000","last_clean":"2024-09-10T20:41:25.001847+0000","last_became_active":"2024-09-10T20:40:56.794893+0000","last_became_peered":"2024-09-10T20:40:56.794893+0000","last_unstale":"2024-09-10T20:41:25.001847+0000","last_undegraded":"2024-09-10T20:41:25.001847+0000","last_fullsized":"2024-09-10T20:41:25.001847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:56.476490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001972+0000","last_change":"2024-09-10T20:41:23.999188+0000","last_active":"2024-09-10T20:41:25.001972+0000","last_peered":"2024-09-10T20:41:25.001972+0000","last_clean":"2024-09-10T20:41:25.001972+0000","last_became_active":"2024-09-10T20:41:23.998882+0000","last_became_peered":"2024-09-10T20:41:23.998882+0000","last_unstale":"2024-09-10T20:41:25.001972+0000","last_undegraded":"2024-09-10T20:41:25.001972+0000","last_fullsized":"2024-09-10T20:41:25.001972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:06.148067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295734+0000","last_change":"2024-09-10T20:40:57.777674+0000","last_active":"2024-09-10T20:41:25.295734+0000","last_peered":"2024-09-10T20:41:25.295734+0000","last_clean":"2024-09-10T20:41:25.295734+0000","last_became_active":"2024-09-10T20:40:57.776652+0000","last_became_peered":"2024-09-10T20:40:57.776652+0000","last_unstale":"2024-09-10T20:41:25.295734+0000","last_undegraded":"2024-09-10T20:41:25.295734+0000","last_fullsized":"2024-09-10T20:41:25.295734+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:22.672592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267291+0000","last_change":"2024-09-10T20:40:56.786260+0000","last_active":"2024-09-10T20:41:25.267291+0000","last_peered":"2024-09-10T20:41:25.267291+0000","last_clean":"2024-09-10T20:41:25.267291+0000","last_became_active":"2024-09-10T20:40:56.785702+0000","last_became_peered":"2024-09-10T20:40:56.785702+0000","last_unstale":"2024-09-10T20:41:25.267291+0000","last_undegraded":"2024-09-10T20:41:25.267291+0000","last_fullsized":"2024-09-10T20:41:25.267291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970409+0000","last_change":"2024-09-10T20:41:22.970409+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970409+0000","last_undegraded":"2024-09-10T20:41:22.970409+0000","last_fullsized":"2024-09-10T20:41:22.970409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023703+0000","last_change":"2024-09-10T20:40:57.793392+0000","last_active":"2024-09-10T20:41:25.023703+0000","last_peered":"2024-09-10T20:41:25.023703+0000","last_clean":"2024-09-10T20:41:25.023703+0000","last_became_active":"2024-09-10T20:40:57.793192+0000","last_became_peered":"2024-09-10T20:40:57.793192+0000","last_unstale":"2024-09-10T20:41:25.023703+0000","last_undegraded":"2024-09-10T20:41:25.023703+0000","last_fullsized":"2024-09-10T20:41:25.023703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:04.659598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023685+0000","last_change":"2024-09-10T20:40:56.781668+0000","last_active":"2024-09-10T20:41:25.023685+0000","last_peered":"2024-09-10T20:41:25.023685+0000","last_clean":"2024-09-10T20:41:25.023685+0000","last_became_active":"2024-09-10T20:40:56.781402+0000","last_became_peered":"2024-09-10T20:40:56.781402+0000","last_unstale":"2024-09-10T20:41:25.023685+0000","last_undegraded":"2024-09-10T20:41:25.023685+0000","last_fullsized":"2024-09-10T20:41:25.023685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:35.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001449+0000","last_change":"2024-09-10T20:41:24.002138+0000","last_active":"2024-09-10T20:41:25.001449+0000","last_peered":"2024-09-10T20:41:25.001449+0000","last_clean":"2024-09-10T20:41:25.001449+0000","last_became_active":"2024-09-10T20:41:24.001620+0000","last_became_peered":"2024-09-10T20:41:24.001620+0000","last_unstale":"2024-09-10T20:41:25.001449+0000","last_undegraded":"2024-09-10T20:41:25.001449+0000","last_fullsized":"2024-09-10T20:41:25.001449+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:13.979541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267202+0000","last_change":"2024-09-10T20:40:57.789700+0000","last_active":"2024-09-10T20:41:25.267202+0000","last_peered":"2024-09-10T20:41:25.267202+0000","last_clean":"2024-09-10T20:41:25.267202+0000","last_became_active":"2024-09-10T20:40:57.789433+0000","last_became_peered":"2024-09-10T20:40:57.789433+0000","last_unstale":"2024-09-10T20:41:25.267202+0000","last_undegraded":"2024-09-10T20:41:25.267202+0000","last_fullsized":"2024-09-10T20:41:25.267202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:28.800368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002615+0000","last_change":"2024-09-10T20:40:56.795619+0000","last_active":"2024-09-10T20:41:25.002615+0000","last_peered":"2024-09-10T20:41:25.002615+0000","last_clean":"2024-09-10T20:41:25.002615+0000","last_became_active":"2024-09-10T20:40:56.795292+0000","last_became_peered":"2024-09-10T20:40:56.795292+0000","last_unstale":"2024-09-10T20:41:25.002615+0000","last_undegraded":"2024-09-10T20:41:25.002615+0000","last_fullsized":"2024-09-10T20:41:25.002615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:09.500262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970028+0000","last_change":"2024-09-10T20:41:22.970028+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970028+0000","last_undegraded":"2024-09-10T20:41:22.970028+0000","last_fullsized":"2024-09-10T20:41:22.970028+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024030+0000","last_change":"2024-09-10T20:40:57.784029+0000","last_active":"2024-09-10T20:41:25.024030+0000","last_peered":"2024-09-10T20:41:25.024030+0000","last_clean":"2024-09-10T20:41:25.024030+0000","last_became_active":"2024-09-10T20:40:57.783716+0000","last_became_peered":"2024-09-10T20:40:57.783716+0000","last_unstale":"2024-09-10T20:41:25.024030+0000","last_undegraded":"2024-09-10T20:41:25.024030+0000","last_fullsized":"2024-09-10T20:41:25.024030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:31.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267214+0000","last_change":"2024-09-10T20:40:56.785344+0000","last_active":"2024-09-10T20:41:25.267214+0000","last_peered":"2024-09-10T20:41:25.267214+0000","last_clean":"2024-09-10T20:41:25.267214+0000","last_became_active":"2024-09-10T20:40:56.785096+0000","last_became_peered":"2024-09-10T20:40:56.785096+0000","last_unstale":"2024-09-10T20:41:25.267214+0000","last_undegraded":"2024-09-10T20:41:25.267214+0000","last_fullsized":"2024-09-10T20:41:25.267214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":159,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002333+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:25.002333+0000","last_peered":"2024-09-10T20:41:25.002333+0000","last_clean":"2024-09-10T20:41:25.002333+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:25.002333+0000","last_undegraded":"2024-09-10T20:41:25.002333+0000","last_fullsized":"2024-09-10T20:41:25.002333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":98,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6844416,"data_stored":6540388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1146880,"data_stored":839300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29616,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342224,"statfs":{"total":96636764160,"available":96606437376,"internally_reserved":0,"allocated":2650112,"data_stored":2346084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":5180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":5304320,"data_stored":5011475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:28.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.386+0000 7fa929a00640 1 -- 172.21.15.81:0/818915679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa908003ac0 msgr2=0x7fa908003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.386+0000 7fa929a00640 1 --2- 172.21.15.81:0/818915679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa908003ac0 0x7fa908003ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa914001dc0 tx=0x7fa908005830 comp rx=0 tx=0).stop 2024-09-10T20:41:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.387+0000 7fa929a00640 1 -- 172.21.15.81:0/818915679 shutdown_connections 2024-09-10T20:41:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.387+0000 7fa929a00640 1 --2- 172.21.15.81:0/818915679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa908003ac0 0x7fa908003ee0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.387+0000 7fa929a00640 1 -- 172.21.15.81:0/818915679 >> 172.21.15.81:0/818915679 conn(0x7fa9240d3cc0 msgr2=0x7fa9240d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.387+0000 7fa929a00640 1 -- 172.21.15.81:0/818915679 shutdown_connections 2024-09-10T20:41:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.387+0000 7fa929a00640 1 -- 172.21.15.81:0/818915679 wait complete. 2024-09-10T20:41:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.388+0000 7fa929a00640 1 Processor -- start 2024-09-10T20:41:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.389+0000 7fa929a00640 1 -- start start 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.389+0000 7fa929a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa908003ac0 0x7fa924150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.389+0000 7fa929a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9241f89e0 0x7fa92406d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.389+0000 7fa929a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92406dd80 0x7fa924153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.389+0000 7fa929a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240d1d40 con 0x7fa9241f89e0 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.389+0000 7fa929a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240cf590 con 0x7fa92406dd80 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.389+0000 7fa929a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa9240d1ec0 con 0x7fa908003ac0 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9241f89e0 0x7fa92406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9241f89e0 0x7fa92406d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41230/0 (socket says 172.21.15.81:41230) 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 -- 172.21.15.81:0/364429828 learned_addr learned my addr 172.21.15.81:0/364429828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923e00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa908003ac0 0x7fa924150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa929000640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92406dd80 0x7fa924153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 -- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa908003ac0 msgr2=0x7fa924150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa908003ac0 0x7fa924150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 -- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92406dd80 msgr2=0x7fa924153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92406dd80 0x7fa924153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 -- 172.21.15.81:0/364429828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924153f30 con 0x7fa9241f89e0 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa929000640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92406dd80 0x7fa924153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.390+0000 7fa923400640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9241f89e0 0x7fa92406d840 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00e590 tx=0x7fa90c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.391+0000 7fa91be00640 1 -- 172.21.15.81:0/364429828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c015070 con 0x7fa9241f89e0 2024-09-10T20:41:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.391+0000 7fa91be00640 1 -- 172.21.15.81:0/364429828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa90c0109a0 con 0x7fa9241f89e0 2024-09-10T20:41:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.391+0000 7fa91be00640 1 -- 172.21.15.81:0/364429828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c010df0 con 0x7fa9241f89e0 2024-09-10T20:41:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.391+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9241f7f00 con 0x7fa9241f89e0 2024-09-10T20:41:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.391+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9241f84c0 con 0x7fa9241f89e0 2024-09-10T20:41:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.392+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92406e160 con 0x7fa9241f89e0 2024-09-10T20:41:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.393+0000 7fa91be00640 1 -- 172.21.15.81:0/364429828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa90c011460 con 0x7fa9241f89e0 2024-09-10T20:41:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.394+0000 7fa91be00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa900077f70 0x7fa90007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.395+0000 7fa91be00640 1 -- 172.21.15.81:0/364429828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7fa90c09a6a0 con 0x7fa9241f89e0 2024-09-10T20:41:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.395+0000 7fa923e00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa900077f70 0x7fa90007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.396+0000 7fa923e00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa900077f70 0x7fa90007a430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa914032000 tx=0x7fa914001510 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.399+0000 7fa91be00640 1 -- 172.21.15.81:0/364429828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa90c062730 con 0x7fa9241f89e0 2024-09-10T20:41:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.579+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa92406ebe0 con 0x7fa900077f70 2024-09-10T20:41:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.584+0000 7fa91be00640 1 -- 172.21.15.81:0/364429828 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332032 (secure 0 0 0) 0x7fa92406ebe0 con 0x7fa900077f70 2024-09-10T20:41:28.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa900077f70 msgr2=0x7fa90007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa900077f70 0x7fa90007a430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa914032000 tx=0x7fa914001510 comp rx=0 tx=0).stop 2024-09-10T20:41:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9241f89e0 msgr2=0x7fa92406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9241f89e0 0x7fa92406d840 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00e590 tx=0x7fa90c00ea50 comp rx=0 tx=0).stop 2024-09-10T20:41:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 shutdown_connections 2024-09-10T20:41:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa900077f70 0x7fa90007a430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92406dd80 0x7fa924153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9241f89e0 0x7fa92406d840 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 --2- 172.21.15.81:0/364429828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa908003ac0 0x7fa924150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 >> 172.21.15.81:0/364429828 conn(0x7fa9240d3cc0 msgr2=0x7fa9240b8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 shutdown_connections 2024-09-10T20:41:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.589+0000 7fa929a00640 1 -- 172.21.15.81:0/364429828 wait complete. 2024-09-10T20:41:28.610 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-10T20:41:27.868584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":203,"num_write_kb":7813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661,"ondisk_log_size":661,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233960,"kb_used_data":17708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740760,"statfs":{"total":773094113280,"available":772854538240,"internally_reserved":0,"allocated":18132992,"data_stored":15718463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.904965"},"pg_stats":[{"pgid":"6.3f","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002280+0000","last_change":"2024-09-10T20:40:57.808566+0000","last_active":"2024-09-10T20:41:25.002280+0000","last_peered":"2024-09-10T20:41:25.002280+0000","last_clean":"2024-09-10T20:41:25.002280+0000","last_became_active":"2024-09-10T20:40:57.808299+0000","last_became_peered":"2024-09-10T20:40:57.808299+0000","last_unstale":"2024-09-10T20:41:25.002280+0000","last_undegraded":"2024-09-10T20:41:25.002280+0000","last_fullsized":"2024-09-10T20:41:25.002280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:11.202752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.785246+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.784969+0000","last_became_peered":"2024-09-10T20:40:57.784969+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:26.513133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002056+0000","last_change":"2024-09-10T20:40:57.798413+0000","last_active":"2024-09-10T20:41:25.002056+0000","last_peered":"2024-09-10T20:41:25.002056+0000","last_clean":"2024-09-10T20:41:25.002056+0000","last_became_active":"2024-09-10T20:40:57.798085+0000","last_became_peered":"2024-09-10T20:40:57.798085+0000","last_unstale":"2024-09-10T20:41:25.002056+0000","last_undegraded":"2024-09-10T20:41:25.002056+0000","last_fullsized":"2024-09-10T20:41:25.002056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:33.904500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002674+0000","last_change":"2024-09-10T20:40:57.793918+0000","last_active":"2024-09-10T20:41:25.002674+0000","last_peered":"2024-09-10T20:41:25.002674+0000","last_clean":"2024-09-10T20:41:25.002674+0000","last_became_active":"2024-09-10T20:40:57.793335+0000","last_became_peered":"2024-09-10T20:40:57.793335+0000","last_unstale":"2024-09-10T20:41:25.002674+0000","last_undegraded":"2024-09-10T20:41:25.002674+0000","last_fullsized":"2024-09-10T20:41:25.002674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:12.740619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"40'4","reported_seq":30,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985310+0000","last_change":"2024-09-10T20:40:57.802056+0000","last_active":"2024-09-10T20:41:23.985310+0000","last_peered":"2024-09-10T20:41:23.985310+0000","last_clean":"2024-09-10T20:41:23.985310+0000","last_became_active":"2024-09-10T20:40:57.801252+0000","last_became_peered":"2024-09-10T20:40:57.801252+0000","last_unstale":"2024-09-10T20:41:23.985310+0000","last_undegraded":"2024-09-10T20:41:23.985310+0000","last_fullsized":"2024-09-10T20:41:23.985310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:43.552747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295818+0000","last_change":"2024-09-10T20:40:57.781646+0000","last_active":"2024-09-10T20:41:25.295818+0000","last_peered":"2024-09-10T20:41:25.295818+0000","last_clean":"2024-09-10T20:41:25.295818+0000","last_became_active":"2024-09-10T20:40:57.781350+0000","last_became_peered":"2024-09-10T20:40:57.781350+0000","last_unstale":"2024-09-10T20:41:25.295818+0000","last_undegraded":"2024-09-10T20:41:25.295818+0000","last_fullsized":"2024-09-10T20:41:25.295818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.959912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001962+0000","last_change":"2024-09-10T20:40:57.797129+0000","last_active":"2024-09-10T20:41:25.001962+0000","last_peered":"2024-09-10T20:41:25.001962+0000","last_clean":"2024-09-10T20:41:25.001962+0000","last_became_active":"2024-09-10T20:40:57.796854+0000","last_became_peered":"2024-09-10T20:40:57.796854+0000","last_unstale":"2024-09-10T20:41:25.001962+0000","last_undegraded":"2024-09-10T20:41:25.001962+0000","last_fullsized":"2024-09-10T20:41:25.001962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:43.327598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001457+0000","last_change":"2024-09-10T20:40:57.808609+0000","last_active":"2024-09-10T20:41:25.001457+0000","last_peered":"2024-09-10T20:41:25.001457+0000","last_clean":"2024-09-10T20:41:25.001457+0000","last_became_active":"2024-09-10T20:40:57.807999+0000","last_became_peered":"2024-09-10T20:40:57.807999+0000","last_unstale":"2024-09-10T20:41:25.001457+0000","last_undegraded":"2024-09-10T20:41:25.001457+0000","last_fullsized":"2024-09-10T20:41:25.001457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"40'11","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987894+0000","last_change":"2024-09-10T20:40:57.802618+0000","last_active":"2024-09-10T20:41:23.987894+0000","last_peered":"2024-09-10T20:41:23.987894+0000","last_clean":"2024-09-10T20:41:23.987894+0000","last_became_active":"2024-09-10T20:40:57.801991+0000","last_became_peered":"2024-09-10T20:40:57.801991+0000","last_unstale":"2024-09-10T20:41:23.987894+0000","last_undegraded":"2024-09-10T20:41:23.987894+0000","last_fullsized":"2024-09-10T20:41:23.987894+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:57.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002527+0000","last_change":"2024-09-10T20:40:57.805178+0000","last_active":"2024-09-10T20:41:25.002527+0000","last_peered":"2024-09-10T20:41:25.002527+0000","last_clean":"2024-09-10T20:41:25.002527+0000","last_became_active":"2024-09-10T20:40:57.804919+0000","last_became_peered":"2024-09-10T20:40:57.804919+0000","last_unstale":"2024-09-10T20:41:25.002527+0000","last_undegraded":"2024-09-10T20:41:25.002527+0000","last_fullsized":"2024-09-10T20:41:25.002527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:34.267791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267431+0000","last_change":"2024-09-10T20:40:57.797147+0000","last_active":"2024-09-10T20:41:25.267431+0000","last_peered":"2024-09-10T20:41:25.267431+0000","last_clean":"2024-09-10T20:41:25.267431+0000","last_became_active":"2024-09-10T20:40:57.796910+0000","last_became_peered":"2024-09-10T20:40:57.796910+0000","last_unstale":"2024-09-10T20:41:25.267431+0000","last_undegraded":"2024-09-10T20:41:25.267431+0000","last_fullsized":"2024-09-10T20:41:25.267431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:43.015903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"40'7","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986521+0000","last_change":"2024-09-10T20:40:57.804510+0000","last_active":"2024-09-10T20:41:23.986521+0000","last_peered":"2024-09-10T20:41:23.986521+0000","last_clean":"2024-09-10T20:41:23.986521+0000","last_became_active":"2024-09-10T20:40:57.804220+0000","last_became_peered":"2024-09-10T20:40:57.804220+0000","last_unstale":"2024-09-10T20:41:23.986521+0000","last_undegraded":"2024-09-10T20:41:23.986521+0000","last_fullsized":"2024-09-10T20:41:23.986521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:55.727449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002169+0000","last_change":"2024-09-10T20:40:57.795473+0000","last_active":"2024-09-10T20:41:25.002169+0000","last_peered":"2024-09-10T20:41:25.002169+0000","last_clean":"2024-09-10T20:41:25.002169+0000","last_became_active":"2024-09-10T20:40:57.795179+0000","last_became_peered":"2024-09-10T20:40:57.795179+0000","last_unstale":"2024-09-10T20:41:25.002169+0000","last_undegraded":"2024-09-10T20:41:25.002169+0000","last_fullsized":"2024-09-10T20:41:25.002169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"40'8","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991972+0000","last_change":"2024-09-10T20:40:57.801649+0000","last_active":"2024-09-10T20:41:23.991972+0000","last_peered":"2024-09-10T20:41:23.991972+0000","last_clean":"2024-09-10T20:41:23.991972+0000","last_became_active":"2024-09-10T20:40:57.797096+0000","last_became_peered":"2024-09-10T20:40:57.797096+0000","last_unstale":"2024-09-10T20:41:23.991972+0000","last_undegraded":"2024-09-10T20:41:23.991972+0000","last_fullsized":"2024-09-10T20:41:23.991972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:05.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023428+0000","last_change":"2024-09-10T20:40:57.779842+0000","last_active":"2024-09-10T20:41:25.023428+0000","last_peered":"2024-09-10T20:41:25.023428+0000","last_clean":"2024-09-10T20:41:25.023428+0000","last_became_active":"2024-09-10T20:40:57.779564+0000","last_became_peered":"2024-09-10T20:40:57.779564+0000","last_unstale":"2024-09-10T20:41:25.023428+0000","last_undegraded":"2024-09-10T20:41:25.023428+0000","last_fullsized":"2024-09-10T20:41:25.023428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:23.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001997+0000","last_change":"2024-09-10T20:40:57.806288+0000","last_active":"2024-09-10T20:41:25.001997+0000","last_peered":"2024-09-10T20:41:25.001997+0000","last_clean":"2024-09-10T20:41:25.001997+0000","last_became_active":"2024-09-10T20:40:57.804491+0000","last_became_peered":"2024-09-10T20:40:57.804491+0000","last_unstale":"2024-09-10T20:41:25.001997+0000","last_undegraded":"2024-09-10T20:41:25.001997+0000","last_fullsized":"2024-09-10T20:41:25.001997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:18.810090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024138+0000","last_change":"2024-09-10T20:40:57.781946+0000","last_active":"2024-09-10T20:41:25.024138+0000","last_peered":"2024-09-10T20:41:25.024138+0000","last_clean":"2024-09-10T20:41:25.024138+0000","last_became_active":"2024-09-10T20:40:57.781711+0000","last_became_peered":"2024-09-10T20:40:57.781711+0000","last_unstale":"2024-09-10T20:41:25.024138+0000","last_undegraded":"2024-09-10T20:41:25.024138+0000","last_fullsized":"2024-09-10T20:41:25.024138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:57.437327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023982+0000","last_change":"2024-09-10T20:40:57.781131+0000","last_active":"2024-09-10T20:41:25.023982+0000","last_peered":"2024-09-10T20:41:25.023982+0000","last_clean":"2024-09-10T20:41:25.023982+0000","last_became_active":"2024-09-10T20:40:57.780857+0000","last_became_peered":"2024-09-10T20:40:57.780857+0000","last_unstale":"2024-09-10T20:41:25.023982+0000","last_undegraded":"2024-09-10T20:41:25.023982+0000","last_fullsized":"2024-09-10T20:41:25.023982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:18.298699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972503+0000","last_change":"2024-09-10T20:40:57.799870+0000","last_active":"2024-09-10T20:41:22.972503+0000","last_peered":"2024-09-10T20:41:22.972503+0000","last_clean":"2024-09-10T20:41:22.972503+0000","last_became_active":"2024-09-10T20:40:57.799593+0000","last_became_peered":"2024-09-10T20:40:57.799593+0000","last_unstale":"2024-09-10T20:41:22.972503+0000","last_undegraded":"2024-09-10T20:41:22.972503+0000","last_fullsized":"2024-09-10T20:41:22.972503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:27.031641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267232+0000","last_change":"2024-09-10T20:40:57.788576+0000","last_active":"2024-09-10T20:41:25.267232+0000","last_peered":"2024-09-10T20:41:25.267232+0000","last_clean":"2024-09-10T20:41:25.267232+0000","last_became_active":"2024-09-10T20:40:57.788342+0000","last_became_peered":"2024-09-10T20:40:57.788342+0000","last_unstale":"2024-09-10T20:41:25.267232+0000","last_undegraded":"2024-09-10T20:41:25.267232+0000","last_fullsized":"2024-09-10T20:41:25.267232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:56.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"40'11","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267138+0000","last_change":"2024-09-10T20:40:57.797333+0000","last_active":"2024-09-10T20:41:25.267138+0000","last_peered":"2024-09-10T20:41:25.267138+0000","last_clean":"2024-09-10T20:41:25.267138+0000","last_became_active":"2024-09-10T20:40:57.794482+0000","last_became_peered":"2024-09-10T20:40:57.794482+0000","last_unstale":"2024-09-10T20:41:25.267138+0000","last_undegraded":"2024-09-10T20:41:25.267138+0000","last_fullsized":"2024-09-10T20:41:25.267138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:33.113187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267051+0000","last_change":"2024-09-10T20:40:57.785890+0000","last_active":"2024-09-10T20:41:25.267051+0000","last_peered":"2024-09-10T20:41:25.267051+0000","last_clean":"2024-09-10T20:41:25.267051+0000","last_became_active":"2024-09-10T20:40:57.785582+0000","last_became_peered":"2024-09-10T20:40:57.785582+0000","last_unstale":"2024-09-10T20:41:25.267051+0000","last_undegraded":"2024-09-10T20:41:25.267051+0000","last_fullsized":"2024-09-10T20:41:25.267051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:51.491322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023468+0000","last_change":"2024-09-10T20:40:57.786174+0000","last_active":"2024-09-10T20:41:25.023468+0000","last_peered":"2024-09-10T20:41:25.023468+0000","last_clean":"2024-09-10T20:41:25.023468+0000","last_became_active":"2024-09-10T20:40:57.785175+0000","last_became_peered":"2024-09-10T20:40:57.785175+0000","last_unstale":"2024-09-10T20:41:25.023468+0000","last_undegraded":"2024-09-10T20:41:25.023468+0000","last_fullsized":"2024-09-10T20:41:25.023468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:23.271959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001563+0000","last_change":"2024-09-10T20:40:57.808222+0000","last_active":"2024-09-10T20:41:25.001563+0000","last_peered":"2024-09-10T20:41:25.001563+0000","last_clean":"2024-09-10T20:41:25.001563+0000","last_became_active":"2024-09-10T20:40:57.807578+0000","last_became_peered":"2024-09-10T20:40:57.807578+0000","last_unstale":"2024-09-10T20:41:25.001563+0000","last_undegraded":"2024-09-10T20:41:25.001563+0000","last_fullsized":"2024-09-10T20:41:25.001563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:25.893234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"40'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995400+0000","last_change":"2024-09-10T20:40:57.803089+0000","last_active":"2024-09-10T20:41:23.995400+0000","last_peered":"2024-09-10T20:41:23.995400+0000","last_clean":"2024-09-10T20:41:23.995400+0000","last_became_active":"2024-09-10T20:40:57.802606+0000","last_became_peered":"2024-09-10T20:40:57.802606+0000","last_unstale":"2024-09-10T20:41:23.995400+0000","last_undegraded":"2024-09-10T20:41:23.995400+0000","last_fullsized":"2024-09-10T20:41:23.995400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002118+0000","last_change":"2024-09-10T20:40:57.804633+0000","last_active":"2024-09-10T20:41:25.002118+0000","last_peered":"2024-09-10T20:41:25.002118+0000","last_clean":"2024-09-10T20:41:25.002118+0000","last_became_active":"2024-09-10T20:40:57.804388+0000","last_became_peered":"2024-09-10T20:40:57.804388+0000","last_unstale":"2024-09-10T20:41:25.002118+0000","last_undegraded":"2024-09-10T20:41:25.002118+0000","last_fullsized":"2024-09-10T20:41:25.002118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:17.686400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267480+0000","last_change":"2024-09-10T20:40:57.790304+0000","last_active":"2024-09-10T20:41:25.267480+0000","last_peered":"2024-09-10T20:41:25.267480+0000","last_clean":"2024-09-10T20:41:25.267480+0000","last_became_active":"2024-09-10T20:40:57.790064+0000","last_became_peered":"2024-09-10T20:40:57.790064+0000","last_unstale":"2024-09-10T20:41:25.267480+0000","last_undegraded":"2024-09-10T20:41:25.267480+0000","last_fullsized":"2024-09-10T20:41:25.267480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:03.995020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002320+0000","last_change":"2024-09-10T20:40:57.811854+0000","last_active":"2024-09-10T20:41:25.002320+0000","last_peered":"2024-09-10T20:41:25.002320+0000","last_clean":"2024-09-10T20:41:25.002320+0000","last_became_active":"2024-09-10T20:40:57.811532+0000","last_became_peered":"2024-09-10T20:40:57.811532+0000","last_unstale":"2024-09-10T20:41:25.002320+0000","last_undegraded":"2024-09-10T20:41:25.002320+0000","last_fullsized":"2024-09-10T20:41:25.002320+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:39.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023478+0000","last_change":"2024-09-10T20:40:57.783995+0000","last_active":"2024-09-10T20:41:25.023478+0000","last_peered":"2024-09-10T20:41:25.023478+0000","last_clean":"2024-09-10T20:41:25.023478+0000","last_became_active":"2024-09-10T20:40:57.782195+0000","last_became_peered":"2024-09-10T20:40:57.782195+0000","last_unstale":"2024-09-10T20:41:25.023478+0000","last_undegraded":"2024-09-10T20:41:25.023478+0000","last_fullsized":"2024-09-10T20:41:25.023478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:53.576166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023603+0000","last_change":"2024-09-10T20:40:57.778945+0000","last_active":"2024-09-10T20:41:25.023603+0000","last_peered":"2024-09-10T20:41:25.023603+0000","last_clean":"2024-09-10T20:41:25.023603+0000","last_became_active":"2024-09-10T20:40:57.778659+0000","last_became_peered":"2024-09-10T20:40:57.778659+0000","last_unstale":"2024-09-10T20:41:25.023603+0000","last_undegraded":"2024-09-10T20:41:25.023603+0000","last_fullsized":"2024-09-10T20:41:25.023603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:42.767732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"40'12","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002065+0000","last_change":"2024-09-10T20:40:57.796477+0000","last_active":"2024-09-10T20:41:25.002065+0000","last_peered":"2024-09-10T20:41:25.002065+0000","last_clean":"2024-09-10T20:41:25.002065+0000","last_became_active":"2024-09-10T20:40:57.796191+0000","last_became_peered":"2024-09-10T20:40:57.796191+0000","last_unstale":"2024-09-10T20:41:25.002065+0000","last_undegraded":"2024-09-10T20:41:25.002065+0000","last_fullsized":"2024-09-10T20:41:25.002065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:00.682250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001687+0000","last_change":"2024-09-10T20:40:57.813103+0000","last_active":"2024-09-10T20:41:25.001687+0000","last_peered":"2024-09-10T20:41:25.001687+0000","last_clean":"2024-09-10T20:41:25.001687+0000","last_became_active":"2024-09-10T20:40:57.812863+0000","last_became_peered":"2024-09-10T20:40:57.812863+0000","last_unstale":"2024-09-10T20:41:25.001687+0000","last_undegraded":"2024-09-10T20:41:25.001687+0000","last_fullsized":"2024-09-10T20:41:25.001687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:03.255660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969555+0000","last_change":"2024-09-10T20:41:22.969555+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969555+0000","last_undegraded":"2024-09-10T20:41:22.969555+0000","last_fullsized":"2024-09-10T20:41:22.969555+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023852+0000","last_change":"2024-09-10T20:40:57.806845+0000","last_active":"2024-09-10T20:41:25.023852+0000","last_peered":"2024-09-10T20:41:25.023852+0000","last_clean":"2024-09-10T20:41:25.023852+0000","last_became_active":"2024-09-10T20:40:57.806562+0000","last_became_peered":"2024-09-10T20:40:57.806562+0000","last_unstale":"2024-09-10T20:41:25.023852+0000","last_undegraded":"2024-09-10T20:41:25.023852+0000","last_fullsized":"2024-09-10T20:41:25.023852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:32.177438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"44'8","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995550+0000","last_change":"2024-09-10T20:40:56.787360+0000","last_active":"2024-09-10T20:41:23.995550+0000","last_peered":"2024-09-10T20:41:23.995550+0000","last_clean":"2024-09-10T20:41:23.995550+0000","last_became_active":"2024-09-10T20:40:56.787113+0000","last_became_peered":"2024-09-10T20:40:56.787113+0000","last_unstale":"2024-09-10T20:41:23.995550+0000","last_undegraded":"2024-09-10T20:41:23.995550+0000","last_fullsized":"2024-09-10T20:41:23.995550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.999843+0000","last_change":"2024-09-10T20:41:23.997577+0000","last_active":"2024-09-10T20:41:23.999843+0000","last_peered":"2024-09-10T20:41:23.999843+0000","last_clean":"2024-09-10T20:41:23.999843+0000","last_became_active":"2024-09-10T20:41:23.997315+0000","last_became_peered":"2024-09-10T20:41:23.997315+0000","last_unstale":"2024-09-10T20:41:23.999843+0000","last_undegraded":"2024-09-10T20:41:23.999843+0000","last_fullsized":"2024-09-10T20:41:23.999843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:49.348851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296022+0000","last_change":"2024-09-10T20:40:57.794642+0000","last_active":"2024-09-10T20:41:25.296022+0000","last_peered":"2024-09-10T20:41:25.296022+0000","last_clean":"2024-09-10T20:41:25.296022+0000","last_became_active":"2024-09-10T20:40:57.794432+0000","last_became_peered":"2024-09-10T20:40:57.794432+0000","last_unstale":"2024-09-10T20:41:25.296022+0000","last_undegraded":"2024-09-10T20:41:25.296022+0000","last_fullsized":"2024-09-10T20:41:25.296022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:59.893364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296194+0000","last_change":"2024-09-10T20:40:56.790001+0000","last_active":"2024-09-10T20:41:25.296194+0000","last_peered":"2024-09-10T20:41:25.296194+0000","last_clean":"2024-09-10T20:41:25.296194+0000","last_became_active":"2024-09-10T20:40:56.789708+0000","last_became_peered":"2024-09-10T20:40:56.789708+0000","last_unstale":"2024-09-10T20:41:25.296194+0000","last_undegraded":"2024-09-10T20:41:25.296194+0000","last_fullsized":"2024-09-10T20:41:25.296194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:56.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267602+0000","last_change":"2024-09-10T20:41:24.001301+0000","last_active":"2024-09-10T20:41:25.267602+0000","last_peered":"2024-09-10T20:41:25.267602+0000","last_clean":"2024-09-10T20:41:25.267602+0000","last_became_active":"2024-09-10T20:41:24.000986+0000","last_became_peered":"2024-09-10T20:41:24.000986+0000","last_unstale":"2024-09-10T20:41:25.267602+0000","last_undegraded":"2024-09-10T20:41:25.267602+0000","last_fullsized":"2024-09-10T20:41:25.267602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:45.971209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024106+0000","last_change":"2024-09-10T20:40:57.804223+0000","last_active":"2024-09-10T20:41:25.024106+0000","last_peered":"2024-09-10T20:41:25.024106+0000","last_clean":"2024-09-10T20:41:25.024106+0000","last_became_active":"2024-09-10T20:40:57.800934+0000","last_became_peered":"2024-09-10T20:40:57.800934+0000","last_unstale":"2024-09-10T20:41:25.024106+0000","last_undegraded":"2024-09-10T20:41:25.024106+0000","last_fullsized":"2024-09-10T20:41:25.024106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:43.140106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"44'3","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002486+0000","last_change":"2024-09-10T20:40:56.798617+0000","last_active":"2024-09-10T20:41:25.002486+0000","last_peered":"2024-09-10T20:41:25.002486+0000","last_clean":"2024-09-10T20:41:25.002486+0000","last_became_active":"2024-09-10T20:40:56.798233+0000","last_became_peered":"2024-09-10T20:40:56.798233+0000","last_unstale":"2024-09-10T20:41:25.002486+0000","last_undegraded":"2024-09-10T20:41:25.002486+0000","last_fullsized":"2024-09-10T20:41:25.002486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:55.548605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003712+0000","last_change":"2024-09-10T20:41:23.999098+0000","last_active":"2024-09-10T20:41:24.003712+0000","last_peered":"2024-09-10T20:41:24.003712+0000","last_clean":"2024-09-10T20:41:24.003712+0000","last_became_active":"2024-09-10T20:41:23.998720+0000","last_became_peered":"2024-09-10T20:41:23.998720+0000","last_unstale":"2024-09-10T20:41:24.003712+0000","last_undegraded":"2024-09-10T20:41:24.003712+0000","last_fullsized":"2024-09-10T20:41:24.003712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:31.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296273+0000","last_change":"2024-09-10T20:40:57.790493+0000","last_active":"2024-09-10T20:41:25.296273+0000","last_peered":"2024-09-10T20:41:25.296273+0000","last_clean":"2024-09-10T20:41:25.296273+0000","last_became_active":"2024-09-10T20:40:57.789768+0000","last_became_peered":"2024-09-10T20:40:57.789768+0000","last_unstale":"2024-09-10T20:41:25.296273+0000","last_undegraded":"2024-09-10T20:41:25.296273+0000","last_fullsized":"2024-09-10T20:41:25.296273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.004069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"44'3","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995056+0000","last_change":"2024-09-10T20:40:56.798645+0000","last_active":"2024-09-10T20:41:23.995056+0000","last_peered":"2024-09-10T20:41:23.995056+0000","last_clean":"2024-09-10T20:41:23.995056+0000","last_became_active":"2024-09-10T20:40:56.798325+0000","last_became_peered":"2024-09-10T20:40:56.798325+0000","last_unstale":"2024-09-10T20:41:23.995056+0000","last_undegraded":"2024-09-10T20:41:23.995056+0000","last_fullsized":"2024-09-10T20:41:23.995056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:18.678416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023770+0000","last_change":"2024-09-10T20:41:23.999199+0000","last_active":"2024-09-10T20:41:25.023770+0000","last_peered":"2024-09-10T20:41:25.023770+0000","last_clean":"2024-09-10T20:41:25.023770+0000","last_became_active":"2024-09-10T20:41:23.998893+0000","last_became_peered":"2024-09-10T20:41:23.998893+0000","last_unstale":"2024-09-10T20:41:25.023770+0000","last_undegraded":"2024-09-10T20:41:25.023770+0000","last_fullsized":"2024-09-10T20:41:25.023770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.712353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001816+0000","last_change":"2024-09-10T20:40:57.792035+0000","last_active":"2024-09-10T20:41:25.001816+0000","last_peered":"2024-09-10T20:41:25.001816+0000","last_clean":"2024-09-10T20:41:25.001816+0000","last_became_active":"2024-09-10T20:40:57.791743+0000","last_became_peered":"2024-09-10T20:40:57.791743+0000","last_unstale":"2024-09-10T20:41:25.001816+0000","last_undegraded":"2024-09-10T20:41:25.001816+0000","last_fullsized":"2024-09-10T20:41:25.001816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:35.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995191+0000","last_change":"2024-09-10T20:40:56.778488+0000","last_active":"2024-09-10T20:41:23.995191+0000","last_peered":"2024-09-10T20:41:23.995191+0000","last_clean":"2024-09-10T20:41:23.995191+0000","last_became_active":"2024-09-10T20:40:56.778241+0000","last_became_peered":"2024-09-10T20:40:56.778241+0000","last_unstale":"2024-09-10T20:41:23.995191+0000","last_undegraded":"2024-09-10T20:41:23.995191+0000","last_fullsized":"2024-09-10T20:41:23.995191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002542+0000","last_change":"2024-09-10T20:41:23.996850+0000","last_active":"2024-09-10T20:41:25.002542+0000","last_peered":"2024-09-10T20:41:25.002542+0000","last_clean":"2024-09-10T20:41:25.002542+0000","last_became_active":"2024-09-10T20:41:23.996537+0000","last_became_peered":"2024-09-10T20:41:23.996537+0000","last_unstale":"2024-09-10T20:41:25.002542+0000","last_undegraded":"2024-09-10T20:41:25.002542+0000","last_fullsized":"2024-09-10T20:41:25.002542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:09.881621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267021+0000","last_change":"2024-09-10T20:40:57.787640+0000","last_active":"2024-09-10T20:41:25.267021+0000","last_peered":"2024-09-10T20:41:25.267021+0000","last_clean":"2024-09-10T20:41:25.267021+0000","last_became_active":"2024-09-10T20:40:57.787374+0000","last_became_peered":"2024-09-10T20:40:57.787374+0000","last_unstale":"2024-09-10T20:41:25.267021+0000","last_undegraded":"2024-09-10T20:41:25.267021+0000","last_fullsized":"2024-09-10T20:41:25.267021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.579080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002354+0000","last_change":"2024-09-10T20:40:56.799544+0000","last_active":"2024-09-10T20:41:25.002354+0000","last_peered":"2024-09-10T20:41:25.002354+0000","last_clean":"2024-09-10T20:41:25.002354+0000","last_became_active":"2024-09-10T20:40:56.799273+0000","last_became_peered":"2024-09-10T20:40:56.799273+0000","last_unstale":"2024-09-10T20:41:25.002354+0000","last_undegraded":"2024-09-10T20:41:25.002354+0000","last_fullsized":"2024-09-10T20:41:25.002354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:24.776937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001061+0000","last_change":"2024-09-10T20:41:24.000751+0000","last_active":"2024-09-10T20:41:25.001061+0000","last_peered":"2024-09-10T20:41:25.001061+0000","last_clean":"2024-09-10T20:41:25.001061+0000","last_became_active":"2024-09-10T20:41:24.000476+0000","last_became_peered":"2024-09-10T20:41:24.000476+0000","last_unstale":"2024-09-10T20:41:25.001061+0000","last_undegraded":"2024-09-10T20:41:25.001061+0000","last_fullsized":"2024-09-10T20:41:25.001061+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:50.959302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023652+0000","last_change":"2024-09-10T20:40:57.790412+0000","last_active":"2024-09-10T20:41:25.023652+0000","last_peered":"2024-09-10T20:41:25.023652+0000","last_clean":"2024-09-10T20:41:25.023652+0000","last_became_active":"2024-09-10T20:40:57.788308+0000","last_became_peered":"2024-09-10T20:40:57.788308+0000","last_unstale":"2024-09-10T20:41:25.023652+0000","last_undegraded":"2024-09-10T20:41:25.023652+0000","last_fullsized":"2024-09-10T20:41:25.023652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.492132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001391+0000","last_change":"2024-09-10T20:40:56.795211+0000","last_active":"2024-09-10T20:41:25.001391+0000","last_peered":"2024-09-10T20:41:25.001391+0000","last_clean":"2024-09-10T20:41:25.001391+0000","last_became_active":"2024-09-10T20:40:56.794869+0000","last_became_peered":"2024-09-10T20:40:56.794869+0000","last_unstale":"2024-09-10T20:41:25.001391+0000","last_undegraded":"2024-09-10T20:41:25.001391+0000","last_fullsized":"2024-09-10T20:41:25.001391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:54.724711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023595+0000","last_change":"2024-09-10T20:41:23.992976+0000","last_active":"2024-09-10T20:41:25.023595+0000","last_peered":"2024-09-10T20:41:25.023595+0000","last_clean":"2024-09-10T20:41:25.023595+0000","last_became_active":"2024-09-10T20:41:23.992286+0000","last_became_peered":"2024-09-10T20:41:23.992286+0000","last_unstale":"2024-09-10T20:41:25.023595+0000","last_undegraded":"2024-09-10T20:41:25.023595+0000","last_fullsized":"2024-09-10T20:41:25.023595+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:38.417982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.799569+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.799219+0000","last_became_peered":"2024-09-10T20:40:57.799219+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:29.475021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002246+0000","last_change":"2024-09-10T20:40:56.779639+0000","last_active":"2024-09-10T20:41:25.002246+0000","last_peered":"2024-09-10T20:41:25.002246+0000","last_clean":"2024-09-10T20:41:25.002246+0000","last_became_active":"2024-09-10T20:40:56.779311+0000","last_became_peered":"2024-09-10T20:40:56.779311+0000","last_unstale":"2024-09-10T20:41:25.002246+0000","last_undegraded":"2024-09-10T20:41:25.002246+0000","last_fullsized":"2024-09-10T20:41:25.002246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:39.771929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023992+0000","last_change":"2024-09-10T20:41:24.003499+0000","last_active":"2024-09-10T20:41:25.023992+0000","last_peered":"2024-09-10T20:41:25.023992+0000","last_clean":"2024-09-10T20:41:25.023992+0000","last_became_active":"2024-09-10T20:41:24.003230+0000","last_became_peered":"2024-09-10T20:41:24.003230+0000","last_unstale":"2024-09-10T20:41:25.023992+0000","last_undegraded":"2024-09-10T20:41:25.023992+0000","last_fullsized":"2024-09-10T20:41:25.023992+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:49.321950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'11","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002775+0000","last_change":"2024-09-10T20:40:57.793647+0000","last_active":"2024-09-10T20:41:25.002775+0000","last_peered":"2024-09-10T20:41:25.002775+0000","last_clean":"2024-09-10T20:41:25.002775+0000","last_became_active":"2024-09-10T20:40:57.792950+0000","last_became_peered":"2024-09-10T20:40:57.792950+0000","last_unstale":"2024-09-10T20:41:25.002775+0000","last_undegraded":"2024-09-10T20:41:25.002775+0000","last_fullsized":"2024-09-10T20:41:25.002775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:17.034966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002385+0000","last_change":"2024-09-10T20:40:56.799456+0000","last_active":"2024-09-10T20:41:25.002385+0000","last_peered":"2024-09-10T20:41:25.002385+0000","last_clean":"2024-09-10T20:41:25.002385+0000","last_became_active":"2024-09-10T20:40:56.799162+0000","last_became_peered":"2024-09-10T20:40:56.799162+0000","last_unstale":"2024-09-10T20:41:25.002385+0000","last_undegraded":"2024-09-10T20:41:25.002385+0000","last_fullsized":"2024-09-10T20:41:25.002385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:44.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969265+0000","last_change":"2024-09-10T20:41:22.969265+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969265+0000","last_undegraded":"2024-09-10T20:41:22.969265+0000","last_fullsized":"2024-09-10T20:41:22.969265+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'6","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995073+0000","last_change":"2024-09-10T20:40:57.802645+0000","last_active":"2024-09-10T20:41:23.995073+0000","last_peered":"2024-09-10T20:41:23.995073+0000","last_clean":"2024-09-10T20:41:23.995073+0000","last_became_active":"2024-09-10T20:40:57.802283+0000","last_became_peered":"2024-09-10T20:40:57.802283+0000","last_unstale":"2024-09-10T20:41:23.995073+0000","last_undegraded":"2024-09-10T20:41:23.995073+0000","last_fullsized":"2024-09-10T20:41:23.995073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:17.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023984+0000","last_change":"2024-09-10T20:40:56.787551+0000","last_active":"2024-09-10T20:41:25.023984+0000","last_peered":"2024-09-10T20:41:25.023984+0000","last_clean":"2024-09-10T20:41:25.023984+0000","last_became_active":"2024-09-10T20:40:56.786720+0000","last_became_peered":"2024-09-10T20:40:56.786720+0000","last_unstale":"2024-09-10T20:41:25.023984+0000","last_undegraded":"2024-09-10T20:41:25.023984+0000","last_fullsized":"2024-09-10T20:41:25.023984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:58.890626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002375+0000","last_change":"2024-09-10T20:41:23.994183+0000","last_active":"2024-09-10T20:41:25.002375+0000","last_peered":"2024-09-10T20:41:25.002375+0000","last_clean":"2024-09-10T20:41:25.002375+0000","last_became_active":"2024-09-10T20:41:23.993219+0000","last_became_peered":"2024-09-10T20:41:23.993219+0000","last_unstale":"2024-09-10T20:41:25.002375+0000","last_undegraded":"2024-09-10T20:41:25.002375+0000","last_fullsized":"2024-09-10T20:41:25.002375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:55.786567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002227+0000","last_change":"2024-09-10T20:40:57.805104+0000","last_active":"2024-09-10T20:41:25.002227+0000","last_peered":"2024-09-10T20:41:25.002227+0000","last_clean":"2024-09-10T20:41:25.002227+0000","last_became_active":"2024-09-10T20:40:57.804894+0000","last_became_peered":"2024-09-10T20:40:57.804894+0000","last_unstale":"2024-09-10T20:41:25.002227+0000","last_undegraded":"2024-09-10T20:41:25.002227+0000","last_fullsized":"2024-09-10T20:41:25.002227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:02.247029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"44'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024048+0000","last_change":"2024-09-10T20:40:56.798785+0000","last_active":"2024-09-10T20:41:25.024048+0000","last_peered":"2024-09-10T20:41:25.024048+0000","last_clean":"2024-09-10T20:41:25.024048+0000","last_became_active":"2024-09-10T20:40:56.798390+0000","last_became_peered":"2024-09-10T20:40:56.798390+0000","last_unstale":"2024-09-10T20:41:25.024048+0000","last_undegraded":"2024-09-10T20:41:25.024048+0000","last_fullsized":"2024-09-10T20:41:25.024048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:39.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002349+0000","last_change":"2024-09-10T20:41:23.993848+0000","last_active":"2024-09-10T20:41:25.002349+0000","last_peered":"2024-09-10T20:41:25.002349+0000","last_clean":"2024-09-10T20:41:25.002349+0000","last_became_active":"2024-09-10T20:41:23.993558+0000","last_became_peered":"2024-09-10T20:41:23.993558+0000","last_unstale":"2024-09-10T20:41:25.002349+0000","last_undegraded":"2024-09-10T20:41:25.002349+0000","last_fullsized":"2024-09-10T20:41:25.002349+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:05.240195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002434+0000","last_change":"2024-09-10T20:40:57.807154+0000","last_active":"2024-09-10T20:41:25.002434+0000","last_peered":"2024-09-10T20:41:25.002434+0000","last_clean":"2024-09-10T20:41:25.002434+0000","last_became_active":"2024-09-10T20:40:57.806970+0000","last_became_peered":"2024-09-10T20:40:57.806970+0000","last_unstale":"2024-09-10T20:41:25.002434+0000","last_undegraded":"2024-09-10T20:41:25.002434+0000","last_fullsized":"2024-09-10T20:41:25.002434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:40.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"44'24","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002928+0000","last_change":"2024-09-10T20:40:56.798461+0000","last_active":"2024-09-10T20:41:25.002928+0000","last_peered":"2024-09-10T20:41:25.002928+0000","last_clean":"2024-09-10T20:41:25.002928+0000","last_became_active":"2024-09-10T20:40:56.798136+0000","last_became_peered":"2024-09-10T20:40:56.798136+0000","last_unstale":"2024-09-10T20:41:25.002928+0000","last_undegraded":"2024-09-10T20:41:25.002928+0000","last_fullsized":"2024-09-10T20:41:25.002928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:08.271880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.998155+0000","last_change":"2024-09-10T20:41:23.994788+0000","last_active":"2024-09-10T20:41:23.998155+0000","last_peered":"2024-09-10T20:41:23.998155+0000","last_clean":"2024-09-10T20:41:23.998155+0000","last_became_active":"2024-09-10T20:41:23.994527+0000","last_became_peered":"2024-09-10T20:41:23.994527+0000","last_unstale":"2024-09-10T20:41:23.998155+0000","last_undegraded":"2024-09-10T20:41:23.998155+0000","last_fullsized":"2024-09-10T20:41:23.998155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001987+0000","last_change":"2024-09-10T20:40:57.800593+0000","last_active":"2024-09-10T20:41:25.001987+0000","last_peered":"2024-09-10T20:41:25.001987+0000","last_clean":"2024-09-10T20:41:25.001987+0000","last_became_active":"2024-09-10T20:40:57.796067+0000","last_became_peered":"2024-09-10T20:40:57.796067+0000","last_unstale":"2024-09-10T20:41:25.001987+0000","last_undegraded":"2024-09-10T20:41:25.001987+0000","last_fullsized":"2024-09-10T20:41:25.001987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:13.660313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"44'5","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001700+0000","last_change":"2024-09-10T20:40:56.798892+0000","last_active":"2024-09-10T20:41:25.001700+0000","last_peered":"2024-09-10T20:41:25.001700+0000","last_clean":"2024-09-10T20:41:25.001700+0000","last_became_active":"2024-09-10T20:40:56.798574+0000","last_became_peered":"2024-09-10T20:40:56.798574+0000","last_unstale":"2024-09-10T20:41:25.001700+0000","last_undegraded":"2024-09-10T20:41:25.001700+0000","last_fullsized":"2024-09-10T20:41:25.001700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:12.809899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003719+0000","last_change":"2024-09-10T20:41:23.997814+0000","last_active":"2024-09-10T20:41:24.003719+0000","last_peered":"2024-09-10T20:41:24.003719+0000","last_clean":"2024-09-10T20:41:24.003719+0000","last_became_active":"2024-09-10T20:41:23.997261+0000","last_became_peered":"2024-09-10T20:41:23.997261+0000","last_unstale":"2024-09-10T20:41:24.003719+0000","last_undegraded":"2024-09-10T20:41:24.003719+0000","last_fullsized":"2024-09-10T20:41:24.003719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:33.403127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295687+0000","last_change":"2024-09-10T20:40:57.789344+0000","last_active":"2024-09-10T20:41:25.295687+0000","last_peered":"2024-09-10T20:41:25.295687+0000","last_clean":"2024-09-10T20:41:25.295687+0000","last_became_active":"2024-09-10T20:40:57.789092+0000","last_became_peered":"2024-09-10T20:40:57.789092+0000","last_unstale":"2024-09-10T20:41:25.295687+0000","last_undegraded":"2024-09-10T20:41:25.295687+0000","last_fullsized":"2024-09-10T20:41:25.295687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.377370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295848+0000","last_change":"2024-09-10T20:40:56.787899+0000","last_active":"2024-09-10T20:41:25.295848+0000","last_peered":"2024-09-10T20:41:25.295848+0000","last_clean":"2024-09-10T20:41:25.295848+0000","last_became_active":"2024-09-10T20:40:56.787509+0000","last_became_peered":"2024-09-10T20:40:56.787509+0000","last_unstale":"2024-09-10T20:41:25.295848+0000","last_undegraded":"2024-09-10T20:41:25.295848+0000","last_fullsized":"2024-09-10T20:41:25.295848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.249527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995941+0000","last_change":"2024-09-10T20:41:23.993761+0000","last_active":"2024-09-10T20:41:23.995941+0000","last_peered":"2024-09-10T20:41:23.995941+0000","last_clean":"2024-09-10T20:41:23.995941+0000","last_became_active":"2024-09-10T20:41:23.993477+0000","last_became_peered":"2024-09-10T20:41:23.993477+0000","last_unstale":"2024-09-10T20:41:23.995941+0000","last_undegraded":"2024-09-10T20:41:23.995941+0000","last_fullsized":"2024-09-10T20:41:23.995941+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:35.482106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267196+0000","last_change":"2024-09-10T20:40:57.786588+0000","last_active":"2024-09-10T20:41:25.267196+0000","last_peered":"2024-09-10T20:41:25.267196+0000","last_clean":"2024-09-10T20:41:25.267196+0000","last_became_active":"2024-09-10T20:40:57.786296+0000","last_became_peered":"2024-09-10T20:40:57.786296+0000","last_unstale":"2024-09-10T20:41:25.267196+0000","last_undegraded":"2024-09-10T20:41:25.267196+0000","last_fullsized":"2024-09-10T20:41:25.267196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:36.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023573+0000","last_change":"2024-09-10T20:40:56.783758+0000","last_active":"2024-09-10T20:41:25.023573+0000","last_peered":"2024-09-10T20:41:25.023573+0000","last_clean":"2024-09-10T20:41:25.023573+0000","last_became_active":"2024-09-10T20:40:56.783512+0000","last_became_peered":"2024-09-10T20:40:56.783512+0000","last_unstale":"2024-09-10T20:41:25.023573+0000","last_undegraded":"2024-09-10T20:41:25.023573+0000","last_fullsized":"2024-09-10T20:41:25.023573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:39.374632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002192+0000","last_change":"2024-09-10T20:41:24.000925+0000","last_active":"2024-09-10T20:41:25.002192+0000","last_peered":"2024-09-10T20:41:25.002192+0000","last_clean":"2024-09-10T20:41:25.002192+0000","last_became_active":"2024-09-10T20:41:23.999216+0000","last_became_peered":"2024-09-10T20:41:23.999216+0000","last_unstale":"2024-09-10T20:41:25.002192+0000","last_undegraded":"2024-09-10T20:41:25.002192+0000","last_fullsized":"2024-09-10T20:41:25.002192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:36.479766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'15","reported_seq":41,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985588+0000","last_change":"2024-09-10T20:40:57.801745+0000","last_active":"2024-09-10T20:41:23.985588+0000","last_peered":"2024-09-10T20:41:23.985588+0000","last_clean":"2024-09-10T20:41:23.985588+0000","last_became_active":"2024-09-10T20:40:57.801484+0000","last_became_peered":"2024-09-10T20:40:57.801484+0000","last_unstale":"2024-09-10T20:41:23.985588+0000","last_undegraded":"2024-09-10T20:41:23.985588+0000","last_fullsized":"2024-09-10T20:41:23.985588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:10.503000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"44'15","reported_seq":43,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991869+0000","last_change":"2024-09-10T20:40:56.779692+0000","last_active":"2024-09-10T20:41:23.991869+0000","last_peered":"2024-09-10T20:41:23.991869+0000","last_clean":"2024-09-10T20:41:23.991869+0000","last_became_active":"2024-09-10T20:40:56.779447+0000","last_became_peered":"2024-09-10T20:40:56.779447+0000","last_unstale":"2024-09-10T20:41:23.991869+0000","last_undegraded":"2024-09-10T20:41:23.991869+0000","last_fullsized":"2024-09-10T20:41:23.991869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:15.261201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002291+0000","last_change":"2024-09-10T20:41:23.999605+0000","last_active":"2024-09-10T20:41:25.002291+0000","last_peered":"2024-09-10T20:41:25.002291+0000","last_clean":"2024-09-10T20:41:25.002291+0000","last_became_active":"2024-09-10T20:41:23.998539+0000","last_became_peered":"2024-09-10T20:41:23.998539+0000","last_unstale":"2024-09-10T20:41:25.002291+0000","last_undegraded":"2024-09-10T20:41:25.002291+0000","last_fullsized":"2024-09-10T20:41:25.002291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:26.825035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295947+0000","last_change":"2024-09-10T20:40:57.795777+0000","last_active":"2024-09-10T20:41:25.295947+0000","last_peered":"2024-09-10T20:41:25.295947+0000","last_clean":"2024-09-10T20:41:25.295947+0000","last_became_active":"2024-09-10T20:40:57.795521+0000","last_became_peered":"2024-09-10T20:40:57.795521+0000","last_unstale":"2024-09-10T20:41:25.295947+0000","last_undegraded":"2024-09-10T20:41:25.295947+0000","last_fullsized":"2024-09-10T20:41:25.295947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:15.958954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"44'2","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002456+0000","last_change":"2024-09-10T20:40:56.792708+0000","last_active":"2024-09-10T20:41:25.002456+0000","last_peered":"2024-09-10T20:41:25.002456+0000","last_clean":"2024-09-10T20:41:25.002456+0000","last_became_active":"2024-09-10T20:40:56.792427+0000","last_became_peered":"2024-09-10T20:40:56.792427+0000","last_unstale":"2024-09-10T20:41:25.002456+0000","last_undegraded":"2024-09-10T20:41:25.002456+0000","last_fullsized":"2024-09-10T20:41:25.002456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:40.781428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.008364+0000","last_change":"2024-09-10T20:41:24.005055+0000","last_active":"2024-09-10T20:41:24.008364+0000","last_peered":"2024-09-10T20:41:24.008364+0000","last_clean":"2024-09-10T20:41:24.008364+0000","last_became_active":"2024-09-10T20:41:24.004760+0000","last_became_peered":"2024-09-10T20:41:24.004760+0000","last_unstale":"2024-09-10T20:41:24.008364+0000","last_undegraded":"2024-09-10T20:41:24.008364+0000","last_fullsized":"2024-09-10T20:41:24.008364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:40.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002465+0000","last_change":"2024-09-10T20:40:57.805292+0000","last_active":"2024-09-10T20:41:25.002465+0000","last_peered":"2024-09-10T20:41:25.002465+0000","last_clean":"2024-09-10T20:41:25.002465+0000","last_became_active":"2024-09-10T20:40:57.804999+0000","last_became_peered":"2024-09-10T20:40:57.804999+0000","last_unstale":"2024-09-10T20:41:25.002465+0000","last_undegraded":"2024-09-10T20:41:25.002465+0000","last_fullsized":"2024-09-10T20:41:25.002465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:56.651005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024199+0000","last_change":"2024-09-10T20:40:56.798769+0000","last_active":"2024-09-10T20:41:25.024199+0000","last_peered":"2024-09-10T20:41:25.024199+0000","last_clean":"2024-09-10T20:41:25.024199+0000","last_became_active":"2024-09-10T20:40:56.798317+0000","last_became_peered":"2024-09-10T20:40:56.798317+0000","last_unstale":"2024-09-10T20:41:25.024199+0000","last_undegraded":"2024-09-10T20:41:25.024199+0000","last_fullsized":"2024-09-10T20:41:25.024199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:25.510395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003862+0000","last_change":"2024-09-10T20:41:23.999829+0000","last_active":"2024-09-10T20:41:24.003862+0000","last_peered":"2024-09-10T20:41:24.003862+0000","last_clean":"2024-09-10T20:41:24.003862+0000","last_became_active":"2024-09-10T20:41:23.999579+0000","last_became_peered":"2024-09-10T20:41:23.999579+0000","last_unstale":"2024-09-10T20:41:24.003862+0000","last_undegraded":"2024-09-10T20:41:24.003862+0000","last_fullsized":"2024-09-10T20:41:24.003862+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002530+0000","last_change":"2024-09-10T20:40:57.795506+0000","last_active":"2024-09-10T20:41:25.002530+0000","last_peered":"2024-09-10T20:41:25.002530+0000","last_clean":"2024-09-10T20:41:25.002530+0000","last_became_active":"2024-09-10T20:40:57.795238+0000","last_became_peered":"2024-09-10T20:40:57.795238+0000","last_unstale":"2024-09-10T20:41:25.002530+0000","last_undegraded":"2024-09-10T20:41:25.002530+0000","last_fullsized":"2024-09-10T20:41:25.002530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"44'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986466+0000","last_change":"2024-09-10T20:40:56.792843+0000","last_active":"2024-09-10T20:41:23.986466+0000","last_peered":"2024-09-10T20:41:23.986466+0000","last_clean":"2024-09-10T20:41:23.986466+0000","last_became_active":"2024-09-10T20:40:56.792439+0000","last_became_peered":"2024-09-10T20:40:56.792439+0000","last_unstale":"2024-09-10T20:41:23.986466+0000","last_undegraded":"2024-09-10T20:41:23.986466+0000","last_fullsized":"2024-09-10T20:41:23.986466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:49.054542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003682+0000","last_change":"2024-09-10T20:41:23.997742+0000","last_active":"2024-09-10T20:41:24.003682+0000","last_peered":"2024-09-10T20:41:24.003682+0000","last_clean":"2024-09-10T20:41:24.003682+0000","last_became_active":"2024-09-10T20:41:23.997137+0000","last_became_peered":"2024-09-10T20:41:23.997137+0000","last_unstale":"2024-09-10T20:41:24.003682+0000","last_undegraded":"2024-09-10T20:41:24.003682+0000","last_fullsized":"2024-09-10T20:41:24.003682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:12.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'9","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972839+0000","last_change":"2024-09-10T20:40:57.798663+0000","last_active":"2024-09-10T20:41:22.972839+0000","last_peered":"2024-09-10T20:41:22.972839+0000","last_clean":"2024-09-10T20:41:22.972839+0000","last_became_active":"2024-09-10T20:40:57.798333+0000","last_became_peered":"2024-09-10T20:40:57.798333+0000","last_unstale":"2024-09-10T20:41:22.972839+0000","last_undegraded":"2024-09-10T20:41:22.972839+0000","last_fullsized":"2024-09-10T20:41:22.972839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:22.259106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972259+0000","last_change":"2024-09-10T20:40:56.789841+0000","last_active":"2024-09-10T20:41:22.972259+0000","last_peered":"2024-09-10T20:41:22.972259+0000","last_clean":"2024-09-10T20:41:22.972259+0000","last_became_active":"2024-09-10T20:40:56.789524+0000","last_became_peered":"2024-09-10T20:40:56.789524+0000","last_unstale":"2024-09-10T20:41:22.972259+0000","last_undegraded":"2024-09-10T20:41:22.972259+0000","last_fullsized":"2024-09-10T20:41:22.972259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:06.139874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969239+0000","last_change":"2024-09-10T20:41:22.969239+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969239+0000","last_undegraded":"2024-09-10T20:41:22.969239+0000","last_fullsized":"2024-09-10T20:41:22.969239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023403+0000","last_change":"2024-09-10T20:40:57.779901+0000","last_active":"2024-09-10T20:41:25.023403+0000","last_peered":"2024-09-10T20:41:25.023403+0000","last_clean":"2024-09-10T20:41:25.023403+0000","last_became_active":"2024-09-10T20:40:57.779489+0000","last_became_peered":"2024-09-10T20:40:57.779489+0000","last_unstale":"2024-09-10T20:41:25.023403+0000","last_undegraded":"2024-09-10T20:41:25.023403+0000","last_fullsized":"2024-09-10T20:41:25.023403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.265123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"44'4","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.971719+0000","last_change":"2024-09-10T20:40:56.787107+0000","last_active":"2024-09-10T20:41:22.971719+0000","last_peered":"2024-09-10T20:41:22.971719+0000","last_clean":"2024-09-10T20:41:22.971719+0000","last_became_active":"2024-09-10T20:40:56.786778+0000","last_became_peered":"2024-09-10T20:40:56.786778+0000","last_unstale":"2024-09-10T20:41:22.971719+0000","last_undegraded":"2024-09-10T20:41:22.971719+0000","last_fullsized":"2024-09-10T20:41:22.971719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:21.098826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969341+0000","last_change":"2024-09-10T20:41:22.969341+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969341+0000","last_undegraded":"2024-09-10T20:41:22.969341+0000","last_fullsized":"2024-09-10T20:41:22.969341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"40'2","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001262+0000","last_change":"2024-09-10T20:40:57.805036+0000","last_active":"2024-09-10T20:41:25.001262+0000","last_peered":"2024-09-10T20:41:25.001262+0000","last_clean":"2024-09-10T20:41:25.001262+0000","last_became_active":"2024-09-10T20:40:57.804826+0000","last_became_peered":"2024-09-10T20:40:57.804826+0000","last_unstale":"2024-09-10T20:41:25.001262+0000","last_undegraded":"2024-09-10T20:41:25.001262+0000","last_fullsized":"2024-09-10T20:41:25.001262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:26.742701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295936+0000","last_change":"2024-09-10T20:40:56.792580+0000","last_active":"2024-09-10T20:41:25.295936+0000","last_peered":"2024-09-10T20:41:25.295936+0000","last_clean":"2024-09-10T20:41:25.295936+0000","last_became_active":"2024-09-10T20:40:56.792296+0000","last_became_peered":"2024-09-10T20:40:56.792296+0000","last_unstale":"2024-09-10T20:41:25.295936+0000","last_undegraded":"2024-09-10T20:41:25.295936+0000","last_fullsized":"2024-09-10T20:41:25.295936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:34.728794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295921+0000","last_change":"2024-09-10T20:41:23.999776+0000","last_active":"2024-09-10T20:41:25.295921+0000","last_peered":"2024-09-10T20:41:25.295921+0000","last_clean":"2024-09-10T20:41:25.295921+0000","last_became_active":"2024-09-10T20:41:23.999315+0000","last_became_peered":"2024-09-10T20:41:23.999315+0000","last_unstale":"2024-09-10T20:41:25.295921+0000","last_undegraded":"2024-09-10T20:41:25.295921+0000","last_fullsized":"2024-09-10T20:41:25.295921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:22.338151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267170+0000","last_change":"2024-09-10T20:40:57.798757+0000","last_active":"2024-09-10T20:41:25.267170+0000","last_peered":"2024-09-10T20:41:25.267170+0000","last_clean":"2024-09-10T20:41:25.267170+0000","last_became_active":"2024-09-10T20:40:57.796635+0000","last_became_peered":"2024-09-10T20:40:57.796635+0000","last_unstale":"2024-09-10T20:41:25.267170+0000","last_undegraded":"2024-09-10T20:41:25.267170+0000","last_fullsized":"2024-09-10T20:41:25.267170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:19.855245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002083+0000","last_change":"2024-09-10T20:40:56.779612+0000","last_active":"2024-09-10T20:41:25.002083+0000","last_peered":"2024-09-10T20:41:25.002083+0000","last_clean":"2024-09-10T20:41:25.002083+0000","last_became_active":"2024-09-10T20:40:56.779319+0000","last_became_peered":"2024-09-10T20:40:56.779319+0000","last_unstale":"2024-09-10T20:41:25.002083+0000","last_undegraded":"2024-09-10T20:41:25.002083+0000","last_fullsized":"2024-09-10T20:41:25.002083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:20.129458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001203+0000","last_change":"2024-09-10T20:41:24.002621+0000","last_active":"2024-09-10T20:41:25.001203+0000","last_peered":"2024-09-10T20:41:25.001203+0000","last_clean":"2024-09-10T20:41:25.001203+0000","last_became_active":"2024-09-10T20:41:24.001969+0000","last_became_peered":"2024-09-10T20:41:24.001969+0000","last_unstale":"2024-09-10T20:41:25.001203+0000","last_undegraded":"2024-09-10T20:41:25.001203+0000","last_fullsized":"2024-09-10T20:41:25.001203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:38.113389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001137+0000","last_change":"2024-09-10T20:40:57.794987+0000","last_active":"2024-09-10T20:41:25.001137+0000","last_peered":"2024-09-10T20:41:25.001137+0000","last_clean":"2024-09-10T20:41:25.001137+0000","last_became_active":"2024-09-10T20:40:57.794701+0000","last_became_peered":"2024-09-10T20:40:57.794701+0000","last_unstale":"2024-09-10T20:41:25.001137+0000","last_undegraded":"2024-09-10T20:41:25.001137+0000","last_fullsized":"2024-09-10T20:41:25.001137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:35.070564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295553+0000","last_change":"2024-09-10T20:40:56.796619+0000","last_active":"2024-09-10T20:41:25.295553+0000","last_peered":"2024-09-10T20:41:25.295553+0000","last_clean":"2024-09-10T20:41:25.295553+0000","last_became_active":"2024-09-10T20:40:56.796334+0000","last_became_peered":"2024-09-10T20:40:56.796334+0000","last_unstale":"2024-09-10T20:41:25.295553+0000","last_undegraded":"2024-09-10T20:41:25.295553+0000","last_fullsized":"2024-09-10T20:41:25.295553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:18.035879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024094+0000","last_change":"2024-09-10T20:41:24.002545+0000","last_active":"2024-09-10T20:41:25.024094+0000","last_peered":"2024-09-10T20:41:25.024094+0000","last_clean":"2024-09-10T20:41:25.024094+0000","last_became_active":"2024-09-10T20:41:24.002269+0000","last_became_peered":"2024-09-10T20:41:24.002269+0000","last_unstale":"2024-09-10T20:41:25.024094+0000","last_undegraded":"2024-09-10T20:41:25.024094+0000","last_fullsized":"2024-09-10T20:41:25.024094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:29.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"40'9","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987145+0000","last_change":"2024-09-10T20:40:57.797064+0000","last_active":"2024-09-10T20:41:23.987145+0000","last_peered":"2024-09-10T20:41:23.987145+0000","last_clean":"2024-09-10T20:41:23.987145+0000","last_became_active":"2024-09-10T20:40:57.796778+0000","last_became_peered":"2024-09-10T20:40:57.796778+0000","last_unstale":"2024-09-10T20:41:23.987145+0000","last_undegraded":"2024-09-10T20:41:23.987145+0000","last_fullsized":"2024-09-10T20:41:23.987145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:13.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024157+0000","last_change":"2024-09-10T20:40:56.781802+0000","last_active":"2024-09-10T20:41:25.024157+0000","last_peered":"2024-09-10T20:41:25.024157+0000","last_clean":"2024-09-10T20:41:25.024157+0000","last_became_active":"2024-09-10T20:40:56.781430+0000","last_became_peered":"2024-09-10T20:40:56.781430+0000","last_unstale":"2024-09-10T20:41:25.024157+0000","last_undegraded":"2024-09-10T20:41:25.024157+0000","last_fullsized":"2024-09-10T20:41:25.024157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:52.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002451+0000","last_change":"2024-09-10T20:41:23.999122+0000","last_active":"2024-09-10T20:41:25.002451+0000","last_peered":"2024-09-10T20:41:25.002451+0000","last_clean":"2024-09-10T20:41:25.002451+0000","last_became_active":"2024-09-10T20:41:23.996737+0000","last_became_peered":"2024-09-10T20:41:23.996737+0000","last_unstale":"2024-09-10T20:41:25.002451+0000","last_undegraded":"2024-09-10T20:41:25.002451+0000","last_fullsized":"2024-09-10T20:41:25.002451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:04.584893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267543+0000","last_change":"2024-09-10T20:40:57.797088+0000","last_active":"2024-09-10T20:41:25.267543+0000","last_peered":"2024-09-10T20:41:25.267543+0000","last_clean":"2024-09-10T20:41:25.267543+0000","last_became_active":"2024-09-10T20:40:57.796516+0000","last_became_peered":"2024-09-10T20:40:57.796516+0000","last_unstale":"2024-09-10T20:41:25.267543+0000","last_undegraded":"2024-09-10T20:41:25.267543+0000","last_fullsized":"2024-09-10T20:41:25.267543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:23.886368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"44'5","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987209+0000","last_change":"2024-09-10T20:40:56.792746+0000","last_active":"2024-09-10T20:41:23.987209+0000","last_peered":"2024-09-10T20:41:23.987209+0000","last_clean":"2024-09-10T20:41:23.987209+0000","last_became_active":"2024-09-10T20:40:56.792409+0000","last_became_peered":"2024-09-10T20:40:56.792409+0000","last_unstale":"2024-09-10T20:41:23.987209+0000","last_undegraded":"2024-09-10T20:41:23.987209+0000","last_fullsized":"2024-09-10T20:41:23.987209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:11.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024072+0000","last_change":"2024-09-10T20:41:24.001797+0000","last_active":"2024-09-10T20:41:25.024072+0000","last_peered":"2024-09-10T20:41:25.024072+0000","last_clean":"2024-09-10T20:41:25.024072+0000","last_became_active":"2024-09-10T20:41:24.001549+0000","last_became_peered":"2024-09-10T20:41:24.001549+0000","last_unstale":"2024-09-10T20:41:25.024072+0000","last_undegraded":"2024-09-10T20:41:25.024072+0000","last_fullsized":"2024-09-10T20:41:25.024072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:51.657538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972657+0000","last_change":"2024-09-10T20:40:57.780255+0000","last_active":"2024-09-10T20:41:22.972657+0000","last_peered":"2024-09-10T20:41:22.972657+0000","last_clean":"2024-09-10T20:41:22.972657+0000","last_became_active":"2024-09-10T20:40:57.779962+0000","last_became_peered":"2024-09-10T20:40:57.779962+0000","last_unstale":"2024-09-10T20:41:22.972657+0000","last_undegraded":"2024-09-10T20:41:22.972657+0000","last_fullsized":"2024-09-10T20:41:22.972657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:32.285607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986598+0000","last_change":"2024-09-10T20:40:56.800962+0000","last_active":"2024-09-10T20:41:23.986598+0000","last_peered":"2024-09-10T20:41:23.986598+0000","last_clean":"2024-09-10T20:41:23.986598+0000","last_became_active":"2024-09-10T20:40:56.800727+0000","last_became_peered":"2024-09-10T20:40:56.800727+0000","last_unstale":"2024-09-10T20:41:23.986598+0000","last_undegraded":"2024-09-10T20:41:23.986598+0000","last_fullsized":"2024-09-10T20:41:23.986598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:52.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.005439+0000","last_change":"2024-09-10T20:41:24.001291+0000","last_active":"2024-09-10T20:41:24.005439+0000","last_peered":"2024-09-10T20:41:24.005439+0000","last_clean":"2024-09-10T20:41:24.005439+0000","last_became_active":"2024-09-10T20:41:24.000871+0000","last_became_peered":"2024-09-10T20:41:24.000871+0000","last_unstale":"2024-09-10T20:41:24.005439+0000","last_undegraded":"2024-09-10T20:41:24.005439+0000","last_fullsized":"2024-09-10T20:41:24.005439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:45.607883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"40'8","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.984817+0000","last_change":"2024-09-10T20:40:57.793540+0000","last_active":"2024-09-10T20:41:23.984817+0000","last_peered":"2024-09-10T20:41:23.984817+0000","last_clean":"2024-09-10T20:41:23.984817+0000","last_became_active":"2024-09-10T20:40:57.793231+0000","last_became_peered":"2024-09-10T20:40:57.793231+0000","last_unstale":"2024-09-10T20:41:23.984817+0000","last_undegraded":"2024-09-10T20:41:23.984817+0000","last_fullsized":"2024-09-10T20:41:23.984817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:43.458885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001847+0000","last_change":"2024-09-10T20:40:56.795661+0000","last_active":"2024-09-10T20:41:25.001847+0000","last_peered":"2024-09-10T20:41:25.001847+0000","last_clean":"2024-09-10T20:41:25.001847+0000","last_became_active":"2024-09-10T20:40:56.794893+0000","last_became_peered":"2024-09-10T20:40:56.794893+0000","last_unstale":"2024-09-10T20:41:25.001847+0000","last_undegraded":"2024-09-10T20:41:25.001847+0000","last_fullsized":"2024-09-10T20:41:25.001847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:56.476490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001972+0000","last_change":"2024-09-10T20:41:23.999188+0000","last_active":"2024-09-10T20:41:25.001972+0000","last_peered":"2024-09-10T20:41:25.001972+0000","last_clean":"2024-09-10T20:41:25.001972+0000","last_became_active":"2024-09-10T20:41:23.998882+0000","last_became_peered":"2024-09-10T20:41:23.998882+0000","last_unstale":"2024-09-10T20:41:25.001972+0000","last_undegraded":"2024-09-10T20:41:25.001972+0000","last_fullsized":"2024-09-10T20:41:25.001972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:06.148067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295734+0000","last_change":"2024-09-10T20:40:57.777674+0000","last_active":"2024-09-10T20:41:25.295734+0000","last_peered":"2024-09-10T20:41:25.295734+0000","last_clean":"2024-09-10T20:41:25.295734+0000","last_became_active":"2024-09-10T20:40:57.776652+0000","last_became_peered":"2024-09-10T20:40:57.776652+0000","last_unstale":"2024-09-10T20:41:25.295734+0000","last_undegraded":"2024-09-10T20:41:25.295734+0000","last_fullsized":"2024-09-10T20:41:25.295734+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:22.672592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267291+0000","last_change":"2024-09-10T20:40:56.786260+0000","last_active":"2024-09-10T20:41:25.267291+0000","last_peered":"2024-09-10T20:41:25.267291+0000","last_clean":"2024-09-10T20:41:25.267291+0000","last_became_active":"2024-09-10T20:40:56.785702+0000","last_became_peered":"2024-09-10T20:40:56.785702+0000","last_unstale":"2024-09-10T20:41:25.267291+0000","last_undegraded":"2024-09-10T20:41:25.267291+0000","last_fullsized":"2024-09-10T20:41:25.267291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970409+0000","last_change":"2024-09-10T20:41:22.970409+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970409+0000","last_undegraded":"2024-09-10T20:41:22.970409+0000","last_fullsized":"2024-09-10T20:41:22.970409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023703+0000","last_change":"2024-09-10T20:40:57.793392+0000","last_active":"2024-09-10T20:41:25.023703+0000","last_peered":"2024-09-10T20:41:25.023703+0000","last_clean":"2024-09-10T20:41:25.023703+0000","last_became_active":"2024-09-10T20:40:57.793192+0000","last_became_peered":"2024-09-10T20:40:57.793192+0000","last_unstale":"2024-09-10T20:41:25.023703+0000","last_undegraded":"2024-09-10T20:41:25.023703+0000","last_fullsized":"2024-09-10T20:41:25.023703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:04.659598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023685+0000","last_change":"2024-09-10T20:40:56.781668+0000","last_active":"2024-09-10T20:41:25.023685+0000","last_peered":"2024-09-10T20:41:25.023685+0000","last_clean":"2024-09-10T20:41:25.023685+0000","last_became_active":"2024-09-10T20:40:56.781402+0000","last_became_peered":"2024-09-10T20:40:56.781402+0000","last_unstale":"2024-09-10T20:41:25.023685+0000","last_undegraded":"2024-09-10T20:41:25.023685+0000","last_fullsized":"2024-09-10T20:41:25.023685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:35.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001449+0000","last_change":"2024-09-10T20:41:24.002138+0000","last_active":"2024-09-10T20:41:25.001449+0000","last_peered":"2024-09-10T20:41:25.001449+0000","last_clean":"2024-09-10T20:41:25.001449+0000","last_became_active":"2024-09-10T20:41:24.001620+0000","last_became_peered":"2024-09-10T20:41:24.001620+0000","last_unstale":"2024-09-10T20:41:25.001449+0000","last_undegraded":"2024-09-10T20:41:25.001449+0000","last_fullsized":"2024-09-10T20:41:25.001449+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:13.979541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267202+0000","last_change":"2024-09-10T20:40:57.789700+0000","last_active":"2024-09-10T20:41:25.267202+0000","last_peered":"2024-09-10T20:41:25.267202+0000","last_clean":"2024-09-10T20:41:25.267202+0000","last_became_active":"2024-09-10T20:40:57.789433+0000","last_became_peered":"2024-09-10T20:40:57.789433+0000","last_unstale":"2024-09-10T20:41:25.267202+0000","last_undegraded":"2024-09-10T20:41:25.267202+0000","last_fullsized":"2024-09-10T20:41:25.267202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:28.800368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002615+0000","last_change":"2024-09-10T20:40:56.795619+0000","last_active":"2024-09-10T20:41:25.002615+0000","last_peered":"2024-09-10T20:41:25.002615+0000","last_clean":"2024-09-10T20:41:25.002615+0000","last_became_active":"2024-09-10T20:40:56.795292+0000","last_became_peered":"2024-09-10T20:40:56.795292+0000","last_unstale":"2024-09-10T20:41:25.002615+0000","last_undegraded":"2024-09-10T20:41:25.002615+0000","last_fullsized":"2024-09-10T20:41:25.002615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:09.500262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970028+0000","last_change":"2024-09-10T20:41:22.970028+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970028+0000","last_undegraded":"2024-09-10T20:41:22.970028+0000","last_fullsized":"2024-09-10T20:41:22.970028+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024030+0000","last_change":"2024-09-10T20:40:57.784029+0000","last_active":"2024-09-10T20:41:25.024030+0000","last_peered":"2024-09-10T20:41:25.024030+0000","last_clean":"2024-09-10T20:41:25.024030+0000","last_became_active":"2024-09-10T20:40:57.783716+0000","last_became_peered":"2024-09-10T20:40:57.783716+0000","last_unstale":"2024-09-10T20:41:25.024030+0000","last_undegraded":"2024-09-10T20:41:25.024030+0000","last_fullsized":"2024-09-10T20:41:25.024030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:31.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267214+0000","last_change":"2024-09-10T20:40:56.785344+0000","last_active":"2024-09-10T20:41:25.267214+0000","last_peered":"2024-09-10T20:41:25.267214+0000","last_clean":"2024-09-10T20:41:25.267214+0000","last_became_active":"2024-09-10T20:40:56.785096+0000","last_became_peered":"2024-09-10T20:40:56.785096+0000","last_unstale":"2024-09-10T20:41:25.267214+0000","last_undegraded":"2024-09-10T20:41:25.267214+0000","last_fullsized":"2024-09-10T20:41:25.267214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":159,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002333+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:25.002333+0000","last_peered":"2024-09-10T20:41:25.002333+0000","last_clean":"2024-09-10T20:41:25.002333+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:25.002333+0000","last_undegraded":"2024-09-10T20:41:25.002333+0000","last_fullsized":"2024-09-10T20:41:25.002333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":98,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6844416,"data_stored":6540388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1146880,"data_stored":839300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29616,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342224,"statfs":{"total":96636764160,"available":96606437376,"internally_reserved":0,"allocated":2650112,"data_stored":2346084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":5180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":5304320,"data_stored":5011475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:28.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.807+0000 7fde95200640 1 -- 172.21.15.81:0/872457561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde740040b0 msgr2=0x7fde74004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.807+0000 7fde95200640 1 --2- 172.21.15.81:0/872457561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde740040b0 0x7fde74004800 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fde7c006f90 tx=0x7fde74005830 comp rx=0 tx=0).stop 2024-09-10T20:41:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.807+0000 7fde8fe00640 1 -- 172.21.15.81:0/872457561 reap_dead start 2024-09-10T20:41:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.807+0000 7fde95200640 1 -- 172.21.15.81:0/872457561 shutdown_connections 2024-09-10T20:41:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.807+0000 7fde95200640 1 -- 172.21.15.81:0/872457561 >> 172.21.15.81:0/872457561 conn(0x7fde900d3cc0 msgr2=0x7fde900d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:28.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.807+0000 7fde95200640 1 -- 172.21.15.81:0/872457561 shutdown_connections 2024-09-10T20:41:28.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.807+0000 7fde95200640 1 -- 172.21.15.81:0/872457561 wait complete. 2024-09-10T20:41:28.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.809+0000 7fde95200640 1 Processor -- start 2024-09-10T20:41:28.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.809+0000 7fde95200640 1 -- start start 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde95200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde740040b0 0x7fde900b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde95200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde900b9390 0x7fde9015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde95200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde900cad90 0x7fde900cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde95200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde900b4740 con 0x7fde900b9390 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde95200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fde900b45c0 con 0x7fde900cad90 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde95200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fde900b48c0 con 0x7fde740040b0 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde900b9390 0x7fde9015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde900b9390 0x7fde9015af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41246/0 (socket says 172.21.15.81:41246) 2024-09-10T20:41:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 -- 172.21.15.81:0/1461255168 learned_addr learned my addr 172.21.15.81:0/1461255168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:28.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 -- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde740040b0 msgr2=0x7fde900b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8f400640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde740040b0 0x7fde900b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8fe00640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde900cad90 0x7fde900cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde740040b0 0x7fde900b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 -- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde900cad90 msgr2=0x7fde900cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde900cad90 0x7fde900cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8ea00640 1 -- 172.21.15.81:0/1461255168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde900b98c0 con 0x7fde900b9390 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8fe00640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde900cad90 0x7fde900cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.810+0000 7fde8f400640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde740040b0 0x7fde900b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.811+0000 7fde8ea00640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde900b9390 0x7fde9015af30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fde7c02b0a0 tx=0x7fde7c0064a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.811+0000 7fde87400640 1 -- 172.21.15.81:0/1461255168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c032030 con 0x7fde900b9390 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.811+0000 7fde87400640 1 -- 172.21.15.81:0/1461255168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde7c003af0 con 0x7fde900b9390 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.811+0000 7fde87400640 1 -- 172.21.15.81:0/1461255168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c02e480 con 0x7fde900b9390 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.811+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde900b76a0 con 0x7fde900b9390 2024-09-10T20:41:28.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.811+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9015b850 con 0x7fde900b9390 2024-09-10T20:41:28.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.812+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde900b74d0 con 0x7fde900b9390 2024-09-10T20:41:28.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.813+0000 7fde87400640 1 -- 172.21.15.81:0/1461255168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fde7c02e620 con 0x7fde900b9390 2024-09-10T20:41:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.814+0000 7fde87400640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fde70077f70 0x7fde7007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.814+0000 7fde87400640 1 -- 172.21.15.81:0/1461255168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7fde7c0ba8b0 con 0x7fde900b9390 2024-09-10T20:41:28.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.814+0000 7fde8f400640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fde70077f70 0x7fde7007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:28.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.815+0000 7fde8f400640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fde70077f70 0x7fde7007a430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde80009bc0 tx=0x7fde80005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:28.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.818+0000 7fde87400640 1 -- 172.21.15.81:0/1461255168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fde7c047030 con 0x7fde900b9390 2024-09-10T20:41:29.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:28.999+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde900d47e0 con 0x7fde70077f70 2024-09-10T20:41:29.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.005+0000 7fde87400640 1 -- 172.21.15.81:0/1461255168 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332032 (secure 0 0 0) 0x7fde900d47e0 con 0x7fde70077f70 2024-09-10T20:41:29.013 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:29.015 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fde70077f70 msgr2=0x7fde7007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fde70077f70 0x7fde7007a430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde80009bc0 tx=0x7fde80005f90 comp rx=0 tx=0).stop 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde900b9390 msgr2=0x7fde9015af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde900b9390 0x7fde9015af30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fde7c02b0a0 tx=0x7fde7c0064a0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 shutdown_connections 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fde70077f70 0x7fde7007a430 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde900cad90 0x7fde900cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde900b9390 0x7fde9015af30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 --2- 172.21.15.81:0/1461255168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde740040b0 0x7fde900b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 >> 172.21.15.81:0/1461255168 conn(0x7fde900d3cc0 msgr2=0x7fde9006d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:29.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 shutdown_connections 2024-09-10T20:41:29.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.009+0000 7fde95200640 1 -- 172.21.15.81:0/1461255168 wait complete. 2024-09-10T20:41:29.030 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-10T20:41:27.868584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":203,"num_write_kb":7813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661,"ondisk_log_size":661,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233960,"kb_used_data":17708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740760,"statfs":{"total":773094113280,"available":772854538240,"internally_reserved":0,"allocated":18132992,"data_stored":15718463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.904965"},"pg_stats":[{"pgid":"6.3f","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002280+0000","last_change":"2024-09-10T20:40:57.808566+0000","last_active":"2024-09-10T20:41:25.002280+0000","last_peered":"2024-09-10T20:41:25.002280+0000","last_clean":"2024-09-10T20:41:25.002280+0000","last_became_active":"2024-09-10T20:40:57.808299+0000","last_became_peered":"2024-09-10T20:40:57.808299+0000","last_unstale":"2024-09-10T20:41:25.002280+0000","last_undegraded":"2024-09-10T20:41:25.002280+0000","last_fullsized":"2024-09-10T20:41:25.002280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:11.202752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.785246+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.784969+0000","last_became_peered":"2024-09-10T20:40:57.784969+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:26.513133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002056+0000","last_change":"2024-09-10T20:40:57.798413+0000","last_active":"2024-09-10T20:41:25.002056+0000","last_peered":"2024-09-10T20:41:25.002056+0000","last_clean":"2024-09-10T20:41:25.002056+0000","last_became_active":"2024-09-10T20:40:57.798085+0000","last_became_peered":"2024-09-10T20:40:57.798085+0000","last_unstale":"2024-09-10T20:41:25.002056+0000","last_undegraded":"2024-09-10T20:41:25.002056+0000","last_fullsized":"2024-09-10T20:41:25.002056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:33.904500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002674+0000","last_change":"2024-09-10T20:40:57.793918+0000","last_active":"2024-09-10T20:41:25.002674+0000","last_peered":"2024-09-10T20:41:25.002674+0000","last_clean":"2024-09-10T20:41:25.002674+0000","last_became_active":"2024-09-10T20:40:57.793335+0000","last_became_peered":"2024-09-10T20:40:57.793335+0000","last_unstale":"2024-09-10T20:41:25.002674+0000","last_undegraded":"2024-09-10T20:41:25.002674+0000","last_fullsized":"2024-09-10T20:41:25.002674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:12.740619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"40'4","reported_seq":30,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985310+0000","last_change":"2024-09-10T20:40:57.802056+0000","last_active":"2024-09-10T20:41:23.985310+0000","last_peered":"2024-09-10T20:41:23.985310+0000","last_clean":"2024-09-10T20:41:23.985310+0000","last_became_active":"2024-09-10T20:40:57.801252+0000","last_became_peered":"2024-09-10T20:40:57.801252+0000","last_unstale":"2024-09-10T20:41:23.985310+0000","last_undegraded":"2024-09-10T20:41:23.985310+0000","last_fullsized":"2024-09-10T20:41:23.985310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:43.552747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295818+0000","last_change":"2024-09-10T20:40:57.781646+0000","last_active":"2024-09-10T20:41:25.295818+0000","last_peered":"2024-09-10T20:41:25.295818+0000","last_clean":"2024-09-10T20:41:25.295818+0000","last_became_active":"2024-09-10T20:40:57.781350+0000","last_became_peered":"2024-09-10T20:40:57.781350+0000","last_unstale":"2024-09-10T20:41:25.295818+0000","last_undegraded":"2024-09-10T20:41:25.295818+0000","last_fullsized":"2024-09-10T20:41:25.295818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.959912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001962+0000","last_change":"2024-09-10T20:40:57.797129+0000","last_active":"2024-09-10T20:41:25.001962+0000","last_peered":"2024-09-10T20:41:25.001962+0000","last_clean":"2024-09-10T20:41:25.001962+0000","last_became_active":"2024-09-10T20:40:57.796854+0000","last_became_peered":"2024-09-10T20:40:57.796854+0000","last_unstale":"2024-09-10T20:41:25.001962+0000","last_undegraded":"2024-09-10T20:41:25.001962+0000","last_fullsized":"2024-09-10T20:41:25.001962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:43.327598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001457+0000","last_change":"2024-09-10T20:40:57.808609+0000","last_active":"2024-09-10T20:41:25.001457+0000","last_peered":"2024-09-10T20:41:25.001457+0000","last_clean":"2024-09-10T20:41:25.001457+0000","last_became_active":"2024-09-10T20:40:57.807999+0000","last_became_peered":"2024-09-10T20:40:57.807999+0000","last_unstale":"2024-09-10T20:41:25.001457+0000","last_undegraded":"2024-09-10T20:41:25.001457+0000","last_fullsized":"2024-09-10T20:41:25.001457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"40'11","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987894+0000","last_change":"2024-09-10T20:40:57.802618+0000","last_active":"2024-09-10T20:41:23.987894+0000","last_peered":"2024-09-10T20:41:23.987894+0000","last_clean":"2024-09-10T20:41:23.987894+0000","last_became_active":"2024-09-10T20:40:57.801991+0000","last_became_peered":"2024-09-10T20:40:57.801991+0000","last_unstale":"2024-09-10T20:41:23.987894+0000","last_undegraded":"2024-09-10T20:41:23.987894+0000","last_fullsized":"2024-09-10T20:41:23.987894+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:57.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002527+0000","last_change":"2024-09-10T20:40:57.805178+0000","last_active":"2024-09-10T20:41:25.002527+0000","last_peered":"2024-09-10T20:41:25.002527+0000","last_clean":"2024-09-10T20:41:25.002527+0000","last_became_active":"2024-09-10T20:40:57.804919+0000","last_became_peered":"2024-09-10T20:40:57.804919+0000","last_unstale":"2024-09-10T20:41:25.002527+0000","last_undegraded":"2024-09-10T20:41:25.002527+0000","last_fullsized":"2024-09-10T20:41:25.002527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:34.267791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267431+0000","last_change":"2024-09-10T20:40:57.797147+0000","last_active":"2024-09-10T20:41:25.267431+0000","last_peered":"2024-09-10T20:41:25.267431+0000","last_clean":"2024-09-10T20:41:25.267431+0000","last_became_active":"2024-09-10T20:40:57.796910+0000","last_became_peered":"2024-09-10T20:40:57.796910+0000","last_unstale":"2024-09-10T20:41:25.267431+0000","last_undegraded":"2024-09-10T20:41:25.267431+0000","last_fullsized":"2024-09-10T20:41:25.267431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:43.015903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"40'7","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986521+0000","last_change":"2024-09-10T20:40:57.804510+0000","last_active":"2024-09-10T20:41:23.986521+0000","last_peered":"2024-09-10T20:41:23.986521+0000","last_clean":"2024-09-10T20:41:23.986521+0000","last_became_active":"2024-09-10T20:40:57.804220+0000","last_became_peered":"2024-09-10T20:40:57.804220+0000","last_unstale":"2024-09-10T20:41:23.986521+0000","last_undegraded":"2024-09-10T20:41:23.986521+0000","last_fullsized":"2024-09-10T20:41:23.986521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:55.727449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002169+0000","last_change":"2024-09-10T20:40:57.795473+0000","last_active":"2024-09-10T20:41:25.002169+0000","last_peered":"2024-09-10T20:41:25.002169+0000","last_clean":"2024-09-10T20:41:25.002169+0000","last_became_active":"2024-09-10T20:40:57.795179+0000","last_became_peered":"2024-09-10T20:40:57.795179+0000","last_unstale":"2024-09-10T20:41:25.002169+0000","last_undegraded":"2024-09-10T20:41:25.002169+0000","last_fullsized":"2024-09-10T20:41:25.002169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"40'8","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991972+0000","last_change":"2024-09-10T20:40:57.801649+0000","last_active":"2024-09-10T20:41:23.991972+0000","last_peered":"2024-09-10T20:41:23.991972+0000","last_clean":"2024-09-10T20:41:23.991972+0000","last_became_active":"2024-09-10T20:40:57.797096+0000","last_became_peered":"2024-09-10T20:40:57.797096+0000","last_unstale":"2024-09-10T20:41:23.991972+0000","last_undegraded":"2024-09-10T20:41:23.991972+0000","last_fullsized":"2024-09-10T20:41:23.991972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:05.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023428+0000","last_change":"2024-09-10T20:40:57.779842+0000","last_active":"2024-09-10T20:41:25.023428+0000","last_peered":"2024-09-10T20:41:25.023428+0000","last_clean":"2024-09-10T20:41:25.023428+0000","last_became_active":"2024-09-10T20:40:57.779564+0000","last_became_peered":"2024-09-10T20:40:57.779564+0000","last_unstale":"2024-09-10T20:41:25.023428+0000","last_undegraded":"2024-09-10T20:41:25.023428+0000","last_fullsized":"2024-09-10T20:41:25.023428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:23.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001997+0000","last_change":"2024-09-10T20:40:57.806288+0000","last_active":"2024-09-10T20:41:25.001997+0000","last_peered":"2024-09-10T20:41:25.001997+0000","last_clean":"2024-09-10T20:41:25.001997+0000","last_became_active":"2024-09-10T20:40:57.804491+0000","last_became_peered":"2024-09-10T20:40:57.804491+0000","last_unstale":"2024-09-10T20:41:25.001997+0000","last_undegraded":"2024-09-10T20:41:25.001997+0000","last_fullsized":"2024-09-10T20:41:25.001997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:18.810090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024138+0000","last_change":"2024-09-10T20:40:57.781946+0000","last_active":"2024-09-10T20:41:25.024138+0000","last_peered":"2024-09-10T20:41:25.024138+0000","last_clean":"2024-09-10T20:41:25.024138+0000","last_became_active":"2024-09-10T20:40:57.781711+0000","last_became_peered":"2024-09-10T20:40:57.781711+0000","last_unstale":"2024-09-10T20:41:25.024138+0000","last_undegraded":"2024-09-10T20:41:25.024138+0000","last_fullsized":"2024-09-10T20:41:25.024138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:57.437327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023982+0000","last_change":"2024-09-10T20:40:57.781131+0000","last_active":"2024-09-10T20:41:25.023982+0000","last_peered":"2024-09-10T20:41:25.023982+0000","last_clean":"2024-09-10T20:41:25.023982+0000","last_became_active":"2024-09-10T20:40:57.780857+0000","last_became_peered":"2024-09-10T20:40:57.780857+0000","last_unstale":"2024-09-10T20:41:25.023982+0000","last_undegraded":"2024-09-10T20:41:25.023982+0000","last_fullsized":"2024-09-10T20:41:25.023982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:18.298699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972503+0000","last_change":"2024-09-10T20:40:57.799870+0000","last_active":"2024-09-10T20:41:22.972503+0000","last_peered":"2024-09-10T20:41:22.972503+0000","last_clean":"2024-09-10T20:41:22.972503+0000","last_became_active":"2024-09-10T20:40:57.799593+0000","last_became_peered":"2024-09-10T20:40:57.799593+0000","last_unstale":"2024-09-10T20:41:22.972503+0000","last_undegraded":"2024-09-10T20:41:22.972503+0000","last_fullsized":"2024-09-10T20:41:22.972503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:27.031641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267232+0000","last_change":"2024-09-10T20:40:57.788576+0000","last_active":"2024-09-10T20:41:25.267232+0000","last_peered":"2024-09-10T20:41:25.267232+0000","last_clean":"2024-09-10T20:41:25.267232+0000","last_became_active":"2024-09-10T20:40:57.788342+0000","last_became_peered":"2024-09-10T20:40:57.788342+0000","last_unstale":"2024-09-10T20:41:25.267232+0000","last_undegraded":"2024-09-10T20:41:25.267232+0000","last_fullsized":"2024-09-10T20:41:25.267232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:56.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"40'11","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267138+0000","last_change":"2024-09-10T20:40:57.797333+0000","last_active":"2024-09-10T20:41:25.267138+0000","last_peered":"2024-09-10T20:41:25.267138+0000","last_clean":"2024-09-10T20:41:25.267138+0000","last_became_active":"2024-09-10T20:40:57.794482+0000","last_became_peered":"2024-09-10T20:40:57.794482+0000","last_unstale":"2024-09-10T20:41:25.267138+0000","last_undegraded":"2024-09-10T20:41:25.267138+0000","last_fullsized":"2024-09-10T20:41:25.267138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:33.113187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267051+0000","last_change":"2024-09-10T20:40:57.785890+0000","last_active":"2024-09-10T20:41:25.267051+0000","last_peered":"2024-09-10T20:41:25.267051+0000","last_clean":"2024-09-10T20:41:25.267051+0000","last_became_active":"2024-09-10T20:40:57.785582+0000","last_became_peered":"2024-09-10T20:40:57.785582+0000","last_unstale":"2024-09-10T20:41:25.267051+0000","last_undegraded":"2024-09-10T20:41:25.267051+0000","last_fullsized":"2024-09-10T20:41:25.267051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:51.491322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023468+0000","last_change":"2024-09-10T20:40:57.786174+0000","last_active":"2024-09-10T20:41:25.023468+0000","last_peered":"2024-09-10T20:41:25.023468+0000","last_clean":"2024-09-10T20:41:25.023468+0000","last_became_active":"2024-09-10T20:40:57.785175+0000","last_became_peered":"2024-09-10T20:40:57.785175+0000","last_unstale":"2024-09-10T20:41:25.023468+0000","last_undegraded":"2024-09-10T20:41:25.023468+0000","last_fullsized":"2024-09-10T20:41:25.023468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:23.271959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001563+0000","last_change":"2024-09-10T20:40:57.808222+0000","last_active":"2024-09-10T20:41:25.001563+0000","last_peered":"2024-09-10T20:41:25.001563+0000","last_clean":"2024-09-10T20:41:25.001563+0000","last_became_active":"2024-09-10T20:40:57.807578+0000","last_became_peered":"2024-09-10T20:40:57.807578+0000","last_unstale":"2024-09-10T20:41:25.001563+0000","last_undegraded":"2024-09-10T20:41:25.001563+0000","last_fullsized":"2024-09-10T20:41:25.001563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:25.893234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"40'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995400+0000","last_change":"2024-09-10T20:40:57.803089+0000","last_active":"2024-09-10T20:41:23.995400+0000","last_peered":"2024-09-10T20:41:23.995400+0000","last_clean":"2024-09-10T20:41:23.995400+0000","last_became_active":"2024-09-10T20:40:57.802606+0000","last_became_peered":"2024-09-10T20:40:57.802606+0000","last_unstale":"2024-09-10T20:41:23.995400+0000","last_undegraded":"2024-09-10T20:41:23.995400+0000","last_fullsized":"2024-09-10T20:41:23.995400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002118+0000","last_change":"2024-09-10T20:40:57.804633+0000","last_active":"2024-09-10T20:41:25.002118+0000","last_peered":"2024-09-10T20:41:25.002118+0000","last_clean":"2024-09-10T20:41:25.002118+0000","last_became_active":"2024-09-10T20:40:57.804388+0000","last_became_peered":"2024-09-10T20:40:57.804388+0000","last_unstale":"2024-09-10T20:41:25.002118+0000","last_undegraded":"2024-09-10T20:41:25.002118+0000","last_fullsized":"2024-09-10T20:41:25.002118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:17.686400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267480+0000","last_change":"2024-09-10T20:40:57.790304+0000","last_active":"2024-09-10T20:41:25.267480+0000","last_peered":"2024-09-10T20:41:25.267480+0000","last_clean":"2024-09-10T20:41:25.267480+0000","last_became_active":"2024-09-10T20:40:57.790064+0000","last_became_peered":"2024-09-10T20:40:57.790064+0000","last_unstale":"2024-09-10T20:41:25.267480+0000","last_undegraded":"2024-09-10T20:41:25.267480+0000","last_fullsized":"2024-09-10T20:41:25.267480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:03.995020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002320+0000","last_change":"2024-09-10T20:40:57.811854+0000","last_active":"2024-09-10T20:41:25.002320+0000","last_peered":"2024-09-10T20:41:25.002320+0000","last_clean":"2024-09-10T20:41:25.002320+0000","last_became_active":"2024-09-10T20:40:57.811532+0000","last_became_peered":"2024-09-10T20:40:57.811532+0000","last_unstale":"2024-09-10T20:41:25.002320+0000","last_undegraded":"2024-09-10T20:41:25.002320+0000","last_fullsized":"2024-09-10T20:41:25.002320+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:39.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023478+0000","last_change":"2024-09-10T20:40:57.783995+0000","last_active":"2024-09-10T20:41:25.023478+0000","last_peered":"2024-09-10T20:41:25.023478+0000","last_clean":"2024-09-10T20:41:25.023478+0000","last_became_active":"2024-09-10T20:40:57.782195+0000","last_became_peered":"2024-09-10T20:40:57.782195+0000","last_unstale":"2024-09-10T20:41:25.023478+0000","last_undegraded":"2024-09-10T20:41:25.023478+0000","last_fullsized":"2024-09-10T20:41:25.023478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:53.576166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023603+0000","last_change":"2024-09-10T20:40:57.778945+0000","last_active":"2024-09-10T20:41:25.023603+0000","last_peered":"2024-09-10T20:41:25.023603+0000","last_clean":"2024-09-10T20:41:25.023603+0000","last_became_active":"2024-09-10T20:40:57.778659+0000","last_became_peered":"2024-09-10T20:40:57.778659+0000","last_unstale":"2024-09-10T20:41:25.023603+0000","last_undegraded":"2024-09-10T20:41:25.023603+0000","last_fullsized":"2024-09-10T20:41:25.023603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:42.767732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"40'12","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002065+0000","last_change":"2024-09-10T20:40:57.796477+0000","last_active":"2024-09-10T20:41:25.002065+0000","last_peered":"2024-09-10T20:41:25.002065+0000","last_clean":"2024-09-10T20:41:25.002065+0000","last_became_active":"2024-09-10T20:40:57.796191+0000","last_became_peered":"2024-09-10T20:40:57.796191+0000","last_unstale":"2024-09-10T20:41:25.002065+0000","last_undegraded":"2024-09-10T20:41:25.002065+0000","last_fullsized":"2024-09-10T20:41:25.002065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:00.682250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001687+0000","last_change":"2024-09-10T20:40:57.813103+0000","last_active":"2024-09-10T20:41:25.001687+0000","last_peered":"2024-09-10T20:41:25.001687+0000","last_clean":"2024-09-10T20:41:25.001687+0000","last_became_active":"2024-09-10T20:40:57.812863+0000","last_became_peered":"2024-09-10T20:40:57.812863+0000","last_unstale":"2024-09-10T20:41:25.001687+0000","last_undegraded":"2024-09-10T20:41:25.001687+0000","last_fullsized":"2024-09-10T20:41:25.001687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:03.255660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969555+0000","last_change":"2024-09-10T20:41:22.969555+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969555+0000","last_undegraded":"2024-09-10T20:41:22.969555+0000","last_fullsized":"2024-09-10T20:41:22.969555+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023852+0000","last_change":"2024-09-10T20:40:57.806845+0000","last_active":"2024-09-10T20:41:25.023852+0000","last_peered":"2024-09-10T20:41:25.023852+0000","last_clean":"2024-09-10T20:41:25.023852+0000","last_became_active":"2024-09-10T20:40:57.806562+0000","last_became_peered":"2024-09-10T20:40:57.806562+0000","last_unstale":"2024-09-10T20:41:25.023852+0000","last_undegraded":"2024-09-10T20:41:25.023852+0000","last_fullsized":"2024-09-10T20:41:25.023852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:32.177438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"44'8","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995550+0000","last_change":"2024-09-10T20:40:56.787360+0000","last_active":"2024-09-10T20:41:23.995550+0000","last_peered":"2024-09-10T20:41:23.995550+0000","last_clean":"2024-09-10T20:41:23.995550+0000","last_became_active":"2024-09-10T20:40:56.787113+0000","last_became_peered":"2024-09-10T20:40:56.787113+0000","last_unstale":"2024-09-10T20:41:23.995550+0000","last_undegraded":"2024-09-10T20:41:23.995550+0000","last_fullsized":"2024-09-10T20:41:23.995550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.999843+0000","last_change":"2024-09-10T20:41:23.997577+0000","last_active":"2024-09-10T20:41:23.999843+0000","last_peered":"2024-09-10T20:41:23.999843+0000","last_clean":"2024-09-10T20:41:23.999843+0000","last_became_active":"2024-09-10T20:41:23.997315+0000","last_became_peered":"2024-09-10T20:41:23.997315+0000","last_unstale":"2024-09-10T20:41:23.999843+0000","last_undegraded":"2024-09-10T20:41:23.999843+0000","last_fullsized":"2024-09-10T20:41:23.999843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:49.348851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296022+0000","last_change":"2024-09-10T20:40:57.794642+0000","last_active":"2024-09-10T20:41:25.296022+0000","last_peered":"2024-09-10T20:41:25.296022+0000","last_clean":"2024-09-10T20:41:25.296022+0000","last_became_active":"2024-09-10T20:40:57.794432+0000","last_became_peered":"2024-09-10T20:40:57.794432+0000","last_unstale":"2024-09-10T20:41:25.296022+0000","last_undegraded":"2024-09-10T20:41:25.296022+0000","last_fullsized":"2024-09-10T20:41:25.296022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:59.893364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296194+0000","last_change":"2024-09-10T20:40:56.790001+0000","last_active":"2024-09-10T20:41:25.296194+0000","last_peered":"2024-09-10T20:41:25.296194+0000","last_clean":"2024-09-10T20:41:25.296194+0000","last_became_active":"2024-09-10T20:40:56.789708+0000","last_became_peered":"2024-09-10T20:40:56.789708+0000","last_unstale":"2024-09-10T20:41:25.296194+0000","last_undegraded":"2024-09-10T20:41:25.296194+0000","last_fullsized":"2024-09-10T20:41:25.296194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:56.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267602+0000","last_change":"2024-09-10T20:41:24.001301+0000","last_active":"2024-09-10T20:41:25.267602+0000","last_peered":"2024-09-10T20:41:25.267602+0000","last_clean":"2024-09-10T20:41:25.267602+0000","last_became_active":"2024-09-10T20:41:24.000986+0000","last_became_peered":"2024-09-10T20:41:24.000986+0000","last_unstale":"2024-09-10T20:41:25.267602+0000","last_undegraded":"2024-09-10T20:41:25.267602+0000","last_fullsized":"2024-09-10T20:41:25.267602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:45.971209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024106+0000","last_change":"2024-09-10T20:40:57.804223+0000","last_active":"2024-09-10T20:41:25.024106+0000","last_peered":"2024-09-10T20:41:25.024106+0000","last_clean":"2024-09-10T20:41:25.024106+0000","last_became_active":"2024-09-10T20:40:57.800934+0000","last_became_peered":"2024-09-10T20:40:57.800934+0000","last_unstale":"2024-09-10T20:41:25.024106+0000","last_undegraded":"2024-09-10T20:41:25.024106+0000","last_fullsized":"2024-09-10T20:41:25.024106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:43.140106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"44'3","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002486+0000","last_change":"2024-09-10T20:40:56.798617+0000","last_active":"2024-09-10T20:41:25.002486+0000","last_peered":"2024-09-10T20:41:25.002486+0000","last_clean":"2024-09-10T20:41:25.002486+0000","last_became_active":"2024-09-10T20:40:56.798233+0000","last_became_peered":"2024-09-10T20:40:56.798233+0000","last_unstale":"2024-09-10T20:41:25.002486+0000","last_undegraded":"2024-09-10T20:41:25.002486+0000","last_fullsized":"2024-09-10T20:41:25.002486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:55.548605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003712+0000","last_change":"2024-09-10T20:41:23.999098+0000","last_active":"2024-09-10T20:41:24.003712+0000","last_peered":"2024-09-10T20:41:24.003712+0000","last_clean":"2024-09-10T20:41:24.003712+0000","last_became_active":"2024-09-10T20:41:23.998720+0000","last_became_peered":"2024-09-10T20:41:23.998720+0000","last_unstale":"2024-09-10T20:41:24.003712+0000","last_undegraded":"2024-09-10T20:41:24.003712+0000","last_fullsized":"2024-09-10T20:41:24.003712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:31.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296273+0000","last_change":"2024-09-10T20:40:57.790493+0000","last_active":"2024-09-10T20:41:25.296273+0000","last_peered":"2024-09-10T20:41:25.296273+0000","last_clean":"2024-09-10T20:41:25.296273+0000","last_became_active":"2024-09-10T20:40:57.789768+0000","last_became_peered":"2024-09-10T20:40:57.789768+0000","last_unstale":"2024-09-10T20:41:25.296273+0000","last_undegraded":"2024-09-10T20:41:25.296273+0000","last_fullsized":"2024-09-10T20:41:25.296273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.004069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"44'3","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995056+0000","last_change":"2024-09-10T20:40:56.798645+0000","last_active":"2024-09-10T20:41:23.995056+0000","last_peered":"2024-09-10T20:41:23.995056+0000","last_clean":"2024-09-10T20:41:23.995056+0000","last_became_active":"2024-09-10T20:40:56.798325+0000","last_became_peered":"2024-09-10T20:40:56.798325+0000","last_unstale":"2024-09-10T20:41:23.995056+0000","last_undegraded":"2024-09-10T20:41:23.995056+0000","last_fullsized":"2024-09-10T20:41:23.995056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:18.678416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023770+0000","last_change":"2024-09-10T20:41:23.999199+0000","last_active":"2024-09-10T20:41:25.023770+0000","last_peered":"2024-09-10T20:41:25.023770+0000","last_clean":"2024-09-10T20:41:25.023770+0000","last_became_active":"2024-09-10T20:41:23.998893+0000","last_became_peered":"2024-09-10T20:41:23.998893+0000","last_unstale":"2024-09-10T20:41:25.023770+0000","last_undegraded":"2024-09-10T20:41:25.023770+0000","last_fullsized":"2024-09-10T20:41:25.023770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.712353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001816+0000","last_change":"2024-09-10T20:40:57.792035+0000","last_active":"2024-09-10T20:41:25.001816+0000","last_peered":"2024-09-10T20:41:25.001816+0000","last_clean":"2024-09-10T20:41:25.001816+0000","last_became_active":"2024-09-10T20:40:57.791743+0000","last_became_peered":"2024-09-10T20:40:57.791743+0000","last_unstale":"2024-09-10T20:41:25.001816+0000","last_undegraded":"2024-09-10T20:41:25.001816+0000","last_fullsized":"2024-09-10T20:41:25.001816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:35.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995191+0000","last_change":"2024-09-10T20:40:56.778488+0000","last_active":"2024-09-10T20:41:23.995191+0000","last_peered":"2024-09-10T20:41:23.995191+0000","last_clean":"2024-09-10T20:41:23.995191+0000","last_became_active":"2024-09-10T20:40:56.778241+0000","last_became_peered":"2024-09-10T20:40:56.778241+0000","last_unstale":"2024-09-10T20:41:23.995191+0000","last_undegraded":"2024-09-10T20:41:23.995191+0000","last_fullsized":"2024-09-10T20:41:23.995191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002542+0000","last_change":"2024-09-10T20:41:23.996850+0000","last_active":"2024-09-10T20:41:25.002542+0000","last_peered":"2024-09-10T20:41:25.002542+0000","last_clean":"2024-09-10T20:41:25.002542+0000","last_became_active":"2024-09-10T20:41:23.996537+0000","last_became_peered":"2024-09-10T20:41:23.996537+0000","last_unstale":"2024-09-10T20:41:25.002542+0000","last_undegraded":"2024-09-10T20:41:25.002542+0000","last_fullsized":"2024-09-10T20:41:25.002542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:09.881621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267021+0000","last_change":"2024-09-10T20:40:57.787640+0000","last_active":"2024-09-10T20:41:25.267021+0000","last_peered":"2024-09-10T20:41:25.267021+0000","last_clean":"2024-09-10T20:41:25.267021+0000","last_became_active":"2024-09-10T20:40:57.787374+0000","last_became_peered":"2024-09-10T20:40:57.787374+0000","last_unstale":"2024-09-10T20:41:25.267021+0000","last_undegraded":"2024-09-10T20:41:25.267021+0000","last_fullsized":"2024-09-10T20:41:25.267021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.579080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002354+0000","last_change":"2024-09-10T20:40:56.799544+0000","last_active":"2024-09-10T20:41:25.002354+0000","last_peered":"2024-09-10T20:41:25.002354+0000","last_clean":"2024-09-10T20:41:25.002354+0000","last_became_active":"2024-09-10T20:40:56.799273+0000","last_became_peered":"2024-09-10T20:40:56.799273+0000","last_unstale":"2024-09-10T20:41:25.002354+0000","last_undegraded":"2024-09-10T20:41:25.002354+0000","last_fullsized":"2024-09-10T20:41:25.002354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:24.776937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001061+0000","last_change":"2024-09-10T20:41:24.000751+0000","last_active":"2024-09-10T20:41:25.001061+0000","last_peered":"2024-09-10T20:41:25.001061+0000","last_clean":"2024-09-10T20:41:25.001061+0000","last_became_active":"2024-09-10T20:41:24.000476+0000","last_became_peered":"2024-09-10T20:41:24.000476+0000","last_unstale":"2024-09-10T20:41:25.001061+0000","last_undegraded":"2024-09-10T20:41:25.001061+0000","last_fullsized":"2024-09-10T20:41:25.001061+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:50.959302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023652+0000","last_change":"2024-09-10T20:40:57.790412+0000","last_active":"2024-09-10T20:41:25.023652+0000","last_peered":"2024-09-10T20:41:25.023652+0000","last_clean":"2024-09-10T20:41:25.023652+0000","last_became_active":"2024-09-10T20:40:57.788308+0000","last_became_peered":"2024-09-10T20:40:57.788308+0000","last_unstale":"2024-09-10T20:41:25.023652+0000","last_undegraded":"2024-09-10T20:41:25.023652+0000","last_fullsized":"2024-09-10T20:41:25.023652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.492132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001391+0000","last_change":"2024-09-10T20:40:56.795211+0000","last_active":"2024-09-10T20:41:25.001391+0000","last_peered":"2024-09-10T20:41:25.001391+0000","last_clean":"2024-09-10T20:41:25.001391+0000","last_became_active":"2024-09-10T20:40:56.794869+0000","last_became_peered":"2024-09-10T20:40:56.794869+0000","last_unstale":"2024-09-10T20:41:25.001391+0000","last_undegraded":"2024-09-10T20:41:25.001391+0000","last_fullsized":"2024-09-10T20:41:25.001391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:54.724711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023595+0000","last_change":"2024-09-10T20:41:23.992976+0000","last_active":"2024-09-10T20:41:25.023595+0000","last_peered":"2024-09-10T20:41:25.023595+0000","last_clean":"2024-09-10T20:41:25.023595+0000","last_became_active":"2024-09-10T20:41:23.992286+0000","last_became_peered":"2024-09-10T20:41:23.992286+0000","last_unstale":"2024-09-10T20:41:25.023595+0000","last_undegraded":"2024-09-10T20:41:25.023595+0000","last_fullsized":"2024-09-10T20:41:25.023595+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:38.417982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.799569+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.799219+0000","last_became_peered":"2024-09-10T20:40:57.799219+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:29.475021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002246+0000","last_change":"2024-09-10T20:40:56.779639+0000","last_active":"2024-09-10T20:41:25.002246+0000","last_peered":"2024-09-10T20:41:25.002246+0000","last_clean":"2024-09-10T20:41:25.002246+0000","last_became_active":"2024-09-10T20:40:56.779311+0000","last_became_peered":"2024-09-10T20:40:56.779311+0000","last_unstale":"2024-09-10T20:41:25.002246+0000","last_undegraded":"2024-09-10T20:41:25.002246+0000","last_fullsized":"2024-09-10T20:41:25.002246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:39.771929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023992+0000","last_change":"2024-09-10T20:41:24.003499+0000","last_active":"2024-09-10T20:41:25.023992+0000","last_peered":"2024-09-10T20:41:25.023992+0000","last_clean":"2024-09-10T20:41:25.023992+0000","last_became_active":"2024-09-10T20:41:24.003230+0000","last_became_peered":"2024-09-10T20:41:24.003230+0000","last_unstale":"2024-09-10T20:41:25.023992+0000","last_undegraded":"2024-09-10T20:41:25.023992+0000","last_fullsized":"2024-09-10T20:41:25.023992+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:49.321950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'11","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002775+0000","last_change":"2024-09-10T20:40:57.793647+0000","last_active":"2024-09-10T20:41:25.002775+0000","last_peered":"2024-09-10T20:41:25.002775+0000","last_clean":"2024-09-10T20:41:25.002775+0000","last_became_active":"2024-09-10T20:40:57.792950+0000","last_became_peered":"2024-09-10T20:40:57.792950+0000","last_unstale":"2024-09-10T20:41:25.002775+0000","last_undegraded":"2024-09-10T20:41:25.002775+0000","last_fullsized":"2024-09-10T20:41:25.002775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:17.034966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002385+0000","last_change":"2024-09-10T20:40:56.799456+0000","last_active":"2024-09-10T20:41:25.002385+0000","last_peered":"2024-09-10T20:41:25.002385+0000","last_clean":"2024-09-10T20:41:25.002385+0000","last_became_active":"2024-09-10T20:40:56.799162+0000","last_became_peered":"2024-09-10T20:40:56.799162+0000","last_unstale":"2024-09-10T20:41:25.002385+0000","last_undegraded":"2024-09-10T20:41:25.002385+0000","last_fullsized":"2024-09-10T20:41:25.002385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:44.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969265+0000","last_change":"2024-09-10T20:41:22.969265+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969265+0000","last_undegraded":"2024-09-10T20:41:22.969265+0000","last_fullsized":"2024-09-10T20:41:22.969265+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'6","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995073+0000","last_change":"2024-09-10T20:40:57.802645+0000","last_active":"2024-09-10T20:41:23.995073+0000","last_peered":"2024-09-10T20:41:23.995073+0000","last_clean":"2024-09-10T20:41:23.995073+0000","last_became_active":"2024-09-10T20:40:57.802283+0000","last_became_peered":"2024-09-10T20:40:57.802283+0000","last_unstale":"2024-09-10T20:41:23.995073+0000","last_undegraded":"2024-09-10T20:41:23.995073+0000","last_fullsized":"2024-09-10T20:41:23.995073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:17.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023984+0000","last_change":"2024-09-10T20:40:56.787551+0000","last_active":"2024-09-10T20:41:25.023984+0000","last_peered":"2024-09-10T20:41:25.023984+0000","last_clean":"2024-09-10T20:41:25.023984+0000","last_became_active":"2024-09-10T20:40:56.786720+0000","last_became_peered":"2024-09-10T20:40:56.786720+0000","last_unstale":"2024-09-10T20:41:25.023984+0000","last_undegraded":"2024-09-10T20:41:25.023984+0000","last_fullsized":"2024-09-10T20:41:25.023984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:58.890626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002375+0000","last_change":"2024-09-10T20:41:23.994183+0000","last_active":"2024-09-10T20:41:25.002375+0000","last_peered":"2024-09-10T20:41:25.002375+0000","last_clean":"2024-09-10T20:41:25.002375+0000","last_became_active":"2024-09-10T20:41:23.993219+0000","last_became_peered":"2024-09-10T20:41:23.993219+0000","last_unstale":"2024-09-10T20:41:25.002375+0000","last_undegraded":"2024-09-10T20:41:25.002375+0000","last_fullsized":"2024-09-10T20:41:25.002375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:55.786567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002227+0000","last_change":"2024-09-10T20:40:57.805104+0000","last_active":"2024-09-10T20:41:25.002227+0000","last_peered":"2024-09-10T20:41:25.002227+0000","last_clean":"2024-09-10T20:41:25.002227+0000","last_became_active":"2024-09-10T20:40:57.804894+0000","last_became_peered":"2024-09-10T20:40:57.804894+0000","last_unstale":"2024-09-10T20:41:25.002227+0000","last_undegraded":"2024-09-10T20:41:25.002227+0000","last_fullsized":"2024-09-10T20:41:25.002227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:02.247029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"44'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024048+0000","last_change":"2024-09-10T20:40:56.798785+0000","last_active":"2024-09-10T20:41:25.024048+0000","last_peered":"2024-09-10T20:41:25.024048+0000","last_clean":"2024-09-10T20:41:25.024048+0000","last_became_active":"2024-09-10T20:40:56.798390+0000","last_became_peered":"2024-09-10T20:40:56.798390+0000","last_unstale":"2024-09-10T20:41:25.024048+0000","last_undegraded":"2024-09-10T20:41:25.024048+0000","last_fullsized":"2024-09-10T20:41:25.024048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:39.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002349+0000","last_change":"2024-09-10T20:41:23.993848+0000","last_active":"2024-09-10T20:41:25.002349+0000","last_peered":"2024-09-10T20:41:25.002349+0000","last_clean":"2024-09-10T20:41:25.002349+0000","last_became_active":"2024-09-10T20:41:23.993558+0000","last_became_peered":"2024-09-10T20:41:23.993558+0000","last_unstale":"2024-09-10T20:41:25.002349+0000","last_undegraded":"2024-09-10T20:41:25.002349+0000","last_fullsized":"2024-09-10T20:41:25.002349+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:05.240195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002434+0000","last_change":"2024-09-10T20:40:57.807154+0000","last_active":"2024-09-10T20:41:25.002434+0000","last_peered":"2024-09-10T20:41:25.002434+0000","last_clean":"2024-09-10T20:41:25.002434+0000","last_became_active":"2024-09-10T20:40:57.806970+0000","last_became_peered":"2024-09-10T20:40:57.806970+0000","last_unstale":"2024-09-10T20:41:25.002434+0000","last_undegraded":"2024-09-10T20:41:25.002434+0000","last_fullsized":"2024-09-10T20:41:25.002434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:40.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"44'24","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002928+0000","last_change":"2024-09-10T20:40:56.798461+0000","last_active":"2024-09-10T20:41:25.002928+0000","last_peered":"2024-09-10T20:41:25.002928+0000","last_clean":"2024-09-10T20:41:25.002928+0000","last_became_active":"2024-09-10T20:40:56.798136+0000","last_became_peered":"2024-09-10T20:40:56.798136+0000","last_unstale":"2024-09-10T20:41:25.002928+0000","last_undegraded":"2024-09-10T20:41:25.002928+0000","last_fullsized":"2024-09-10T20:41:25.002928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:08.271880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.998155+0000","last_change":"2024-09-10T20:41:23.994788+0000","last_active":"2024-09-10T20:41:23.998155+0000","last_peered":"2024-09-10T20:41:23.998155+0000","last_clean":"2024-09-10T20:41:23.998155+0000","last_became_active":"2024-09-10T20:41:23.994527+0000","last_became_peered":"2024-09-10T20:41:23.994527+0000","last_unstale":"2024-09-10T20:41:23.998155+0000","last_undegraded":"2024-09-10T20:41:23.998155+0000","last_fullsized":"2024-09-10T20:41:23.998155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001987+0000","last_change":"2024-09-10T20:40:57.800593+0000","last_active":"2024-09-10T20:41:25.001987+0000","last_peered":"2024-09-10T20:41:25.001987+0000","last_clean":"2024-09-10T20:41:25.001987+0000","last_became_active":"2024-09-10T20:40:57.796067+0000","last_became_peered":"2024-09-10T20:40:57.796067+0000","last_unstale":"2024-09-10T20:41:25.001987+0000","last_undegraded":"2024-09-10T20:41:25.001987+0000","last_fullsized":"2024-09-10T20:41:25.001987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:13.660313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"44'5","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001700+0000","last_change":"2024-09-10T20:40:56.798892+0000","last_active":"2024-09-10T20:41:25.001700+0000","last_peered":"2024-09-10T20:41:25.001700+0000","last_clean":"2024-09-10T20:41:25.001700+0000","last_became_active":"2024-09-10T20:40:56.798574+0000","last_became_peered":"2024-09-10T20:40:56.798574+0000","last_unstale":"2024-09-10T20:41:25.001700+0000","last_undegraded":"2024-09-10T20:41:25.001700+0000","last_fullsized":"2024-09-10T20:41:25.001700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:12.809899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003719+0000","last_change":"2024-09-10T20:41:23.997814+0000","last_active":"2024-09-10T20:41:24.003719+0000","last_peered":"2024-09-10T20:41:24.003719+0000","last_clean":"2024-09-10T20:41:24.003719+0000","last_became_active":"2024-09-10T20:41:23.997261+0000","last_became_peered":"2024-09-10T20:41:23.997261+0000","last_unstale":"2024-09-10T20:41:24.003719+0000","last_undegraded":"2024-09-10T20:41:24.003719+0000","last_fullsized":"2024-09-10T20:41:24.003719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:33.403127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295687+0000","last_change":"2024-09-10T20:40:57.789344+0000","last_active":"2024-09-10T20:41:25.295687+0000","last_peered":"2024-09-10T20:41:25.295687+0000","last_clean":"2024-09-10T20:41:25.295687+0000","last_became_active":"2024-09-10T20:40:57.789092+0000","last_became_peered":"2024-09-10T20:40:57.789092+0000","last_unstale":"2024-09-10T20:41:25.295687+0000","last_undegraded":"2024-09-10T20:41:25.295687+0000","last_fullsized":"2024-09-10T20:41:25.295687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.377370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295848+0000","last_change":"2024-09-10T20:40:56.787899+0000","last_active":"2024-09-10T20:41:25.295848+0000","last_peered":"2024-09-10T20:41:25.295848+0000","last_clean":"2024-09-10T20:41:25.295848+0000","last_became_active":"2024-09-10T20:40:56.787509+0000","last_became_peered":"2024-09-10T20:40:56.787509+0000","last_unstale":"2024-09-10T20:41:25.295848+0000","last_undegraded":"2024-09-10T20:41:25.295848+0000","last_fullsized":"2024-09-10T20:41:25.295848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.249527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995941+0000","last_change":"2024-09-10T20:41:23.993761+0000","last_active":"2024-09-10T20:41:23.995941+0000","last_peered":"2024-09-10T20:41:23.995941+0000","last_clean":"2024-09-10T20:41:23.995941+0000","last_became_active":"2024-09-10T20:41:23.993477+0000","last_became_peered":"2024-09-10T20:41:23.993477+0000","last_unstale":"2024-09-10T20:41:23.995941+0000","last_undegraded":"2024-09-10T20:41:23.995941+0000","last_fullsized":"2024-09-10T20:41:23.995941+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:35.482106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267196+0000","last_change":"2024-09-10T20:40:57.786588+0000","last_active":"2024-09-10T20:41:25.267196+0000","last_peered":"2024-09-10T20:41:25.267196+0000","last_clean":"2024-09-10T20:41:25.267196+0000","last_became_active":"2024-09-10T20:40:57.786296+0000","last_became_peered":"2024-09-10T20:40:57.786296+0000","last_unstale":"2024-09-10T20:41:25.267196+0000","last_undegraded":"2024-09-10T20:41:25.267196+0000","last_fullsized":"2024-09-10T20:41:25.267196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:36.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023573+0000","last_change":"2024-09-10T20:40:56.783758+0000","last_active":"2024-09-10T20:41:25.023573+0000","last_peered":"2024-09-10T20:41:25.023573+0000","last_clean":"2024-09-10T20:41:25.023573+0000","last_became_active":"2024-09-10T20:40:56.783512+0000","last_became_peered":"2024-09-10T20:40:56.783512+0000","last_unstale":"2024-09-10T20:41:25.023573+0000","last_undegraded":"2024-09-10T20:41:25.023573+0000","last_fullsized":"2024-09-10T20:41:25.023573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:39.374632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002192+0000","last_change":"2024-09-10T20:41:24.000925+0000","last_active":"2024-09-10T20:41:25.002192+0000","last_peered":"2024-09-10T20:41:25.002192+0000","last_clean":"2024-09-10T20:41:25.002192+0000","last_became_active":"2024-09-10T20:41:23.999216+0000","last_became_peered":"2024-09-10T20:41:23.999216+0000","last_unstale":"2024-09-10T20:41:25.002192+0000","last_undegraded":"2024-09-10T20:41:25.002192+0000","last_fullsized":"2024-09-10T20:41:25.002192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:36.479766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'15","reported_seq":41,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985588+0000","last_change":"2024-09-10T20:40:57.801745+0000","last_active":"2024-09-10T20:41:23.985588+0000","last_peered":"2024-09-10T20:41:23.985588+0000","last_clean":"2024-09-10T20:41:23.985588+0000","last_became_active":"2024-09-10T20:40:57.801484+0000","last_became_peered":"2024-09-10T20:40:57.801484+0000","last_unstale":"2024-09-10T20:41:23.985588+0000","last_undegraded":"2024-09-10T20:41:23.985588+0000","last_fullsized":"2024-09-10T20:41:23.985588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:10.503000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"44'15","reported_seq":43,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991869+0000","last_change":"2024-09-10T20:40:56.779692+0000","last_active":"2024-09-10T20:41:23.991869+0000","last_peered":"2024-09-10T20:41:23.991869+0000","last_clean":"2024-09-10T20:41:23.991869+0000","last_became_active":"2024-09-10T20:40:56.779447+0000","last_became_peered":"2024-09-10T20:40:56.779447+0000","last_unstale":"2024-09-10T20:41:23.991869+0000","last_undegraded":"2024-09-10T20:41:23.991869+0000","last_fullsized":"2024-09-10T20:41:23.991869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:15.261201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002291+0000","last_change":"2024-09-10T20:41:23.999605+0000","last_active":"2024-09-10T20:41:25.002291+0000","last_peered":"2024-09-10T20:41:25.002291+0000","last_clean":"2024-09-10T20:41:25.002291+0000","last_became_active":"2024-09-10T20:41:23.998539+0000","last_became_peered":"2024-09-10T20:41:23.998539+0000","last_unstale":"2024-09-10T20:41:25.002291+0000","last_undegraded":"2024-09-10T20:41:25.002291+0000","last_fullsized":"2024-09-10T20:41:25.002291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:26.825035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295947+0000","last_change":"2024-09-10T20:40:57.795777+0000","last_active":"2024-09-10T20:41:25.295947+0000","last_peered":"2024-09-10T20:41:25.295947+0000","last_clean":"2024-09-10T20:41:25.295947+0000","last_became_active":"2024-09-10T20:40:57.795521+0000","last_became_peered":"2024-09-10T20:40:57.795521+0000","last_unstale":"2024-09-10T20:41:25.295947+0000","last_undegraded":"2024-09-10T20:41:25.295947+0000","last_fullsized":"2024-09-10T20:41:25.295947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:15.958954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"44'2","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002456+0000","last_change":"2024-09-10T20:40:56.792708+0000","last_active":"2024-09-10T20:41:25.002456+0000","last_peered":"2024-09-10T20:41:25.002456+0000","last_clean":"2024-09-10T20:41:25.002456+0000","last_became_active":"2024-09-10T20:40:56.792427+0000","last_became_peered":"2024-09-10T20:40:56.792427+0000","last_unstale":"2024-09-10T20:41:25.002456+0000","last_undegraded":"2024-09-10T20:41:25.002456+0000","last_fullsized":"2024-09-10T20:41:25.002456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:40.781428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.008364+0000","last_change":"2024-09-10T20:41:24.005055+0000","last_active":"2024-09-10T20:41:24.008364+0000","last_peered":"2024-09-10T20:41:24.008364+0000","last_clean":"2024-09-10T20:41:24.008364+0000","last_became_active":"2024-09-10T20:41:24.004760+0000","last_became_peered":"2024-09-10T20:41:24.004760+0000","last_unstale":"2024-09-10T20:41:24.008364+0000","last_undegraded":"2024-09-10T20:41:24.008364+0000","last_fullsized":"2024-09-10T20:41:24.008364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:40.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002465+0000","last_change":"2024-09-10T20:40:57.805292+0000","last_active":"2024-09-10T20:41:25.002465+0000","last_peered":"2024-09-10T20:41:25.002465+0000","last_clean":"2024-09-10T20:41:25.002465+0000","last_became_active":"2024-09-10T20:40:57.804999+0000","last_became_peered":"2024-09-10T20:40:57.804999+0000","last_unstale":"2024-09-10T20:41:25.002465+0000","last_undegraded":"2024-09-10T20:41:25.002465+0000","last_fullsized":"2024-09-10T20:41:25.002465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:56.651005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024199+0000","last_change":"2024-09-10T20:40:56.798769+0000","last_active":"2024-09-10T20:41:25.024199+0000","last_peered":"2024-09-10T20:41:25.024199+0000","last_clean":"2024-09-10T20:41:25.024199+0000","last_became_active":"2024-09-10T20:40:56.798317+0000","last_became_peered":"2024-09-10T20:40:56.798317+0000","last_unstale":"2024-09-10T20:41:25.024199+0000","last_undegraded":"2024-09-10T20:41:25.024199+0000","last_fullsized":"2024-09-10T20:41:25.024199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:25.510395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003862+0000","last_change":"2024-09-10T20:41:23.999829+0000","last_active":"2024-09-10T20:41:24.003862+0000","last_peered":"2024-09-10T20:41:24.003862+0000","last_clean":"2024-09-10T20:41:24.003862+0000","last_became_active":"2024-09-10T20:41:23.999579+0000","last_became_peered":"2024-09-10T20:41:23.999579+0000","last_unstale":"2024-09-10T20:41:24.003862+0000","last_undegraded":"2024-09-10T20:41:24.003862+0000","last_fullsized":"2024-09-10T20:41:24.003862+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002530+0000","last_change":"2024-09-10T20:40:57.795506+0000","last_active":"2024-09-10T20:41:25.002530+0000","last_peered":"2024-09-10T20:41:25.002530+0000","last_clean":"2024-09-10T20:41:25.002530+0000","last_became_active":"2024-09-10T20:40:57.795238+0000","last_became_peered":"2024-09-10T20:40:57.795238+0000","last_unstale":"2024-09-10T20:41:25.002530+0000","last_undegraded":"2024-09-10T20:41:25.002530+0000","last_fullsized":"2024-09-10T20:41:25.002530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"44'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986466+0000","last_change":"2024-09-10T20:40:56.792843+0000","last_active":"2024-09-10T20:41:23.986466+0000","last_peered":"2024-09-10T20:41:23.986466+0000","last_clean":"2024-09-10T20:41:23.986466+0000","last_became_active":"2024-09-10T20:40:56.792439+0000","last_became_peered":"2024-09-10T20:40:56.792439+0000","last_unstale":"2024-09-10T20:41:23.986466+0000","last_undegraded":"2024-09-10T20:41:23.986466+0000","last_fullsized":"2024-09-10T20:41:23.986466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:49.054542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003682+0000","last_change":"2024-09-10T20:41:23.997742+0000","last_active":"2024-09-10T20:41:24.003682+0000","last_peered":"2024-09-10T20:41:24.003682+0000","last_clean":"2024-09-10T20:41:24.003682+0000","last_became_active":"2024-09-10T20:41:23.997137+0000","last_became_peered":"2024-09-10T20:41:23.997137+0000","last_unstale":"2024-09-10T20:41:24.003682+0000","last_undegraded":"2024-09-10T20:41:24.003682+0000","last_fullsized":"2024-09-10T20:41:24.003682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:12.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'9","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972839+0000","last_change":"2024-09-10T20:40:57.798663+0000","last_active":"2024-09-10T20:41:22.972839+0000","last_peered":"2024-09-10T20:41:22.972839+0000","last_clean":"2024-09-10T20:41:22.972839+0000","last_became_active":"2024-09-10T20:40:57.798333+0000","last_became_peered":"2024-09-10T20:40:57.798333+0000","last_unstale":"2024-09-10T20:41:22.972839+0000","last_undegraded":"2024-09-10T20:41:22.972839+0000","last_fullsized":"2024-09-10T20:41:22.972839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:22.259106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972259+0000","last_change":"2024-09-10T20:40:56.789841+0000","last_active":"2024-09-10T20:41:22.972259+0000","last_peered":"2024-09-10T20:41:22.972259+0000","last_clean":"2024-09-10T20:41:22.972259+0000","last_became_active":"2024-09-10T20:40:56.789524+0000","last_became_peered":"2024-09-10T20:40:56.789524+0000","last_unstale":"2024-09-10T20:41:22.972259+0000","last_undegraded":"2024-09-10T20:41:22.972259+0000","last_fullsized":"2024-09-10T20:41:22.972259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:06.139874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969239+0000","last_change":"2024-09-10T20:41:22.969239+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969239+0000","last_undegraded":"2024-09-10T20:41:22.969239+0000","last_fullsized":"2024-09-10T20:41:22.969239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023403+0000","last_change":"2024-09-10T20:40:57.779901+0000","last_active":"2024-09-10T20:41:25.023403+0000","last_peered":"2024-09-10T20:41:25.023403+0000","last_clean":"2024-09-10T20:41:25.023403+0000","last_became_active":"2024-09-10T20:40:57.779489+0000","last_became_peered":"2024-09-10T20:40:57.779489+0000","last_unstale":"2024-09-10T20:41:25.023403+0000","last_undegraded":"2024-09-10T20:41:25.023403+0000","last_fullsized":"2024-09-10T20:41:25.023403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.265123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"44'4","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.971719+0000","last_change":"2024-09-10T20:40:56.787107+0000","last_active":"2024-09-10T20:41:22.971719+0000","last_peered":"2024-09-10T20:41:22.971719+0000","last_clean":"2024-09-10T20:41:22.971719+0000","last_became_active":"2024-09-10T20:40:56.786778+0000","last_became_peered":"2024-09-10T20:40:56.786778+0000","last_unstale":"2024-09-10T20:41:22.971719+0000","last_undegraded":"2024-09-10T20:41:22.971719+0000","last_fullsized":"2024-09-10T20:41:22.971719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:21.098826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969341+0000","last_change":"2024-09-10T20:41:22.969341+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969341+0000","last_undegraded":"2024-09-10T20:41:22.969341+0000","last_fullsized":"2024-09-10T20:41:22.969341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"40'2","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001262+0000","last_change":"2024-09-10T20:40:57.805036+0000","last_active":"2024-09-10T20:41:25.001262+0000","last_peered":"2024-09-10T20:41:25.001262+0000","last_clean":"2024-09-10T20:41:25.001262+0000","last_became_active":"2024-09-10T20:40:57.804826+0000","last_became_peered":"2024-09-10T20:40:57.804826+0000","last_unstale":"2024-09-10T20:41:25.001262+0000","last_undegraded":"2024-09-10T20:41:25.001262+0000","last_fullsized":"2024-09-10T20:41:25.001262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:26.742701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295936+0000","last_change":"2024-09-10T20:40:56.792580+0000","last_active":"2024-09-10T20:41:25.295936+0000","last_peered":"2024-09-10T20:41:25.295936+0000","last_clean":"2024-09-10T20:41:25.295936+0000","last_became_active":"2024-09-10T20:40:56.792296+0000","last_became_peered":"2024-09-10T20:40:56.792296+0000","last_unstale":"2024-09-10T20:41:25.295936+0000","last_undegraded":"2024-09-10T20:41:25.295936+0000","last_fullsized":"2024-09-10T20:41:25.295936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:34.728794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295921+0000","last_change":"2024-09-10T20:41:23.999776+0000","last_active":"2024-09-10T20:41:25.295921+0000","last_peered":"2024-09-10T20:41:25.295921+0000","last_clean":"2024-09-10T20:41:25.295921+0000","last_became_active":"2024-09-10T20:41:23.999315+0000","last_became_peered":"2024-09-10T20:41:23.999315+0000","last_unstale":"2024-09-10T20:41:25.295921+0000","last_undegraded":"2024-09-10T20:41:25.295921+0000","last_fullsized":"2024-09-10T20:41:25.295921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:22.338151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267170+0000","last_change":"2024-09-10T20:40:57.798757+0000","last_active":"2024-09-10T20:41:25.267170+0000","last_peered":"2024-09-10T20:41:25.267170+0000","last_clean":"2024-09-10T20:41:25.267170+0000","last_became_active":"2024-09-10T20:40:57.796635+0000","last_became_peered":"2024-09-10T20:40:57.796635+0000","last_unstale":"2024-09-10T20:41:25.267170+0000","last_undegraded":"2024-09-10T20:41:25.267170+0000","last_fullsized":"2024-09-10T20:41:25.267170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:19.855245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002083+0000","last_change":"2024-09-10T20:40:56.779612+0000","last_active":"2024-09-10T20:41:25.002083+0000","last_peered":"2024-09-10T20:41:25.002083+0000","last_clean":"2024-09-10T20:41:25.002083+0000","last_became_active":"2024-09-10T20:40:56.779319+0000","last_became_peered":"2024-09-10T20:40:56.779319+0000","last_unstale":"2024-09-10T20:41:25.002083+0000","last_undegraded":"2024-09-10T20:41:25.002083+0000","last_fullsized":"2024-09-10T20:41:25.002083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:20.129458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001203+0000","last_change":"2024-09-10T20:41:24.002621+0000","last_active":"2024-09-10T20:41:25.001203+0000","last_peered":"2024-09-10T20:41:25.001203+0000","last_clean":"2024-09-10T20:41:25.001203+0000","last_became_active":"2024-09-10T20:41:24.001969+0000","last_became_peered":"2024-09-10T20:41:24.001969+0000","last_unstale":"2024-09-10T20:41:25.001203+0000","last_undegraded":"2024-09-10T20:41:25.001203+0000","last_fullsized":"2024-09-10T20:41:25.001203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:38.113389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001137+0000","last_change":"2024-09-10T20:40:57.794987+0000","last_active":"2024-09-10T20:41:25.001137+0000","last_peered":"2024-09-10T20:41:25.001137+0000","last_clean":"2024-09-10T20:41:25.001137+0000","last_became_active":"2024-09-10T20:40:57.794701+0000","last_became_peered":"2024-09-10T20:40:57.794701+0000","last_unstale":"2024-09-10T20:41:25.001137+0000","last_undegraded":"2024-09-10T20:41:25.001137+0000","last_fullsized":"2024-09-10T20:41:25.001137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:35.070564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295553+0000","last_change":"2024-09-10T20:40:56.796619+0000","last_active":"2024-09-10T20:41:25.295553+0000","last_peered":"2024-09-10T20:41:25.295553+0000","last_clean":"2024-09-10T20:41:25.295553+0000","last_became_active":"2024-09-10T20:40:56.796334+0000","last_became_peered":"2024-09-10T20:40:56.796334+0000","last_unstale":"2024-09-10T20:41:25.295553+0000","last_undegraded":"2024-09-10T20:41:25.295553+0000","last_fullsized":"2024-09-10T20:41:25.295553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:18.035879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024094+0000","last_change":"2024-09-10T20:41:24.002545+0000","last_active":"2024-09-10T20:41:25.024094+0000","last_peered":"2024-09-10T20:41:25.024094+0000","last_clean":"2024-09-10T20:41:25.024094+0000","last_became_active":"2024-09-10T20:41:24.002269+0000","last_became_peered":"2024-09-10T20:41:24.002269+0000","last_unstale":"2024-09-10T20:41:25.024094+0000","last_undegraded":"2024-09-10T20:41:25.024094+0000","last_fullsized":"2024-09-10T20:41:25.024094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:29.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"40'9","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987145+0000","last_change":"2024-09-10T20:40:57.797064+0000","last_active":"2024-09-10T20:41:23.987145+0000","last_peered":"2024-09-10T20:41:23.987145+0000","last_clean":"2024-09-10T20:41:23.987145+0000","last_became_active":"2024-09-10T20:40:57.796778+0000","last_became_peered":"2024-09-10T20:40:57.796778+0000","last_unstale":"2024-09-10T20:41:23.987145+0000","last_undegraded":"2024-09-10T20:41:23.987145+0000","last_fullsized":"2024-09-10T20:41:23.987145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:13.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024157+0000","last_change":"2024-09-10T20:40:56.781802+0000","last_active":"2024-09-10T20:41:25.024157+0000","last_peered":"2024-09-10T20:41:25.024157+0000","last_clean":"2024-09-10T20:41:25.024157+0000","last_became_active":"2024-09-10T20:40:56.781430+0000","last_became_peered":"2024-09-10T20:40:56.781430+0000","last_unstale":"2024-09-10T20:41:25.024157+0000","last_undegraded":"2024-09-10T20:41:25.024157+0000","last_fullsized":"2024-09-10T20:41:25.024157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:52.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002451+0000","last_change":"2024-09-10T20:41:23.999122+0000","last_active":"2024-09-10T20:41:25.002451+0000","last_peered":"2024-09-10T20:41:25.002451+0000","last_clean":"2024-09-10T20:41:25.002451+0000","last_became_active":"2024-09-10T20:41:23.996737+0000","last_became_peered":"2024-09-10T20:41:23.996737+0000","last_unstale":"2024-09-10T20:41:25.002451+0000","last_undegraded":"2024-09-10T20:41:25.002451+0000","last_fullsized":"2024-09-10T20:41:25.002451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:04.584893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267543+0000","last_change":"2024-09-10T20:40:57.797088+0000","last_active":"2024-09-10T20:41:25.267543+0000","last_peered":"2024-09-10T20:41:25.267543+0000","last_clean":"2024-09-10T20:41:25.267543+0000","last_became_active":"2024-09-10T20:40:57.796516+0000","last_became_peered":"2024-09-10T20:40:57.796516+0000","last_unstale":"2024-09-10T20:41:25.267543+0000","last_undegraded":"2024-09-10T20:41:25.267543+0000","last_fullsized":"2024-09-10T20:41:25.267543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:23.886368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"44'5","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987209+0000","last_change":"2024-09-10T20:40:56.792746+0000","last_active":"2024-09-10T20:41:23.987209+0000","last_peered":"2024-09-10T20:41:23.987209+0000","last_clean":"2024-09-10T20:41:23.987209+0000","last_became_active":"2024-09-10T20:40:56.792409+0000","last_became_peered":"2024-09-10T20:40:56.792409+0000","last_unstale":"2024-09-10T20:41:23.987209+0000","last_undegraded":"2024-09-10T20:41:23.987209+0000","last_fullsized":"2024-09-10T20:41:23.987209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:11.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024072+0000","last_change":"2024-09-10T20:41:24.001797+0000","last_active":"2024-09-10T20:41:25.024072+0000","last_peered":"2024-09-10T20:41:25.024072+0000","last_clean":"2024-09-10T20:41:25.024072+0000","last_became_active":"2024-09-10T20:41:24.001549+0000","last_became_peered":"2024-09-10T20:41:24.001549+0000","last_unstale":"2024-09-10T20:41:25.024072+0000","last_undegraded":"2024-09-10T20:41:25.024072+0000","last_fullsized":"2024-09-10T20:41:25.024072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:51.657538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972657+0000","last_change":"2024-09-10T20:40:57.780255+0000","last_active":"2024-09-10T20:41:22.972657+0000","last_peered":"2024-09-10T20:41:22.972657+0000","last_clean":"2024-09-10T20:41:22.972657+0000","last_became_active":"2024-09-10T20:40:57.779962+0000","last_became_peered":"2024-09-10T20:40:57.779962+0000","last_unstale":"2024-09-10T20:41:22.972657+0000","last_undegraded":"2024-09-10T20:41:22.972657+0000","last_fullsized":"2024-09-10T20:41:22.972657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:32.285607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986598+0000","last_change":"2024-09-10T20:40:56.800962+0000","last_active":"2024-09-10T20:41:23.986598+0000","last_peered":"2024-09-10T20:41:23.986598+0000","last_clean":"2024-09-10T20:41:23.986598+0000","last_became_active":"2024-09-10T20:40:56.800727+0000","last_became_peered":"2024-09-10T20:40:56.800727+0000","last_unstale":"2024-09-10T20:41:23.986598+0000","last_undegraded":"2024-09-10T20:41:23.986598+0000","last_fullsized":"2024-09-10T20:41:23.986598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:52.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.005439+0000","last_change":"2024-09-10T20:41:24.001291+0000","last_active":"2024-09-10T20:41:24.005439+0000","last_peered":"2024-09-10T20:41:24.005439+0000","last_clean":"2024-09-10T20:41:24.005439+0000","last_became_active":"2024-09-10T20:41:24.000871+0000","last_became_peered":"2024-09-10T20:41:24.000871+0000","last_unstale":"2024-09-10T20:41:24.005439+0000","last_undegraded":"2024-09-10T20:41:24.005439+0000","last_fullsized":"2024-09-10T20:41:24.005439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:45.607883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"40'8","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.984817+0000","last_change":"2024-09-10T20:40:57.793540+0000","last_active":"2024-09-10T20:41:23.984817+0000","last_peered":"2024-09-10T20:41:23.984817+0000","last_clean":"2024-09-10T20:41:23.984817+0000","last_became_active":"2024-09-10T20:40:57.793231+0000","last_became_peered":"2024-09-10T20:40:57.793231+0000","last_unstale":"2024-09-10T20:41:23.984817+0000","last_undegraded":"2024-09-10T20:41:23.984817+0000","last_fullsized":"2024-09-10T20:41:23.984817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:43.458885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001847+0000","last_change":"2024-09-10T20:40:56.795661+0000","last_active":"2024-09-10T20:41:25.001847+0000","last_peered":"2024-09-10T20:41:25.001847+0000","last_clean":"2024-09-10T20:41:25.001847+0000","last_became_active":"2024-09-10T20:40:56.794893+0000","last_became_peered":"2024-09-10T20:40:56.794893+0000","last_unstale":"2024-09-10T20:41:25.001847+0000","last_undegraded":"2024-09-10T20:41:25.001847+0000","last_fullsized":"2024-09-10T20:41:25.001847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:56.476490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001972+0000","last_change":"2024-09-10T20:41:23.999188+0000","last_active":"2024-09-10T20:41:25.001972+0000","last_peered":"2024-09-10T20:41:25.001972+0000","last_clean":"2024-09-10T20:41:25.001972+0000","last_became_active":"2024-09-10T20:41:23.998882+0000","last_became_peered":"2024-09-10T20:41:23.998882+0000","last_unstale":"2024-09-10T20:41:25.001972+0000","last_undegraded":"2024-09-10T20:41:25.001972+0000","last_fullsized":"2024-09-10T20:41:25.001972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:06.148067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295734+0000","last_change":"2024-09-10T20:40:57.777674+0000","last_active":"2024-09-10T20:41:25.295734+0000","last_peered":"2024-09-10T20:41:25.295734+0000","last_clean":"2024-09-10T20:41:25.295734+0000","last_became_active":"2024-09-10T20:40:57.776652+0000","last_became_peered":"2024-09-10T20:40:57.776652+0000","last_unstale":"2024-09-10T20:41:25.295734+0000","last_undegraded":"2024-09-10T20:41:25.295734+0000","last_fullsized":"2024-09-10T20:41:25.295734+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:22.672592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267291+0000","last_change":"2024-09-10T20:40:56.786260+0000","last_active":"2024-09-10T20:41:25.267291+0000","last_peered":"2024-09-10T20:41:25.267291+0000","last_clean":"2024-09-10T20:41:25.267291+0000","last_became_active":"2024-09-10T20:40:56.785702+0000","last_became_peered":"2024-09-10T20:40:56.785702+0000","last_unstale":"2024-09-10T20:41:25.267291+0000","last_undegraded":"2024-09-10T20:41:25.267291+0000","last_fullsized":"2024-09-10T20:41:25.267291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970409+0000","last_change":"2024-09-10T20:41:22.970409+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970409+0000","last_undegraded":"2024-09-10T20:41:22.970409+0000","last_fullsized":"2024-09-10T20:41:22.970409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023703+0000","last_change":"2024-09-10T20:40:57.793392+0000","last_active":"2024-09-10T20:41:25.023703+0000","last_peered":"2024-09-10T20:41:25.023703+0000","last_clean":"2024-09-10T20:41:25.023703+0000","last_became_active":"2024-09-10T20:40:57.793192+0000","last_became_peered":"2024-09-10T20:40:57.793192+0000","last_unstale":"2024-09-10T20:41:25.023703+0000","last_undegraded":"2024-09-10T20:41:25.023703+0000","last_fullsized":"2024-09-10T20:41:25.023703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:04.659598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023685+0000","last_change":"2024-09-10T20:40:56.781668+0000","last_active":"2024-09-10T20:41:25.023685+0000","last_peered":"2024-09-10T20:41:25.023685+0000","last_clean":"2024-09-10T20:41:25.023685+0000","last_became_active":"2024-09-10T20:40:56.781402+0000","last_became_peered":"2024-09-10T20:40:56.781402+0000","last_unstale":"2024-09-10T20:41:25.023685+0000","last_undegraded":"2024-09-10T20:41:25.023685+0000","last_fullsized":"2024-09-10T20:41:25.023685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:35.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001449+0000","last_change":"2024-09-10T20:41:24.002138+0000","last_active":"2024-09-10T20:41:25.001449+0000","last_peered":"2024-09-10T20:41:25.001449+0000","last_clean":"2024-09-10T20:41:25.001449+0000","last_became_active":"2024-09-10T20:41:24.001620+0000","last_became_peered":"2024-09-10T20:41:24.001620+0000","last_unstale":"2024-09-10T20:41:25.001449+0000","last_undegraded":"2024-09-10T20:41:25.001449+0000","last_fullsized":"2024-09-10T20:41:25.001449+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:13.979541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267202+0000","last_change":"2024-09-10T20:40:57.789700+0000","last_active":"2024-09-10T20:41:25.267202+0000","last_peered":"2024-09-10T20:41:25.267202+0000","last_clean":"2024-09-10T20:41:25.267202+0000","last_became_active":"2024-09-10T20:40:57.789433+0000","last_became_peered":"2024-09-10T20:40:57.789433+0000","last_unstale":"2024-09-10T20:41:25.267202+0000","last_undegraded":"2024-09-10T20:41:25.267202+0000","last_fullsized":"2024-09-10T20:41:25.267202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:28.800368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002615+0000","last_change":"2024-09-10T20:40:56.795619+0000","last_active":"2024-09-10T20:41:25.002615+0000","last_peered":"2024-09-10T20:41:25.002615+0000","last_clean":"2024-09-10T20:41:25.002615+0000","last_became_active":"2024-09-10T20:40:56.795292+0000","last_became_peered":"2024-09-10T20:40:56.795292+0000","last_unstale":"2024-09-10T20:41:25.002615+0000","last_undegraded":"2024-09-10T20:41:25.002615+0000","last_fullsized":"2024-09-10T20:41:25.002615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:09.500262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970028+0000","last_change":"2024-09-10T20:41:22.970028+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970028+0000","last_undegraded":"2024-09-10T20:41:22.970028+0000","last_fullsized":"2024-09-10T20:41:22.970028+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024030+0000","last_change":"2024-09-10T20:40:57.784029+0000","last_active":"2024-09-10T20:41:25.024030+0000","last_peered":"2024-09-10T20:41:25.024030+0000","last_clean":"2024-09-10T20:41:25.024030+0000","last_became_active":"2024-09-10T20:40:57.783716+0000","last_became_peered":"2024-09-10T20:40:57.783716+0000","last_unstale":"2024-09-10T20:41:25.024030+0000","last_undegraded":"2024-09-10T20:41:25.024030+0000","last_fullsized":"2024-09-10T20:41:25.024030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:31.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267214+0000","last_change":"2024-09-10T20:40:56.785344+0000","last_active":"2024-09-10T20:41:25.267214+0000","last_peered":"2024-09-10T20:41:25.267214+0000","last_clean":"2024-09-10T20:41:25.267214+0000","last_became_active":"2024-09-10T20:40:56.785096+0000","last_became_peered":"2024-09-10T20:40:56.785096+0000","last_unstale":"2024-09-10T20:41:25.267214+0000","last_undegraded":"2024-09-10T20:41:25.267214+0000","last_fullsized":"2024-09-10T20:41:25.267214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":159,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002333+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:25.002333+0000","last_peered":"2024-09-10T20:41:25.002333+0000","last_clean":"2024-09-10T20:41:25.002333+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:25.002333+0000","last_undegraded":"2024-09-10T20:41:25.002333+0000","last_fullsized":"2024-09-10T20:41:25.002333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":98,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6844416,"data_stored":6540388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1146880,"data_stored":839300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29616,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342224,"statfs":{"total":96636764160,"available":96606437376,"internally_reserved":0,"allocated":2650112,"data_stored":2346084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":5180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":5304320,"data_stored":5011475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:29.035 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-09-10T20:41:22.969555+0000', 'last_change': '2024-09-10T20:41:22.969555+0000', 'last_active': '2024-09-10T20:41:22.962532+0000', 'last_peered': '2024-09-10T20:41:22.962532+0000', 'last_clean': '2024-09-10T20:41:22.962532+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T20:41:22.969555+0000', 'last_undegraded': '2024-09-10T20:41:22.969555+0000', 'last_fullsized': '2024-09-10T20:41:22.969555+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_clean_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-09-10T20:41:22.969265+0000', 'last_change': '2024-09-10T20:41:22.969265+0000', 'last_active': '2024-09-10T20:41:22.962532+0000', 'last_peered': '2024-09-10T20:41:22.962532+0000', 'last_clean': '2024-09-10T20:41:22.962532+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T20:41:22.969265+0000', 'last_undegraded': '2024-09-10T20:41:22.969265+0000', 'last_fullsized': '2024-09-10T20:41:22.969265+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_clean_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-09-10T20:41:22.969239+0000', 'last_change': '2024-09-10T20:41:22.969239+0000', 'last_active': '2024-09-10T20:41:22.962532+0000', 'last_peered': '2024-09-10T20:41:22.962532+0000', 'last_clean': '2024-09-10T20:41:22.962532+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T20:41:22.969239+0000', 'last_undegraded': '2024-09-10T20:41:22.969239+0000', 'last_fullsized': '2024-09-10T20:41:22.969239+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_clean_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-09-10T20:41:22.969341+0000', 'last_change': '2024-09-10T20:41:22.969341+0000', 'last_active': '2024-09-10T20:41:22.962532+0000', 'last_peered': '2024-09-10T20:41:22.962532+0000', 'last_clean': '2024-09-10T20:41:22.962532+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T20:41:22.969341+0000', 'last_undegraded': '2024-09-10T20:41:22.969341+0000', 'last_fullsized': '2024-09-10T20:41:22.969341+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_clean_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-09-10T20:41:22.970409+0000', 'last_change': '2024-09-10T20:41:22.970409+0000', 'last_active': '2024-09-10T20:41:22.962532+0000', 'last_peered': '2024-09-10T20:41:22.962532+0000', 'last_clean': '2024-09-10T20:41:22.962532+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T20:41:22.970409+0000', 'last_undegraded': '2024-09-10T20:41:22.970409+0000', 'last_fullsized': '2024-09-10T20:41:22.970409+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_clean_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T20:41:29.036 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-10T20:41:29.037 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-09-10T20:41:22.970028+0000', 'last_change': '2024-09-10T20:41:22.970028+0000', 'last_active': '2024-09-10T20:41:22.962532+0000', 'last_peered': '2024-09-10T20:41:22.962532+0000', 'last_clean': '2024-09-10T20:41:22.962532+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-10T20:41:22.970028+0000', 'last_undegraded': '2024-09-10T20:41:22.970028+0000', 'last_fullsized': '2024-09-10T20:41:22.970028+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'last_clean_scrub_stamp': '2024-09-10T20:41:22.962532+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-10T20:41:29.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-10T20:41:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 -- 172.21.15.81:0/1299385667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815d4e0 msgr2=0x7f2a0815d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/1299385667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815d4e0 0x7f2a0815d970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005fd0 tx=0x7f2a0002aa50 comp rx=0 tx=0).stop 2024-09-10T20:41:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 -- 172.21.15.81:0/1299385667 shutdown_connections 2024-09-10T20:41:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/1299385667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815d4e0 0x7f2a0815d970 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/1299385667 >> v2:172.21.15.143:3300/0 conn(0x7f2a0806e660 0x7f2a0806ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 -- 172.21.15.81:0/1299385667 >> 172.21.15.81:0/1299385667 conn(0x7f2a08068f90 msgr2=0x7f2a0806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 -- 172.21.15.81:0/1299385667 shutdown_connections 2024-09-10T20:41:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.221+0000 7f2a0cc00640 1 -- 172.21.15.81:0/1299385667 wait complete. 2024-09-10T20:41:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.223+0000 7f2a0cc00640 1 Processor -- start 2024-09-10T20:41:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.223+0000 7f2a0cc00640 1 -- start start 2024-09-10T20:41:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a0cc00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a0806e660 0x7f2a080cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a0cc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0815d4e0 0x7f2a081e8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a0cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815ee50 0x7f2a0813f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a0cc00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080ccd80 con 0x7f2a0815ee50 2024-09-10T20:41:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a0cc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0815f420 con 0x7f2a0815d4e0 2024-09-10T20:41:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a0cc00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0815deb0 con 0x7f2a0806e660 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815ee50 0x7f2a0813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815ee50 0x7f2a0813f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41256/0 (socket says 172.21.15.81:41256) 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 -- 172.21.15.81:0/3894542848 learned_addr learned my addr 172.21.15.81:0/3894542848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a05400640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0815d4e0 0x7f2a081e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a05e00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a0806e660 0x7f2a080cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 -- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a0806e660 msgr2=0x7f2a080cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a0806e660 0x7f2a080cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 -- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0815d4e0 msgr2=0x7f2a081e8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0815d4e0 0x7f2a081e8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a06800640 1 -- 172.21.15.81:0/3894542848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081e8670 con 0x7f2a0815ee50 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.224+0000 7f2a05400640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0815d4e0 0x7f2a081e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.225+0000 7f2a06800640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815ee50 0x7f2a0813f310 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2a00006010 tx=0x7f2a00003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.225+0000 7f29fe000640 1 -- 172.21.15.81:0/3894542848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00047070 con 0x7f2a0815ee50 2024-09-10T20:41:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.225+0000 7f29fe000640 1 -- 172.21.15.81:0/3894542848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a00004250 con 0x7f2a0815ee50 2024-09-10T20:41:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.225+0000 7f29fe000640 1 -- 172.21.15.81:0/3894542848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00033050 con 0x7f2a0815ee50 2024-09-10T20:41:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.225+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0813e270 con 0x7f2a0815ee50 2024-09-10T20:41:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.225+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0813e830 con 0x7f2a0815ee50 2024-09-10T20:41:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.226+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0806ead0 con 0x7f2a0815ee50 2024-09-10T20:41:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.227+0000 7f29fe000640 1 -- 172.21.15.81:0/3894542848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2a00004660 con 0x7f2a0815ee50 2024-09-10T20:41:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.228+0000 7f29fe000640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f29e8077f70 0x7f29e807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.228+0000 7f29fe000640 1 -- 172.21.15.81:0/3894542848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f2a000bb6b0 con 0x7f2a0815ee50 2024-09-10T20:41:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.229+0000 7f2a05e00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f29e8077f70 0x7f29e807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.229+0000 7f2a05e00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f29e8077f70 0x7f29e807a430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006fd0 tx=0x7f29f8008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:29.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.232+0000 7f29fe000640 1 -- 172.21.15.81:0/3894542848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2a00083e10 con 0x7f2a0815ee50 2024-09-10T20:41:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.487+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2a0815c9a0 con 0x7f2a0815ee50 2024-09-10T20:41:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.487+0000 7f29fe000640 1 -- 172.21.15.81:0/3894542848 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1501 (secure 0 0 0) 0x7f2a00083710 con 0x7f2a0815ee50 2024-09-10T20:41:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:29.493 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","health":{"status":"HEALTH_ERR","checks":{"FS_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"2 filesystems are degraded","count":2},"muted":false},"MDS_ALL_DOWN":{"severity":"HEALTH_ERR","summary":{"message":"2 filesystems are offline","count":2},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":122,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1726000780,"num_in_osds":8,"osd_in_since":1726000770,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":123},{"state_name":"creating+peering","count":6}],"num_pgs":129,"num_pools":4,"num_objects":4,"data_bytes":6881824,"bytes_used":239575040,"bytes_avail":772854538240,"bytes_total":773094113280,"inactive_pgs_ratio":0.046511627733707428,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":25,"btime":"2024-09-10T20:41:27:003995+0000","id":2,"up":0,"in":1,"max":1,"id":3,"up":0,"in":1,"max":1,"by_rank":[],"up:standby":4,"failed":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-10T20:40:47.858777+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-10T20:41:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f29e8077f70 msgr2=0x7f29e807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f29e8077f70 0x7f29e807a430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006fd0 tx=0x7f29f8008040 comp rx=0 tx=0).stop 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815ee50 msgr2=0x7f2a0813f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815ee50 0x7f2a0813f310 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2a00006010 tx=0x7f2a00003f10 comp rx=0 tx=0).stop 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 shutdown_connections 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f29e8077f70 0x7f29e807a430 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a0815ee50 0x7f2a0813f310 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2a0815d4e0 0x7f2a081e8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 --2- 172.21.15.81:0/3894542848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2a0806e660 0x7f2a080cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 >> 172.21.15.81:0/3894542848 conn(0x7f2a08068f90 msgr2=0x7f2a0815ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 shutdown_connections 2024-09-10T20:41:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.490+0000 7f2a0cc00640 1 -- 172.21.15.81:0/3894542848 wait complete. 2024-09-10T20:41:29.513 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-10T20:41:29.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 -- 172.21.15.81:0/2497101616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2006e660 msgr2=0x7f5f2006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 --2- 172.21.15.81:0/2497101616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2006e660 0x7f5f2006ead0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c005fd0 tx=0x7f5f0c02a620 comp rx=0 tx=0).stop 2024-09-10T20:41:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 -- 172.21.15.81:0/2497101616 shutdown_connections 2024-09-10T20:41:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 --2- 172.21.15.81:0/2497101616 >> v2:172.21.15.143:3300/0 conn(0x7f5f2015d4e0 0x7f5f2015d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 --2- 172.21.15.81:0/2497101616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2006e660 0x7f5f2006ead0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 -- 172.21.15.81:0/2497101616 >> 172.21.15.81:0/2497101616 conn(0x7f5f20068f90 msgr2=0x7f5f2006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 -- 172.21.15.81:0/2497101616 shutdown_connections 2024-09-10T20:41:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.664+0000 7f5f26200640 1 -- 172.21.15.81:0/2497101616 wait complete. 2024-09-10T20:41:29.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.666+0000 7f5f26200640 1 Processor -- start 2024-09-10T20:41:29.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.666+0000 7f5f26200640 1 -- start start 2024-09-10T20:41:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f26200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f2006e660 0x7f5f2013ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f26200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2015d4e0 0x7f5f20140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f26200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2015ee50 0x7f5f201f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f26200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f200ccd80 con 0x7f5f2015d4e0 2024-09-10T20:41:29.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f26200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2015f420 con 0x7f5f2015ee50 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f26200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2015deb0 con 0x7f5f2006e660 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f1ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2015d4e0 0x7f5f20140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f1ea00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2015d4e0 0x7f5f20140870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41272/0 (socket says 172.21.15.81:41272) 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f1ea00640 1 -- 172.21.15.81:0/2504204406 learned_addr learned my addr 172.21.15.81:0/2504204406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f1fe00640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2015ee50 0x7f5f201f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.667+0000 7f5f1f400640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f2006e660 0x7f5f2013ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f1ea00640 1 -- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f2006e660 msgr2=0x7f5f2013ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f1ea00640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f2006e660 0x7f5f2013ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f1ea00640 1 -- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2015ee50 msgr2=0x7f5f201f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f1ea00640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2015ee50 0x7f5f201f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f1ea00640 1 -- 172.21.15.81:0/2504204406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f20140db0 con 0x7f5f2015d4e0 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f1ea00640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2015d4e0 0x7f5f20140870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000c00 tx=0x7f5f0c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f17400640 1 -- 172.21.15.81:0/2504204406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c03f070 con 0x7f5f2015d4e0 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f17400640 1 -- 172.21.15.81:0/2504204406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f0c004cc0 con 0x7f5f2015d4e0 2024-09-10T20:41:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f17400640 1 -- 172.21.15.81:0/2504204406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c035030 con 0x7f5f2015d4e0 2024-09-10T20:41:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.668+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f201f6770 con 0x7f5f2015d4e0 2024-09-10T20:41:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.669+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f201568a0 con 0x7f5f2015d4e0 2024-09-10T20:41:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.670+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2006ead0 con 0x7f5f2015d4e0 2024-09-10T20:41:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.671+0000 7f5f17400640 1 -- 172.21.15.81:0/2504204406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5f0c004eb0 con 0x7f5f2015d4e0 2024-09-10T20:41:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.672+0000 7f5f17400640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5f00077f70 0x7f5f0007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.672+0000 7f5f17400640 1 -- 172.21.15.81:0/2504204406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6640+0+0 (secure 0 0 0) 0x7f5f0c0baf30 con 0x7f5f2015d4e0 2024-09-10T20:41:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.672+0000 7f5f1f400640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5f00077f70 0x7f5f0007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.673+0000 7f5f1f400640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5f00077f70 0x7f5f0007a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f10001ce0 tx=0x7f5f10009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.676+0000 7f5f17400640 1 -- 172.21.15.81:0/2504204406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f5f20140db0 con 0x7f5f2015d4e0 2024-09-10T20:41:29.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.862+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f20153200 con 0x7f5f00077f70 2024-09-10T20:41:29.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.868+0000 7f5f17400640 1 -- 172.21.15.81:0/2504204406 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332032 (secure 0 0 0) 0x7f5f20153200 con 0x7f5f00077f70 2024-09-10T20:41:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:29.879 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:29.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.872+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5f00077f70 msgr2=0x7f5f0007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5f00077f70 0x7f5f0007a430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f10001ce0 tx=0x7f5f10009040 comp rx=0 tx=0).stop 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2015d4e0 msgr2=0x7f5f20140870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2015d4e0 0x7f5f20140870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c000c00 tx=0x7f5f0c004430 comp rx=0 tx=0).stop 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 shutdown_connections 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5f00077f70 0x7f5f0007a430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f2015ee50 0x7f5f201f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2015d4e0 0x7f5f20140870 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 --2- 172.21.15.81:0/2504204406 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5f2006e660 0x7f5f2013ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 >> 172.21.15.81:0/2504204406 conn(0x7f5f20068f90 msgr2=0x7f5f2015c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 shutdown_connections 2024-09-10T20:41:29.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:29.873+0000 7f5f26200640 1 -- 172.21.15.81:0/2504204406 wait complete. 2024-09-10T20:41:29.893 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-10T20:41:27.868584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":203,"num_write_kb":7813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661,"ondisk_log_size":661,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233960,"kb_used_data":17708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740760,"statfs":{"total":773094113280,"available":772854538240,"internally_reserved":0,"allocated":18132992,"data_stored":15718463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.904965"},"pg_stats":[{"pgid":"6.3f","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002280+0000","last_change":"2024-09-10T20:40:57.808566+0000","last_active":"2024-09-10T20:41:25.002280+0000","last_peered":"2024-09-10T20:41:25.002280+0000","last_clean":"2024-09-10T20:41:25.002280+0000","last_became_active":"2024-09-10T20:40:57.808299+0000","last_became_peered":"2024-09-10T20:40:57.808299+0000","last_unstale":"2024-09-10T20:41:25.002280+0000","last_undegraded":"2024-09-10T20:41:25.002280+0000","last_fullsized":"2024-09-10T20:41:25.002280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:11.202752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.785246+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.784969+0000","last_became_peered":"2024-09-10T20:40:57.784969+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:26.513133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002056+0000","last_change":"2024-09-10T20:40:57.798413+0000","last_active":"2024-09-10T20:41:25.002056+0000","last_peered":"2024-09-10T20:41:25.002056+0000","last_clean":"2024-09-10T20:41:25.002056+0000","last_became_active":"2024-09-10T20:40:57.798085+0000","last_became_peered":"2024-09-10T20:40:57.798085+0000","last_unstale":"2024-09-10T20:41:25.002056+0000","last_undegraded":"2024-09-10T20:41:25.002056+0000","last_fullsized":"2024-09-10T20:41:25.002056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:33.904500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002674+0000","last_change":"2024-09-10T20:40:57.793918+0000","last_active":"2024-09-10T20:41:25.002674+0000","last_peered":"2024-09-10T20:41:25.002674+0000","last_clean":"2024-09-10T20:41:25.002674+0000","last_became_active":"2024-09-10T20:40:57.793335+0000","last_became_peered":"2024-09-10T20:40:57.793335+0000","last_unstale":"2024-09-10T20:41:25.002674+0000","last_undegraded":"2024-09-10T20:41:25.002674+0000","last_fullsized":"2024-09-10T20:41:25.002674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:12.740619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"40'4","reported_seq":30,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985310+0000","last_change":"2024-09-10T20:40:57.802056+0000","last_active":"2024-09-10T20:41:23.985310+0000","last_peered":"2024-09-10T20:41:23.985310+0000","last_clean":"2024-09-10T20:41:23.985310+0000","last_became_active":"2024-09-10T20:40:57.801252+0000","last_became_peered":"2024-09-10T20:40:57.801252+0000","last_unstale":"2024-09-10T20:41:23.985310+0000","last_undegraded":"2024-09-10T20:41:23.985310+0000","last_fullsized":"2024-09-10T20:41:23.985310+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:43.552747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295818+0000","last_change":"2024-09-10T20:40:57.781646+0000","last_active":"2024-09-10T20:41:25.295818+0000","last_peered":"2024-09-10T20:41:25.295818+0000","last_clean":"2024-09-10T20:41:25.295818+0000","last_became_active":"2024-09-10T20:40:57.781350+0000","last_became_peered":"2024-09-10T20:40:57.781350+0000","last_unstale":"2024-09-10T20:41:25.295818+0000","last_undegraded":"2024-09-10T20:41:25.295818+0000","last_fullsized":"2024-09-10T20:41:25.295818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.959912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001962+0000","last_change":"2024-09-10T20:40:57.797129+0000","last_active":"2024-09-10T20:41:25.001962+0000","last_peered":"2024-09-10T20:41:25.001962+0000","last_clean":"2024-09-10T20:41:25.001962+0000","last_became_active":"2024-09-10T20:40:57.796854+0000","last_became_peered":"2024-09-10T20:40:57.796854+0000","last_unstale":"2024-09-10T20:41:25.001962+0000","last_undegraded":"2024-09-10T20:41:25.001962+0000","last_fullsized":"2024-09-10T20:41:25.001962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:43.327598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001457+0000","last_change":"2024-09-10T20:40:57.808609+0000","last_active":"2024-09-10T20:41:25.001457+0000","last_peered":"2024-09-10T20:41:25.001457+0000","last_clean":"2024-09-10T20:41:25.001457+0000","last_became_active":"2024-09-10T20:40:57.807999+0000","last_became_peered":"2024-09-10T20:40:57.807999+0000","last_unstale":"2024-09-10T20:41:25.001457+0000","last_undegraded":"2024-09-10T20:41:25.001457+0000","last_fullsized":"2024-09-10T20:41:25.001457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"40'11","reported_seq":37,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987894+0000","last_change":"2024-09-10T20:40:57.802618+0000","last_active":"2024-09-10T20:41:23.987894+0000","last_peered":"2024-09-10T20:41:23.987894+0000","last_clean":"2024-09-10T20:41:23.987894+0000","last_became_active":"2024-09-10T20:40:57.801991+0000","last_became_peered":"2024-09-10T20:40:57.801991+0000","last_unstale":"2024-09-10T20:41:23.987894+0000","last_undegraded":"2024-09-10T20:41:23.987894+0000","last_fullsized":"2024-09-10T20:41:23.987894+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:57.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002527+0000","last_change":"2024-09-10T20:40:57.805178+0000","last_active":"2024-09-10T20:41:25.002527+0000","last_peered":"2024-09-10T20:41:25.002527+0000","last_clean":"2024-09-10T20:41:25.002527+0000","last_became_active":"2024-09-10T20:40:57.804919+0000","last_became_peered":"2024-09-10T20:40:57.804919+0000","last_unstale":"2024-09-10T20:41:25.002527+0000","last_undegraded":"2024-09-10T20:41:25.002527+0000","last_fullsized":"2024-09-10T20:41:25.002527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:34.267791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267431+0000","last_change":"2024-09-10T20:40:57.797147+0000","last_active":"2024-09-10T20:41:25.267431+0000","last_peered":"2024-09-10T20:41:25.267431+0000","last_clean":"2024-09-10T20:41:25.267431+0000","last_became_active":"2024-09-10T20:40:57.796910+0000","last_became_peered":"2024-09-10T20:40:57.796910+0000","last_unstale":"2024-09-10T20:41:25.267431+0000","last_undegraded":"2024-09-10T20:41:25.267431+0000","last_fullsized":"2024-09-10T20:41:25.267431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:43.015903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"40'7","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986521+0000","last_change":"2024-09-10T20:40:57.804510+0000","last_active":"2024-09-10T20:41:23.986521+0000","last_peered":"2024-09-10T20:41:23.986521+0000","last_clean":"2024-09-10T20:41:23.986521+0000","last_became_active":"2024-09-10T20:40:57.804220+0000","last_became_peered":"2024-09-10T20:40:57.804220+0000","last_unstale":"2024-09-10T20:41:23.986521+0000","last_undegraded":"2024-09-10T20:41:23.986521+0000","last_fullsized":"2024-09-10T20:41:23.986521+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:55.727449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002169+0000","last_change":"2024-09-10T20:40:57.795473+0000","last_active":"2024-09-10T20:41:25.002169+0000","last_peered":"2024-09-10T20:41:25.002169+0000","last_clean":"2024-09-10T20:41:25.002169+0000","last_became_active":"2024-09-10T20:40:57.795179+0000","last_became_peered":"2024-09-10T20:40:57.795179+0000","last_unstale":"2024-09-10T20:41:25.002169+0000","last_undegraded":"2024-09-10T20:41:25.002169+0000","last_fullsized":"2024-09-10T20:41:25.002169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"40'8","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991972+0000","last_change":"2024-09-10T20:40:57.801649+0000","last_active":"2024-09-10T20:41:23.991972+0000","last_peered":"2024-09-10T20:41:23.991972+0000","last_clean":"2024-09-10T20:41:23.991972+0000","last_became_active":"2024-09-10T20:40:57.797096+0000","last_became_peered":"2024-09-10T20:40:57.797096+0000","last_unstale":"2024-09-10T20:41:23.991972+0000","last_undegraded":"2024-09-10T20:41:23.991972+0000","last_fullsized":"2024-09-10T20:41:23.991972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:05.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023428+0000","last_change":"2024-09-10T20:40:57.779842+0000","last_active":"2024-09-10T20:41:25.023428+0000","last_peered":"2024-09-10T20:41:25.023428+0000","last_clean":"2024-09-10T20:41:25.023428+0000","last_became_active":"2024-09-10T20:40:57.779564+0000","last_became_peered":"2024-09-10T20:40:57.779564+0000","last_unstale":"2024-09-10T20:41:25.023428+0000","last_undegraded":"2024-09-10T20:41:25.023428+0000","last_fullsized":"2024-09-10T20:41:25.023428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:23.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001997+0000","last_change":"2024-09-10T20:40:57.806288+0000","last_active":"2024-09-10T20:41:25.001997+0000","last_peered":"2024-09-10T20:41:25.001997+0000","last_clean":"2024-09-10T20:41:25.001997+0000","last_became_active":"2024-09-10T20:40:57.804491+0000","last_became_peered":"2024-09-10T20:40:57.804491+0000","last_unstale":"2024-09-10T20:41:25.001997+0000","last_undegraded":"2024-09-10T20:41:25.001997+0000","last_fullsized":"2024-09-10T20:41:25.001997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:18.810090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024138+0000","last_change":"2024-09-10T20:40:57.781946+0000","last_active":"2024-09-10T20:41:25.024138+0000","last_peered":"2024-09-10T20:41:25.024138+0000","last_clean":"2024-09-10T20:41:25.024138+0000","last_became_active":"2024-09-10T20:40:57.781711+0000","last_became_peered":"2024-09-10T20:40:57.781711+0000","last_unstale":"2024-09-10T20:41:25.024138+0000","last_undegraded":"2024-09-10T20:41:25.024138+0000","last_fullsized":"2024-09-10T20:41:25.024138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:57.437327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023982+0000","last_change":"2024-09-10T20:40:57.781131+0000","last_active":"2024-09-10T20:41:25.023982+0000","last_peered":"2024-09-10T20:41:25.023982+0000","last_clean":"2024-09-10T20:41:25.023982+0000","last_became_active":"2024-09-10T20:40:57.780857+0000","last_became_peered":"2024-09-10T20:40:57.780857+0000","last_unstale":"2024-09-10T20:41:25.023982+0000","last_undegraded":"2024-09-10T20:41:25.023982+0000","last_fullsized":"2024-09-10T20:41:25.023982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:18.298699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972503+0000","last_change":"2024-09-10T20:40:57.799870+0000","last_active":"2024-09-10T20:41:22.972503+0000","last_peered":"2024-09-10T20:41:22.972503+0000","last_clean":"2024-09-10T20:41:22.972503+0000","last_became_active":"2024-09-10T20:40:57.799593+0000","last_became_peered":"2024-09-10T20:40:57.799593+0000","last_unstale":"2024-09-10T20:41:22.972503+0000","last_undegraded":"2024-09-10T20:41:22.972503+0000","last_fullsized":"2024-09-10T20:41:22.972503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:27.031641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267232+0000","last_change":"2024-09-10T20:40:57.788576+0000","last_active":"2024-09-10T20:41:25.267232+0000","last_peered":"2024-09-10T20:41:25.267232+0000","last_clean":"2024-09-10T20:41:25.267232+0000","last_became_active":"2024-09-10T20:40:57.788342+0000","last_became_peered":"2024-09-10T20:40:57.788342+0000","last_unstale":"2024-09-10T20:41:25.267232+0000","last_undegraded":"2024-09-10T20:41:25.267232+0000","last_fullsized":"2024-09-10T20:41:25.267232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:56.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"40'11","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267138+0000","last_change":"2024-09-10T20:40:57.797333+0000","last_active":"2024-09-10T20:41:25.267138+0000","last_peered":"2024-09-10T20:41:25.267138+0000","last_clean":"2024-09-10T20:41:25.267138+0000","last_became_active":"2024-09-10T20:40:57.794482+0000","last_became_peered":"2024-09-10T20:40:57.794482+0000","last_unstale":"2024-09-10T20:41:25.267138+0000","last_undegraded":"2024-09-10T20:41:25.267138+0000","last_fullsized":"2024-09-10T20:41:25.267138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:33.113187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267051+0000","last_change":"2024-09-10T20:40:57.785890+0000","last_active":"2024-09-10T20:41:25.267051+0000","last_peered":"2024-09-10T20:41:25.267051+0000","last_clean":"2024-09-10T20:41:25.267051+0000","last_became_active":"2024-09-10T20:40:57.785582+0000","last_became_peered":"2024-09-10T20:40:57.785582+0000","last_unstale":"2024-09-10T20:41:25.267051+0000","last_undegraded":"2024-09-10T20:41:25.267051+0000","last_fullsized":"2024-09-10T20:41:25.267051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:51.491322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023468+0000","last_change":"2024-09-10T20:40:57.786174+0000","last_active":"2024-09-10T20:41:25.023468+0000","last_peered":"2024-09-10T20:41:25.023468+0000","last_clean":"2024-09-10T20:41:25.023468+0000","last_became_active":"2024-09-10T20:40:57.785175+0000","last_became_peered":"2024-09-10T20:40:57.785175+0000","last_unstale":"2024-09-10T20:41:25.023468+0000","last_undegraded":"2024-09-10T20:41:25.023468+0000","last_fullsized":"2024-09-10T20:41:25.023468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:23.271959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001563+0000","last_change":"2024-09-10T20:40:57.808222+0000","last_active":"2024-09-10T20:41:25.001563+0000","last_peered":"2024-09-10T20:41:25.001563+0000","last_clean":"2024-09-10T20:41:25.001563+0000","last_became_active":"2024-09-10T20:40:57.807578+0000","last_became_peered":"2024-09-10T20:40:57.807578+0000","last_unstale":"2024-09-10T20:41:25.001563+0000","last_undegraded":"2024-09-10T20:41:25.001563+0000","last_fullsized":"2024-09-10T20:41:25.001563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:25.893234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"40'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995400+0000","last_change":"2024-09-10T20:40:57.803089+0000","last_active":"2024-09-10T20:41:23.995400+0000","last_peered":"2024-09-10T20:41:23.995400+0000","last_clean":"2024-09-10T20:41:23.995400+0000","last_became_active":"2024-09-10T20:40:57.802606+0000","last_became_peered":"2024-09-10T20:40:57.802606+0000","last_unstale":"2024-09-10T20:41:23.995400+0000","last_undegraded":"2024-09-10T20:41:23.995400+0000","last_fullsized":"2024-09-10T20:41:23.995400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002118+0000","last_change":"2024-09-10T20:40:57.804633+0000","last_active":"2024-09-10T20:41:25.002118+0000","last_peered":"2024-09-10T20:41:25.002118+0000","last_clean":"2024-09-10T20:41:25.002118+0000","last_became_active":"2024-09-10T20:40:57.804388+0000","last_became_peered":"2024-09-10T20:40:57.804388+0000","last_unstale":"2024-09-10T20:41:25.002118+0000","last_undegraded":"2024-09-10T20:41:25.002118+0000","last_fullsized":"2024-09-10T20:41:25.002118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:17.686400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267480+0000","last_change":"2024-09-10T20:40:57.790304+0000","last_active":"2024-09-10T20:41:25.267480+0000","last_peered":"2024-09-10T20:41:25.267480+0000","last_clean":"2024-09-10T20:41:25.267480+0000","last_became_active":"2024-09-10T20:40:57.790064+0000","last_became_peered":"2024-09-10T20:40:57.790064+0000","last_unstale":"2024-09-10T20:41:25.267480+0000","last_undegraded":"2024-09-10T20:41:25.267480+0000","last_fullsized":"2024-09-10T20:41:25.267480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:03.995020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002320+0000","last_change":"2024-09-10T20:40:57.811854+0000","last_active":"2024-09-10T20:41:25.002320+0000","last_peered":"2024-09-10T20:41:25.002320+0000","last_clean":"2024-09-10T20:41:25.002320+0000","last_became_active":"2024-09-10T20:40:57.811532+0000","last_became_peered":"2024-09-10T20:40:57.811532+0000","last_unstale":"2024-09-10T20:41:25.002320+0000","last_undegraded":"2024-09-10T20:41:25.002320+0000","last_fullsized":"2024-09-10T20:41:25.002320+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:39.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023478+0000","last_change":"2024-09-10T20:40:57.783995+0000","last_active":"2024-09-10T20:41:25.023478+0000","last_peered":"2024-09-10T20:41:25.023478+0000","last_clean":"2024-09-10T20:41:25.023478+0000","last_became_active":"2024-09-10T20:40:57.782195+0000","last_became_peered":"2024-09-10T20:40:57.782195+0000","last_unstale":"2024-09-10T20:41:25.023478+0000","last_undegraded":"2024-09-10T20:41:25.023478+0000","last_fullsized":"2024-09-10T20:41:25.023478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:53.576166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023603+0000","last_change":"2024-09-10T20:40:57.778945+0000","last_active":"2024-09-10T20:41:25.023603+0000","last_peered":"2024-09-10T20:41:25.023603+0000","last_clean":"2024-09-10T20:41:25.023603+0000","last_became_active":"2024-09-10T20:40:57.778659+0000","last_became_peered":"2024-09-10T20:40:57.778659+0000","last_unstale":"2024-09-10T20:41:25.023603+0000","last_undegraded":"2024-09-10T20:41:25.023603+0000","last_fullsized":"2024-09-10T20:41:25.023603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:42.767732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"40'12","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002065+0000","last_change":"2024-09-10T20:40:57.796477+0000","last_active":"2024-09-10T20:41:25.002065+0000","last_peered":"2024-09-10T20:41:25.002065+0000","last_clean":"2024-09-10T20:41:25.002065+0000","last_became_active":"2024-09-10T20:40:57.796191+0000","last_became_peered":"2024-09-10T20:40:57.796191+0000","last_unstale":"2024-09-10T20:41:25.002065+0000","last_undegraded":"2024-09-10T20:41:25.002065+0000","last_fullsized":"2024-09-10T20:41:25.002065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:00.682250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001687+0000","last_change":"2024-09-10T20:40:57.813103+0000","last_active":"2024-09-10T20:41:25.001687+0000","last_peered":"2024-09-10T20:41:25.001687+0000","last_clean":"2024-09-10T20:41:25.001687+0000","last_became_active":"2024-09-10T20:40:57.812863+0000","last_became_peered":"2024-09-10T20:40:57.812863+0000","last_unstale":"2024-09-10T20:41:25.001687+0000","last_undegraded":"2024-09-10T20:41:25.001687+0000","last_fullsized":"2024-09-10T20:41:25.001687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:03.255660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969555+0000","last_change":"2024-09-10T20:41:22.969555+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969555+0000","last_undegraded":"2024-09-10T20:41:22.969555+0000","last_fullsized":"2024-09-10T20:41:22.969555+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023852+0000","last_change":"2024-09-10T20:40:57.806845+0000","last_active":"2024-09-10T20:41:25.023852+0000","last_peered":"2024-09-10T20:41:25.023852+0000","last_clean":"2024-09-10T20:41:25.023852+0000","last_became_active":"2024-09-10T20:40:57.806562+0000","last_became_peered":"2024-09-10T20:40:57.806562+0000","last_unstale":"2024-09-10T20:41:25.023852+0000","last_undegraded":"2024-09-10T20:41:25.023852+0000","last_fullsized":"2024-09-10T20:41:25.023852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:32.177438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"44'8","reported_seq":36,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995550+0000","last_change":"2024-09-10T20:40:56.787360+0000","last_active":"2024-09-10T20:41:23.995550+0000","last_peered":"2024-09-10T20:41:23.995550+0000","last_clean":"2024-09-10T20:41:23.995550+0000","last_became_active":"2024-09-10T20:40:56.787113+0000","last_became_peered":"2024-09-10T20:40:56.787113+0000","last_unstale":"2024-09-10T20:41:23.995550+0000","last_undegraded":"2024-09-10T20:41:23.995550+0000","last_fullsized":"2024-09-10T20:41:23.995550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.999843+0000","last_change":"2024-09-10T20:41:23.997577+0000","last_active":"2024-09-10T20:41:23.999843+0000","last_peered":"2024-09-10T20:41:23.999843+0000","last_clean":"2024-09-10T20:41:23.999843+0000","last_became_active":"2024-09-10T20:41:23.997315+0000","last_became_peered":"2024-09-10T20:41:23.997315+0000","last_unstale":"2024-09-10T20:41:23.999843+0000","last_undegraded":"2024-09-10T20:41:23.999843+0000","last_fullsized":"2024-09-10T20:41:23.999843+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:37:49.348851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296022+0000","last_change":"2024-09-10T20:40:57.794642+0000","last_active":"2024-09-10T20:41:25.296022+0000","last_peered":"2024-09-10T20:41:25.296022+0000","last_clean":"2024-09-10T20:41:25.296022+0000","last_became_active":"2024-09-10T20:40:57.794432+0000","last_became_peered":"2024-09-10T20:40:57.794432+0000","last_unstale":"2024-09-10T20:41:25.296022+0000","last_undegraded":"2024-09-10T20:41:25.296022+0000","last_fullsized":"2024-09-10T20:41:25.296022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:59.893364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296194+0000","last_change":"2024-09-10T20:40:56.790001+0000","last_active":"2024-09-10T20:41:25.296194+0000","last_peered":"2024-09-10T20:41:25.296194+0000","last_clean":"2024-09-10T20:41:25.296194+0000","last_became_active":"2024-09-10T20:40:56.789708+0000","last_became_peered":"2024-09-10T20:40:56.789708+0000","last_unstale":"2024-09-10T20:41:25.296194+0000","last_undegraded":"2024-09-10T20:41:25.296194+0000","last_fullsized":"2024-09-10T20:41:25.296194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:56.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267602+0000","last_change":"2024-09-10T20:41:24.001301+0000","last_active":"2024-09-10T20:41:25.267602+0000","last_peered":"2024-09-10T20:41:25.267602+0000","last_clean":"2024-09-10T20:41:25.267602+0000","last_became_active":"2024-09-10T20:41:24.000986+0000","last_became_peered":"2024-09-10T20:41:24.000986+0000","last_unstale":"2024-09-10T20:41:25.267602+0000","last_undegraded":"2024-09-10T20:41:25.267602+0000","last_fullsized":"2024-09-10T20:41:25.267602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:45.971209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024106+0000","last_change":"2024-09-10T20:40:57.804223+0000","last_active":"2024-09-10T20:41:25.024106+0000","last_peered":"2024-09-10T20:41:25.024106+0000","last_clean":"2024-09-10T20:41:25.024106+0000","last_became_active":"2024-09-10T20:40:57.800934+0000","last_became_peered":"2024-09-10T20:40:57.800934+0000","last_unstale":"2024-09-10T20:41:25.024106+0000","last_undegraded":"2024-09-10T20:41:25.024106+0000","last_fullsized":"2024-09-10T20:41:25.024106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:43.140106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"44'3","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002486+0000","last_change":"2024-09-10T20:40:56.798617+0000","last_active":"2024-09-10T20:41:25.002486+0000","last_peered":"2024-09-10T20:41:25.002486+0000","last_clean":"2024-09-10T20:41:25.002486+0000","last_became_active":"2024-09-10T20:40:56.798233+0000","last_became_peered":"2024-09-10T20:40:56.798233+0000","last_unstale":"2024-09-10T20:41:25.002486+0000","last_undegraded":"2024-09-10T20:41:25.002486+0000","last_fullsized":"2024-09-10T20:41:25.002486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:55.548605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003712+0000","last_change":"2024-09-10T20:41:23.999098+0000","last_active":"2024-09-10T20:41:24.003712+0000","last_peered":"2024-09-10T20:41:24.003712+0000","last_clean":"2024-09-10T20:41:24.003712+0000","last_became_active":"2024-09-10T20:41:23.998720+0000","last_became_peered":"2024-09-10T20:41:23.998720+0000","last_unstale":"2024-09-10T20:41:24.003712+0000","last_undegraded":"2024-09-10T20:41:24.003712+0000","last_fullsized":"2024-09-10T20:41:24.003712+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:31.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296273+0000","last_change":"2024-09-10T20:40:57.790493+0000","last_active":"2024-09-10T20:41:25.296273+0000","last_peered":"2024-09-10T20:41:25.296273+0000","last_clean":"2024-09-10T20:41:25.296273+0000","last_became_active":"2024-09-10T20:40:57.789768+0000","last_became_peered":"2024-09-10T20:40:57.789768+0000","last_unstale":"2024-09-10T20:41:25.296273+0000","last_undegraded":"2024-09-10T20:41:25.296273+0000","last_fullsized":"2024-09-10T20:41:25.296273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.004069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"44'3","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995056+0000","last_change":"2024-09-10T20:40:56.798645+0000","last_active":"2024-09-10T20:41:23.995056+0000","last_peered":"2024-09-10T20:41:23.995056+0000","last_clean":"2024-09-10T20:41:23.995056+0000","last_became_active":"2024-09-10T20:40:56.798325+0000","last_became_peered":"2024-09-10T20:40:56.798325+0000","last_unstale":"2024-09-10T20:41:23.995056+0000","last_undegraded":"2024-09-10T20:41:23.995056+0000","last_fullsized":"2024-09-10T20:41:23.995056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:18.678416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023770+0000","last_change":"2024-09-10T20:41:23.999199+0000","last_active":"2024-09-10T20:41:25.023770+0000","last_peered":"2024-09-10T20:41:25.023770+0000","last_clean":"2024-09-10T20:41:25.023770+0000","last_became_active":"2024-09-10T20:41:23.998893+0000","last_became_peered":"2024-09-10T20:41:23.998893+0000","last_unstale":"2024-09-10T20:41:25.023770+0000","last_undegraded":"2024-09-10T20:41:25.023770+0000","last_fullsized":"2024-09-10T20:41:25.023770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.712353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001816+0000","last_change":"2024-09-10T20:40:57.792035+0000","last_active":"2024-09-10T20:41:25.001816+0000","last_peered":"2024-09-10T20:41:25.001816+0000","last_clean":"2024-09-10T20:41:25.001816+0000","last_became_active":"2024-09-10T20:40:57.791743+0000","last_became_peered":"2024-09-10T20:40:57.791743+0000","last_unstale":"2024-09-10T20:41:25.001816+0000","last_undegraded":"2024-09-10T20:41:25.001816+0000","last_fullsized":"2024-09-10T20:41:25.001816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:35.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995191+0000","last_change":"2024-09-10T20:40:56.778488+0000","last_active":"2024-09-10T20:41:23.995191+0000","last_peered":"2024-09-10T20:41:23.995191+0000","last_clean":"2024-09-10T20:41:23.995191+0000","last_became_active":"2024-09-10T20:40:56.778241+0000","last_became_peered":"2024-09-10T20:40:56.778241+0000","last_unstale":"2024-09-10T20:41:23.995191+0000","last_undegraded":"2024-09-10T20:41:23.995191+0000","last_fullsized":"2024-09-10T20:41:23.995191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002542+0000","last_change":"2024-09-10T20:41:23.996850+0000","last_active":"2024-09-10T20:41:25.002542+0000","last_peered":"2024-09-10T20:41:25.002542+0000","last_clean":"2024-09-10T20:41:25.002542+0000","last_became_active":"2024-09-10T20:41:23.996537+0000","last_became_peered":"2024-09-10T20:41:23.996537+0000","last_unstale":"2024-09-10T20:41:25.002542+0000","last_undegraded":"2024-09-10T20:41:25.002542+0000","last_fullsized":"2024-09-10T20:41:25.002542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:09.881621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267021+0000","last_change":"2024-09-10T20:40:57.787640+0000","last_active":"2024-09-10T20:41:25.267021+0000","last_peered":"2024-09-10T20:41:25.267021+0000","last_clean":"2024-09-10T20:41:25.267021+0000","last_became_active":"2024-09-10T20:40:57.787374+0000","last_became_peered":"2024-09-10T20:40:57.787374+0000","last_unstale":"2024-09-10T20:41:25.267021+0000","last_undegraded":"2024-09-10T20:41:25.267021+0000","last_fullsized":"2024-09-10T20:41:25.267021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.579080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002354+0000","last_change":"2024-09-10T20:40:56.799544+0000","last_active":"2024-09-10T20:41:25.002354+0000","last_peered":"2024-09-10T20:41:25.002354+0000","last_clean":"2024-09-10T20:41:25.002354+0000","last_became_active":"2024-09-10T20:40:56.799273+0000","last_became_peered":"2024-09-10T20:40:56.799273+0000","last_unstale":"2024-09-10T20:41:25.002354+0000","last_undegraded":"2024-09-10T20:41:25.002354+0000","last_fullsized":"2024-09-10T20:41:25.002354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:24.776937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001061+0000","last_change":"2024-09-10T20:41:24.000751+0000","last_active":"2024-09-10T20:41:25.001061+0000","last_peered":"2024-09-10T20:41:25.001061+0000","last_clean":"2024-09-10T20:41:25.001061+0000","last_became_active":"2024-09-10T20:41:24.000476+0000","last_became_peered":"2024-09-10T20:41:24.000476+0000","last_unstale":"2024-09-10T20:41:25.001061+0000","last_undegraded":"2024-09-10T20:41:25.001061+0000","last_fullsized":"2024-09-10T20:41:25.001061+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:50.959302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023652+0000","last_change":"2024-09-10T20:40:57.790412+0000","last_active":"2024-09-10T20:41:25.023652+0000","last_peered":"2024-09-10T20:41:25.023652+0000","last_clean":"2024-09-10T20:41:25.023652+0000","last_became_active":"2024-09-10T20:40:57.788308+0000","last_became_peered":"2024-09-10T20:40:57.788308+0000","last_unstale":"2024-09-10T20:41:25.023652+0000","last_undegraded":"2024-09-10T20:41:25.023652+0000","last_fullsized":"2024-09-10T20:41:25.023652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.492132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001391+0000","last_change":"2024-09-10T20:40:56.795211+0000","last_active":"2024-09-10T20:41:25.001391+0000","last_peered":"2024-09-10T20:41:25.001391+0000","last_clean":"2024-09-10T20:41:25.001391+0000","last_became_active":"2024-09-10T20:40:56.794869+0000","last_became_peered":"2024-09-10T20:40:56.794869+0000","last_unstale":"2024-09-10T20:41:25.001391+0000","last_undegraded":"2024-09-10T20:41:25.001391+0000","last_fullsized":"2024-09-10T20:41:25.001391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:54.724711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023595+0000","last_change":"2024-09-10T20:41:23.992976+0000","last_active":"2024-09-10T20:41:25.023595+0000","last_peered":"2024-09-10T20:41:25.023595+0000","last_clean":"2024-09-10T20:41:25.023595+0000","last_became_active":"2024-09-10T20:41:23.992286+0000","last_became_peered":"2024-09-10T20:41:23.992286+0000","last_unstale":"2024-09-10T20:41:25.023595+0000","last_undegraded":"2024-09-10T20:41:25.023595+0000","last_fullsized":"2024-09-10T20:41:25.023595+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:38.417982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.799569+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.799219+0000","last_became_peered":"2024-09-10T20:40:57.799219+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:29.475021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002246+0000","last_change":"2024-09-10T20:40:56.779639+0000","last_active":"2024-09-10T20:41:25.002246+0000","last_peered":"2024-09-10T20:41:25.002246+0000","last_clean":"2024-09-10T20:41:25.002246+0000","last_became_active":"2024-09-10T20:40:56.779311+0000","last_became_peered":"2024-09-10T20:40:56.779311+0000","last_unstale":"2024-09-10T20:41:25.002246+0000","last_undegraded":"2024-09-10T20:41:25.002246+0000","last_fullsized":"2024-09-10T20:41:25.002246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:39.771929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023992+0000","last_change":"2024-09-10T20:41:24.003499+0000","last_active":"2024-09-10T20:41:25.023992+0000","last_peered":"2024-09-10T20:41:25.023992+0000","last_clean":"2024-09-10T20:41:25.023992+0000","last_became_active":"2024-09-10T20:41:24.003230+0000","last_became_peered":"2024-09-10T20:41:24.003230+0000","last_unstale":"2024-09-10T20:41:25.023992+0000","last_undegraded":"2024-09-10T20:41:25.023992+0000","last_fullsized":"2024-09-10T20:41:25.023992+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:49.321950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'11","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002775+0000","last_change":"2024-09-10T20:40:57.793647+0000","last_active":"2024-09-10T20:41:25.002775+0000","last_peered":"2024-09-10T20:41:25.002775+0000","last_clean":"2024-09-10T20:41:25.002775+0000","last_became_active":"2024-09-10T20:40:57.792950+0000","last_became_peered":"2024-09-10T20:40:57.792950+0000","last_unstale":"2024-09-10T20:41:25.002775+0000","last_undegraded":"2024-09-10T20:41:25.002775+0000","last_fullsized":"2024-09-10T20:41:25.002775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:17.034966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002385+0000","last_change":"2024-09-10T20:40:56.799456+0000","last_active":"2024-09-10T20:41:25.002385+0000","last_peered":"2024-09-10T20:41:25.002385+0000","last_clean":"2024-09-10T20:41:25.002385+0000","last_became_active":"2024-09-10T20:40:56.799162+0000","last_became_peered":"2024-09-10T20:40:56.799162+0000","last_unstale":"2024-09-10T20:41:25.002385+0000","last_undegraded":"2024-09-10T20:41:25.002385+0000","last_fullsized":"2024-09-10T20:41:25.002385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:44.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969265+0000","last_change":"2024-09-10T20:41:22.969265+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969265+0000","last_undegraded":"2024-09-10T20:41:22.969265+0000","last_fullsized":"2024-09-10T20:41:22.969265+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'6","reported_seq":33,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995073+0000","last_change":"2024-09-10T20:40:57.802645+0000","last_active":"2024-09-10T20:41:23.995073+0000","last_peered":"2024-09-10T20:41:23.995073+0000","last_clean":"2024-09-10T20:41:23.995073+0000","last_became_active":"2024-09-10T20:40:57.802283+0000","last_became_peered":"2024-09-10T20:40:57.802283+0000","last_unstale":"2024-09-10T20:41:23.995073+0000","last_undegraded":"2024-09-10T20:41:23.995073+0000","last_fullsized":"2024-09-10T20:41:23.995073+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:17.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023984+0000","last_change":"2024-09-10T20:40:56.787551+0000","last_active":"2024-09-10T20:41:25.023984+0000","last_peered":"2024-09-10T20:41:25.023984+0000","last_clean":"2024-09-10T20:41:25.023984+0000","last_became_active":"2024-09-10T20:40:56.786720+0000","last_became_peered":"2024-09-10T20:40:56.786720+0000","last_unstale":"2024-09-10T20:41:25.023984+0000","last_undegraded":"2024-09-10T20:41:25.023984+0000","last_fullsized":"2024-09-10T20:41:25.023984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:58.890626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002375+0000","last_change":"2024-09-10T20:41:23.994183+0000","last_active":"2024-09-10T20:41:25.002375+0000","last_peered":"2024-09-10T20:41:25.002375+0000","last_clean":"2024-09-10T20:41:25.002375+0000","last_became_active":"2024-09-10T20:41:23.993219+0000","last_became_peered":"2024-09-10T20:41:23.993219+0000","last_unstale":"2024-09-10T20:41:25.002375+0000","last_undegraded":"2024-09-10T20:41:25.002375+0000","last_fullsized":"2024-09-10T20:41:25.002375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:55.786567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002227+0000","last_change":"2024-09-10T20:40:57.805104+0000","last_active":"2024-09-10T20:41:25.002227+0000","last_peered":"2024-09-10T20:41:25.002227+0000","last_clean":"2024-09-10T20:41:25.002227+0000","last_became_active":"2024-09-10T20:40:57.804894+0000","last_became_peered":"2024-09-10T20:40:57.804894+0000","last_unstale":"2024-09-10T20:41:25.002227+0000","last_undegraded":"2024-09-10T20:41:25.002227+0000","last_fullsized":"2024-09-10T20:41:25.002227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:02.247029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"44'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024048+0000","last_change":"2024-09-10T20:40:56.798785+0000","last_active":"2024-09-10T20:41:25.024048+0000","last_peered":"2024-09-10T20:41:25.024048+0000","last_clean":"2024-09-10T20:41:25.024048+0000","last_became_active":"2024-09-10T20:40:56.798390+0000","last_became_peered":"2024-09-10T20:40:56.798390+0000","last_unstale":"2024-09-10T20:41:25.024048+0000","last_undegraded":"2024-09-10T20:41:25.024048+0000","last_fullsized":"2024-09-10T20:41:25.024048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:39.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002349+0000","last_change":"2024-09-10T20:41:23.993848+0000","last_active":"2024-09-10T20:41:25.002349+0000","last_peered":"2024-09-10T20:41:25.002349+0000","last_clean":"2024-09-10T20:41:25.002349+0000","last_became_active":"2024-09-10T20:41:23.993558+0000","last_became_peered":"2024-09-10T20:41:23.993558+0000","last_unstale":"2024-09-10T20:41:25.002349+0000","last_undegraded":"2024-09-10T20:41:25.002349+0000","last_fullsized":"2024-09-10T20:41:25.002349+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:05.240195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002434+0000","last_change":"2024-09-10T20:40:57.807154+0000","last_active":"2024-09-10T20:41:25.002434+0000","last_peered":"2024-09-10T20:41:25.002434+0000","last_clean":"2024-09-10T20:41:25.002434+0000","last_became_active":"2024-09-10T20:40:57.806970+0000","last_became_peered":"2024-09-10T20:40:57.806970+0000","last_unstale":"2024-09-10T20:41:25.002434+0000","last_undegraded":"2024-09-10T20:41:25.002434+0000","last_fullsized":"2024-09-10T20:41:25.002434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:40.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"44'24","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002928+0000","last_change":"2024-09-10T20:40:56.798461+0000","last_active":"2024-09-10T20:41:25.002928+0000","last_peered":"2024-09-10T20:41:25.002928+0000","last_clean":"2024-09-10T20:41:25.002928+0000","last_became_active":"2024-09-10T20:40:56.798136+0000","last_became_peered":"2024-09-10T20:40:56.798136+0000","last_unstale":"2024-09-10T20:41:25.002928+0000","last_undegraded":"2024-09-10T20:41:25.002928+0000","last_fullsized":"2024-09-10T20:41:25.002928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:08.271880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.998155+0000","last_change":"2024-09-10T20:41:23.994788+0000","last_active":"2024-09-10T20:41:23.998155+0000","last_peered":"2024-09-10T20:41:23.998155+0000","last_clean":"2024-09-10T20:41:23.998155+0000","last_became_active":"2024-09-10T20:41:23.994527+0000","last_became_peered":"2024-09-10T20:41:23.994527+0000","last_unstale":"2024-09-10T20:41:23.998155+0000","last_undegraded":"2024-09-10T20:41:23.998155+0000","last_fullsized":"2024-09-10T20:41:23.998155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001987+0000","last_change":"2024-09-10T20:40:57.800593+0000","last_active":"2024-09-10T20:41:25.001987+0000","last_peered":"2024-09-10T20:41:25.001987+0000","last_clean":"2024-09-10T20:41:25.001987+0000","last_became_active":"2024-09-10T20:40:57.796067+0000","last_became_peered":"2024-09-10T20:40:57.796067+0000","last_unstale":"2024-09-10T20:41:25.001987+0000","last_undegraded":"2024-09-10T20:41:25.001987+0000","last_fullsized":"2024-09-10T20:41:25.001987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:13.660313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"44'5","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001700+0000","last_change":"2024-09-10T20:40:56.798892+0000","last_active":"2024-09-10T20:41:25.001700+0000","last_peered":"2024-09-10T20:41:25.001700+0000","last_clean":"2024-09-10T20:41:25.001700+0000","last_became_active":"2024-09-10T20:40:56.798574+0000","last_became_peered":"2024-09-10T20:40:56.798574+0000","last_unstale":"2024-09-10T20:41:25.001700+0000","last_undegraded":"2024-09-10T20:41:25.001700+0000","last_fullsized":"2024-09-10T20:41:25.001700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:12.809899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003719+0000","last_change":"2024-09-10T20:41:23.997814+0000","last_active":"2024-09-10T20:41:24.003719+0000","last_peered":"2024-09-10T20:41:24.003719+0000","last_clean":"2024-09-10T20:41:24.003719+0000","last_became_active":"2024-09-10T20:41:23.997261+0000","last_became_peered":"2024-09-10T20:41:23.997261+0000","last_unstale":"2024-09-10T20:41:24.003719+0000","last_undegraded":"2024-09-10T20:41:24.003719+0000","last_fullsized":"2024-09-10T20:41:24.003719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:33.403127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295687+0000","last_change":"2024-09-10T20:40:57.789344+0000","last_active":"2024-09-10T20:41:25.295687+0000","last_peered":"2024-09-10T20:41:25.295687+0000","last_clean":"2024-09-10T20:41:25.295687+0000","last_became_active":"2024-09-10T20:40:57.789092+0000","last_became_peered":"2024-09-10T20:40:57.789092+0000","last_unstale":"2024-09-10T20:41:25.295687+0000","last_undegraded":"2024-09-10T20:41:25.295687+0000","last_fullsized":"2024-09-10T20:41:25.295687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.377370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295848+0000","last_change":"2024-09-10T20:40:56.787899+0000","last_active":"2024-09-10T20:41:25.295848+0000","last_peered":"2024-09-10T20:41:25.295848+0000","last_clean":"2024-09-10T20:41:25.295848+0000","last_became_active":"2024-09-10T20:40:56.787509+0000","last_became_peered":"2024-09-10T20:40:56.787509+0000","last_unstale":"2024-09-10T20:41:25.295848+0000","last_undegraded":"2024-09-10T20:41:25.295848+0000","last_fullsized":"2024-09-10T20:41:25.295848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.249527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.995941+0000","last_change":"2024-09-10T20:41:23.993761+0000","last_active":"2024-09-10T20:41:23.995941+0000","last_peered":"2024-09-10T20:41:23.995941+0000","last_clean":"2024-09-10T20:41:23.995941+0000","last_became_active":"2024-09-10T20:41:23.993477+0000","last_became_peered":"2024-09-10T20:41:23.993477+0000","last_unstale":"2024-09-10T20:41:23.995941+0000","last_undegraded":"2024-09-10T20:41:23.995941+0000","last_fullsized":"2024-09-10T20:41:23.995941+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:35.482106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267196+0000","last_change":"2024-09-10T20:40:57.786588+0000","last_active":"2024-09-10T20:41:25.267196+0000","last_peered":"2024-09-10T20:41:25.267196+0000","last_clean":"2024-09-10T20:41:25.267196+0000","last_became_active":"2024-09-10T20:40:57.786296+0000","last_became_peered":"2024-09-10T20:40:57.786296+0000","last_unstale":"2024-09-10T20:41:25.267196+0000","last_undegraded":"2024-09-10T20:41:25.267196+0000","last_fullsized":"2024-09-10T20:41:25.267196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:36.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023573+0000","last_change":"2024-09-10T20:40:56.783758+0000","last_active":"2024-09-10T20:41:25.023573+0000","last_peered":"2024-09-10T20:41:25.023573+0000","last_clean":"2024-09-10T20:41:25.023573+0000","last_became_active":"2024-09-10T20:40:56.783512+0000","last_became_peered":"2024-09-10T20:40:56.783512+0000","last_unstale":"2024-09-10T20:41:25.023573+0000","last_undegraded":"2024-09-10T20:41:25.023573+0000","last_fullsized":"2024-09-10T20:41:25.023573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:39.374632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002192+0000","last_change":"2024-09-10T20:41:24.000925+0000","last_active":"2024-09-10T20:41:25.002192+0000","last_peered":"2024-09-10T20:41:25.002192+0000","last_clean":"2024-09-10T20:41:25.002192+0000","last_became_active":"2024-09-10T20:41:23.999216+0000","last_became_peered":"2024-09-10T20:41:23.999216+0000","last_unstale":"2024-09-10T20:41:25.002192+0000","last_undegraded":"2024-09-10T20:41:25.002192+0000","last_fullsized":"2024-09-10T20:41:25.002192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:36.479766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'15","reported_seq":41,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.985588+0000","last_change":"2024-09-10T20:40:57.801745+0000","last_active":"2024-09-10T20:41:23.985588+0000","last_peered":"2024-09-10T20:41:23.985588+0000","last_clean":"2024-09-10T20:41:23.985588+0000","last_became_active":"2024-09-10T20:40:57.801484+0000","last_became_peered":"2024-09-10T20:40:57.801484+0000","last_unstale":"2024-09-10T20:41:23.985588+0000","last_undegraded":"2024-09-10T20:41:23.985588+0000","last_fullsized":"2024-09-10T20:41:23.985588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:10.503000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"44'15","reported_seq":43,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.991869+0000","last_change":"2024-09-10T20:40:56.779692+0000","last_active":"2024-09-10T20:41:23.991869+0000","last_peered":"2024-09-10T20:41:23.991869+0000","last_clean":"2024-09-10T20:41:23.991869+0000","last_became_active":"2024-09-10T20:40:56.779447+0000","last_became_peered":"2024-09-10T20:40:56.779447+0000","last_unstale":"2024-09-10T20:41:23.991869+0000","last_undegraded":"2024-09-10T20:41:23.991869+0000","last_fullsized":"2024-09-10T20:41:23.991869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:15.261201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002291+0000","last_change":"2024-09-10T20:41:23.999605+0000","last_active":"2024-09-10T20:41:25.002291+0000","last_peered":"2024-09-10T20:41:25.002291+0000","last_clean":"2024-09-10T20:41:25.002291+0000","last_became_active":"2024-09-10T20:41:23.998539+0000","last_became_peered":"2024-09-10T20:41:23.998539+0000","last_unstale":"2024-09-10T20:41:25.002291+0000","last_undegraded":"2024-09-10T20:41:25.002291+0000","last_fullsized":"2024-09-10T20:41:25.002291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:26.825035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295947+0000","last_change":"2024-09-10T20:40:57.795777+0000","last_active":"2024-09-10T20:41:25.295947+0000","last_peered":"2024-09-10T20:41:25.295947+0000","last_clean":"2024-09-10T20:41:25.295947+0000","last_became_active":"2024-09-10T20:40:57.795521+0000","last_became_peered":"2024-09-10T20:40:57.795521+0000","last_unstale":"2024-09-10T20:41:25.295947+0000","last_undegraded":"2024-09-10T20:41:25.295947+0000","last_fullsized":"2024-09-10T20:41:25.295947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:15.958954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"44'2","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002456+0000","last_change":"2024-09-10T20:40:56.792708+0000","last_active":"2024-09-10T20:41:25.002456+0000","last_peered":"2024-09-10T20:41:25.002456+0000","last_clean":"2024-09-10T20:41:25.002456+0000","last_became_active":"2024-09-10T20:40:56.792427+0000","last_became_peered":"2024-09-10T20:40:56.792427+0000","last_unstale":"2024-09-10T20:41:25.002456+0000","last_undegraded":"2024-09-10T20:41:25.002456+0000","last_fullsized":"2024-09-10T20:41:25.002456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:40.781428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.008364+0000","last_change":"2024-09-10T20:41:24.005055+0000","last_active":"2024-09-10T20:41:24.008364+0000","last_peered":"2024-09-10T20:41:24.008364+0000","last_clean":"2024-09-10T20:41:24.008364+0000","last_became_active":"2024-09-10T20:41:24.004760+0000","last_became_peered":"2024-09-10T20:41:24.004760+0000","last_unstale":"2024-09-10T20:41:24.008364+0000","last_undegraded":"2024-09-10T20:41:24.008364+0000","last_fullsized":"2024-09-10T20:41:24.008364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:40.817136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002465+0000","last_change":"2024-09-10T20:40:57.805292+0000","last_active":"2024-09-10T20:41:25.002465+0000","last_peered":"2024-09-10T20:41:25.002465+0000","last_clean":"2024-09-10T20:41:25.002465+0000","last_became_active":"2024-09-10T20:40:57.804999+0000","last_became_peered":"2024-09-10T20:40:57.804999+0000","last_unstale":"2024-09-10T20:41:25.002465+0000","last_undegraded":"2024-09-10T20:41:25.002465+0000","last_fullsized":"2024-09-10T20:41:25.002465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:56.651005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024199+0000","last_change":"2024-09-10T20:40:56.798769+0000","last_active":"2024-09-10T20:41:25.024199+0000","last_peered":"2024-09-10T20:41:25.024199+0000","last_clean":"2024-09-10T20:41:25.024199+0000","last_became_active":"2024-09-10T20:40:56.798317+0000","last_became_peered":"2024-09-10T20:40:56.798317+0000","last_unstale":"2024-09-10T20:41:25.024199+0000","last_undegraded":"2024-09-10T20:41:25.024199+0000","last_fullsized":"2024-09-10T20:41:25.024199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:25.510395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003862+0000","last_change":"2024-09-10T20:41:23.999829+0000","last_active":"2024-09-10T20:41:24.003862+0000","last_peered":"2024-09-10T20:41:24.003862+0000","last_clean":"2024-09-10T20:41:24.003862+0000","last_became_active":"2024-09-10T20:41:23.999579+0000","last_became_peered":"2024-09-10T20:41:23.999579+0000","last_unstale":"2024-09-10T20:41:24.003862+0000","last_undegraded":"2024-09-10T20:41:24.003862+0000","last_fullsized":"2024-09-10T20:41:24.003862+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:13.342757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002530+0000","last_change":"2024-09-10T20:40:57.795506+0000","last_active":"2024-09-10T20:41:25.002530+0000","last_peered":"2024-09-10T20:41:25.002530+0000","last_clean":"2024-09-10T20:41:25.002530+0000","last_became_active":"2024-09-10T20:40:57.795238+0000","last_became_peered":"2024-09-10T20:40:57.795238+0000","last_unstale":"2024-09-10T20:41:25.002530+0000","last_undegraded":"2024-09-10T20:41:25.002530+0000","last_fullsized":"2024-09-10T20:41:25.002530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"44'2","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986466+0000","last_change":"2024-09-10T20:40:56.792843+0000","last_active":"2024-09-10T20:41:23.986466+0000","last_peered":"2024-09-10T20:41:23.986466+0000","last_clean":"2024-09-10T20:41:23.986466+0000","last_became_active":"2024-09-10T20:40:56.792439+0000","last_became_peered":"2024-09-10T20:40:56.792439+0000","last_unstale":"2024-09-10T20:41:23.986466+0000","last_undegraded":"2024-09-10T20:41:23.986466+0000","last_fullsized":"2024-09-10T20:41:23.986466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:49.054542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.003682+0000","last_change":"2024-09-10T20:41:23.997742+0000","last_active":"2024-09-10T20:41:24.003682+0000","last_peered":"2024-09-10T20:41:24.003682+0000","last_clean":"2024-09-10T20:41:24.003682+0000","last_became_active":"2024-09-10T20:41:23.997137+0000","last_became_peered":"2024-09-10T20:41:23.997137+0000","last_unstale":"2024-09-10T20:41:24.003682+0000","last_undegraded":"2024-09-10T20:41:24.003682+0000","last_fullsized":"2024-09-10T20:41:24.003682+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:12.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'9","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972839+0000","last_change":"2024-09-10T20:40:57.798663+0000","last_active":"2024-09-10T20:41:22.972839+0000","last_peered":"2024-09-10T20:41:22.972839+0000","last_clean":"2024-09-10T20:41:22.972839+0000","last_became_active":"2024-09-10T20:40:57.798333+0000","last_became_peered":"2024-09-10T20:40:57.798333+0000","last_unstale":"2024-09-10T20:41:22.972839+0000","last_undegraded":"2024-09-10T20:41:22.972839+0000","last_fullsized":"2024-09-10T20:41:22.972839+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:22.259106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972259+0000","last_change":"2024-09-10T20:40:56.789841+0000","last_active":"2024-09-10T20:41:22.972259+0000","last_peered":"2024-09-10T20:41:22.972259+0000","last_clean":"2024-09-10T20:41:22.972259+0000","last_became_active":"2024-09-10T20:40:56.789524+0000","last_became_peered":"2024-09-10T20:40:56.789524+0000","last_unstale":"2024-09-10T20:41:22.972259+0000","last_undegraded":"2024-09-10T20:41:22.972259+0000","last_fullsized":"2024-09-10T20:41:22.972259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:06.139874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969239+0000","last_change":"2024-09-10T20:41:22.969239+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969239+0000","last_undegraded":"2024-09-10T20:41:22.969239+0000","last_fullsized":"2024-09-10T20:41:22.969239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023403+0000","last_change":"2024-09-10T20:40:57.779901+0000","last_active":"2024-09-10T20:41:25.023403+0000","last_peered":"2024-09-10T20:41:25.023403+0000","last_clean":"2024-09-10T20:41:25.023403+0000","last_became_active":"2024-09-10T20:40:57.779489+0000","last_became_peered":"2024-09-10T20:40:57.779489+0000","last_unstale":"2024-09-10T20:41:25.023403+0000","last_undegraded":"2024-09-10T20:41:25.023403+0000","last_fullsized":"2024-09-10T20:41:25.023403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.265123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"44'4","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.971719+0000","last_change":"2024-09-10T20:40:56.787107+0000","last_active":"2024-09-10T20:41:22.971719+0000","last_peered":"2024-09-10T20:41:22.971719+0000","last_clean":"2024-09-10T20:41:22.971719+0000","last_became_active":"2024-09-10T20:40:56.786778+0000","last_became_peered":"2024-09-10T20:40:56.786778+0000","last_unstale":"2024-09-10T20:41:22.971719+0000","last_undegraded":"2024-09-10T20:41:22.971719+0000","last_fullsized":"2024-09-10T20:41:22.971719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:21.098826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.969341+0000","last_change":"2024-09-10T20:41:22.969341+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.969341+0000","last_undegraded":"2024-09-10T20:41:22.969341+0000","last_fullsized":"2024-09-10T20:41:22.969341+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"40'2","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001262+0000","last_change":"2024-09-10T20:40:57.805036+0000","last_active":"2024-09-10T20:41:25.001262+0000","last_peered":"2024-09-10T20:41:25.001262+0000","last_clean":"2024-09-10T20:41:25.001262+0000","last_became_active":"2024-09-10T20:40:57.804826+0000","last_became_peered":"2024-09-10T20:40:57.804826+0000","last_unstale":"2024-09-10T20:41:25.001262+0000","last_undegraded":"2024-09-10T20:41:25.001262+0000","last_fullsized":"2024-09-10T20:41:25.001262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:26.742701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295936+0000","last_change":"2024-09-10T20:40:56.792580+0000","last_active":"2024-09-10T20:41:25.295936+0000","last_peered":"2024-09-10T20:41:25.295936+0000","last_clean":"2024-09-10T20:41:25.295936+0000","last_became_active":"2024-09-10T20:40:56.792296+0000","last_became_peered":"2024-09-10T20:40:56.792296+0000","last_unstale":"2024-09-10T20:41:25.295936+0000","last_undegraded":"2024-09-10T20:41:25.295936+0000","last_fullsized":"2024-09-10T20:41:25.295936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:34.728794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295921+0000","last_change":"2024-09-10T20:41:23.999776+0000","last_active":"2024-09-10T20:41:25.295921+0000","last_peered":"2024-09-10T20:41:25.295921+0000","last_clean":"2024-09-10T20:41:25.295921+0000","last_became_active":"2024-09-10T20:41:23.999315+0000","last_became_peered":"2024-09-10T20:41:23.999315+0000","last_unstale":"2024-09-10T20:41:25.295921+0000","last_undegraded":"2024-09-10T20:41:25.295921+0000","last_fullsized":"2024-09-10T20:41:25.295921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:22.338151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267170+0000","last_change":"2024-09-10T20:40:57.798757+0000","last_active":"2024-09-10T20:41:25.267170+0000","last_peered":"2024-09-10T20:41:25.267170+0000","last_clean":"2024-09-10T20:41:25.267170+0000","last_became_active":"2024-09-10T20:40:57.796635+0000","last_became_peered":"2024-09-10T20:40:57.796635+0000","last_unstale":"2024-09-10T20:41:25.267170+0000","last_undegraded":"2024-09-10T20:41:25.267170+0000","last_fullsized":"2024-09-10T20:41:25.267170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:19.855245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002083+0000","last_change":"2024-09-10T20:40:56.779612+0000","last_active":"2024-09-10T20:41:25.002083+0000","last_peered":"2024-09-10T20:41:25.002083+0000","last_clean":"2024-09-10T20:41:25.002083+0000","last_became_active":"2024-09-10T20:40:56.779319+0000","last_became_peered":"2024-09-10T20:40:56.779319+0000","last_unstale":"2024-09-10T20:41:25.002083+0000","last_undegraded":"2024-09-10T20:41:25.002083+0000","last_fullsized":"2024-09-10T20:41:25.002083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:20.129458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001203+0000","last_change":"2024-09-10T20:41:24.002621+0000","last_active":"2024-09-10T20:41:25.001203+0000","last_peered":"2024-09-10T20:41:25.001203+0000","last_clean":"2024-09-10T20:41:25.001203+0000","last_became_active":"2024-09-10T20:41:24.001969+0000","last_became_peered":"2024-09-10T20:41:24.001969+0000","last_unstale":"2024-09-10T20:41:25.001203+0000","last_undegraded":"2024-09-10T20:41:25.001203+0000","last_fullsized":"2024-09-10T20:41:25.001203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:38.113389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001137+0000","last_change":"2024-09-10T20:40:57.794987+0000","last_active":"2024-09-10T20:41:25.001137+0000","last_peered":"2024-09-10T20:41:25.001137+0000","last_clean":"2024-09-10T20:41:25.001137+0000","last_became_active":"2024-09-10T20:40:57.794701+0000","last_became_peered":"2024-09-10T20:40:57.794701+0000","last_unstale":"2024-09-10T20:41:25.001137+0000","last_undegraded":"2024-09-10T20:41:25.001137+0000","last_fullsized":"2024-09-10T20:41:25.001137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:35.070564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295553+0000","last_change":"2024-09-10T20:40:56.796619+0000","last_active":"2024-09-10T20:41:25.295553+0000","last_peered":"2024-09-10T20:41:25.295553+0000","last_clean":"2024-09-10T20:41:25.295553+0000","last_became_active":"2024-09-10T20:40:56.796334+0000","last_became_peered":"2024-09-10T20:40:56.796334+0000","last_unstale":"2024-09-10T20:41:25.295553+0000","last_undegraded":"2024-09-10T20:41:25.295553+0000","last_fullsized":"2024-09-10T20:41:25.295553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:18.035879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024094+0000","last_change":"2024-09-10T20:41:24.002545+0000","last_active":"2024-09-10T20:41:25.024094+0000","last_peered":"2024-09-10T20:41:25.024094+0000","last_clean":"2024-09-10T20:41:25.024094+0000","last_became_active":"2024-09-10T20:41:24.002269+0000","last_became_peered":"2024-09-10T20:41:24.002269+0000","last_unstale":"2024-09-10T20:41:25.024094+0000","last_undegraded":"2024-09-10T20:41:25.024094+0000","last_fullsized":"2024-09-10T20:41:25.024094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:29.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"40'9","reported_seq":35,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987145+0000","last_change":"2024-09-10T20:40:57.797064+0000","last_active":"2024-09-10T20:41:23.987145+0000","last_peered":"2024-09-10T20:41:23.987145+0000","last_clean":"2024-09-10T20:41:23.987145+0000","last_became_active":"2024-09-10T20:40:57.796778+0000","last_became_peered":"2024-09-10T20:40:57.796778+0000","last_unstale":"2024-09-10T20:41:23.987145+0000","last_undegraded":"2024-09-10T20:41:23.987145+0000","last_fullsized":"2024-09-10T20:41:23.987145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:13.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024157+0000","last_change":"2024-09-10T20:40:56.781802+0000","last_active":"2024-09-10T20:41:25.024157+0000","last_peered":"2024-09-10T20:41:25.024157+0000","last_clean":"2024-09-10T20:41:25.024157+0000","last_became_active":"2024-09-10T20:40:56.781430+0000","last_became_peered":"2024-09-10T20:40:56.781430+0000","last_unstale":"2024-09-10T20:41:25.024157+0000","last_undegraded":"2024-09-10T20:41:25.024157+0000","last_fullsized":"2024-09-10T20:41:25.024157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:52.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002451+0000","last_change":"2024-09-10T20:41:23.999122+0000","last_active":"2024-09-10T20:41:25.002451+0000","last_peered":"2024-09-10T20:41:25.002451+0000","last_clean":"2024-09-10T20:41:25.002451+0000","last_became_active":"2024-09-10T20:41:23.996737+0000","last_became_peered":"2024-09-10T20:41:23.996737+0000","last_unstale":"2024-09-10T20:41:25.002451+0000","last_undegraded":"2024-09-10T20:41:25.002451+0000","last_fullsized":"2024-09-10T20:41:25.002451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:04.584893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267543+0000","last_change":"2024-09-10T20:40:57.797088+0000","last_active":"2024-09-10T20:41:25.267543+0000","last_peered":"2024-09-10T20:41:25.267543+0000","last_clean":"2024-09-10T20:41:25.267543+0000","last_became_active":"2024-09-10T20:40:57.796516+0000","last_became_peered":"2024-09-10T20:40:57.796516+0000","last_unstale":"2024-09-10T20:41:25.267543+0000","last_undegraded":"2024-09-10T20:41:25.267543+0000","last_fullsized":"2024-09-10T20:41:25.267543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:23.886368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"44'5","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.987209+0000","last_change":"2024-09-10T20:40:56.792746+0000","last_active":"2024-09-10T20:41:23.987209+0000","last_peered":"2024-09-10T20:41:23.987209+0000","last_clean":"2024-09-10T20:41:23.987209+0000","last_became_active":"2024-09-10T20:40:56.792409+0000","last_became_peered":"2024-09-10T20:40:56.792409+0000","last_unstale":"2024-09-10T20:41:23.987209+0000","last_undegraded":"2024-09-10T20:41:23.987209+0000","last_fullsized":"2024-09-10T20:41:23.987209+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:11.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024072+0000","last_change":"2024-09-10T20:41:24.001797+0000","last_active":"2024-09-10T20:41:25.024072+0000","last_peered":"2024-09-10T20:41:25.024072+0000","last_clean":"2024-09-10T20:41:25.024072+0000","last_became_active":"2024-09-10T20:41:24.001549+0000","last_became_peered":"2024-09-10T20:41:24.001549+0000","last_unstale":"2024-09-10T20:41:25.024072+0000","last_undegraded":"2024-09-10T20:41:25.024072+0000","last_fullsized":"2024-09-10T20:41:25.024072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:51.657538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"40'7","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-10T20:41:22.972657+0000","last_change":"2024-09-10T20:40:57.780255+0000","last_active":"2024-09-10T20:41:22.972657+0000","last_peered":"2024-09-10T20:41:22.972657+0000","last_clean":"2024-09-10T20:41:22.972657+0000","last_became_active":"2024-09-10T20:40:57.779962+0000","last_became_peered":"2024-09-10T20:40:57.779962+0000","last_unstale":"2024-09-10T20:41:22.972657+0000","last_undegraded":"2024-09-10T20:41:22.972657+0000","last_fullsized":"2024-09-10T20:41:22.972657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:32.285607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.986598+0000","last_change":"2024-09-10T20:40:56.800962+0000","last_active":"2024-09-10T20:41:23.986598+0000","last_peered":"2024-09-10T20:41:23.986598+0000","last_clean":"2024-09-10T20:41:23.986598+0000","last_became_active":"2024-09-10T20:40:56.800727+0000","last_became_peered":"2024-09-10T20:40:56.800727+0000","last_unstale":"2024-09-10T20:41:23.986598+0000","last_undegraded":"2024-09-10T20:41:23.986598+0000","last_fullsized":"2024-09-10T20:41:23.986598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:52.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:24.005439+0000","last_change":"2024-09-10T20:41:24.001291+0000","last_active":"2024-09-10T20:41:24.005439+0000","last_peered":"2024-09-10T20:41:24.005439+0000","last_clean":"2024-09-10T20:41:24.005439+0000","last_became_active":"2024-09-10T20:41:24.000871+0000","last_became_peered":"2024-09-10T20:41:24.000871+0000","last_unstale":"2024-09-10T20:41:24.005439+0000","last_undegraded":"2024-09-10T20:41:24.005439+0000","last_fullsized":"2024-09-10T20:41:24.005439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:45.607883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"40'8","reported_seq":34,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-10T20:41:23.984817+0000","last_change":"2024-09-10T20:40:57.793540+0000","last_active":"2024-09-10T20:41:23.984817+0000","last_peered":"2024-09-10T20:41:23.984817+0000","last_clean":"2024-09-10T20:41:23.984817+0000","last_became_active":"2024-09-10T20:40:57.793231+0000","last_became_peered":"2024-09-10T20:40:57.793231+0000","last_unstale":"2024-09-10T20:41:23.984817+0000","last_undegraded":"2024-09-10T20:41:23.984817+0000","last_fullsized":"2024-09-10T20:41:23.984817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:43.458885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001847+0000","last_change":"2024-09-10T20:40:56.795661+0000","last_active":"2024-09-10T20:41:25.001847+0000","last_peered":"2024-09-10T20:41:25.001847+0000","last_clean":"2024-09-10T20:41:25.001847+0000","last_became_active":"2024-09-10T20:40:56.794893+0000","last_became_peered":"2024-09-10T20:40:56.794893+0000","last_unstale":"2024-09-10T20:41:25.001847+0000","last_undegraded":"2024-09-10T20:41:25.001847+0000","last_fullsized":"2024-09-10T20:41:25.001847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:56.476490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001972+0000","last_change":"2024-09-10T20:41:23.999188+0000","last_active":"2024-09-10T20:41:25.001972+0000","last_peered":"2024-09-10T20:41:25.001972+0000","last_clean":"2024-09-10T20:41:25.001972+0000","last_became_active":"2024-09-10T20:41:23.998882+0000","last_became_peered":"2024-09-10T20:41:23.998882+0000","last_unstale":"2024-09-10T20:41:25.001972+0000","last_undegraded":"2024-09-10T20:41:25.001972+0000","last_fullsized":"2024-09-10T20:41:25.001972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:06.148067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295734+0000","last_change":"2024-09-10T20:40:57.777674+0000","last_active":"2024-09-10T20:41:25.295734+0000","last_peered":"2024-09-10T20:41:25.295734+0000","last_clean":"2024-09-10T20:41:25.295734+0000","last_became_active":"2024-09-10T20:40:57.776652+0000","last_became_peered":"2024-09-10T20:40:57.776652+0000","last_unstale":"2024-09-10T20:41:25.295734+0000","last_undegraded":"2024-09-10T20:41:25.295734+0000","last_fullsized":"2024-09-10T20:41:25.295734+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:22.672592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267291+0000","last_change":"2024-09-10T20:40:56.786260+0000","last_active":"2024-09-10T20:41:25.267291+0000","last_peered":"2024-09-10T20:41:25.267291+0000","last_clean":"2024-09-10T20:41:25.267291+0000","last_became_active":"2024-09-10T20:40:56.785702+0000","last_became_peered":"2024-09-10T20:40:56.785702+0000","last_unstale":"2024-09-10T20:41:25.267291+0000","last_undegraded":"2024-09-10T20:41:25.267291+0000","last_fullsized":"2024-09-10T20:41:25.267291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970409+0000","last_change":"2024-09-10T20:41:22.970409+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970409+0000","last_undegraded":"2024-09-10T20:41:22.970409+0000","last_fullsized":"2024-09-10T20:41:22.970409+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023703+0000","last_change":"2024-09-10T20:40:57.793392+0000","last_active":"2024-09-10T20:41:25.023703+0000","last_peered":"2024-09-10T20:41:25.023703+0000","last_clean":"2024-09-10T20:41:25.023703+0000","last_became_active":"2024-09-10T20:40:57.793192+0000","last_became_peered":"2024-09-10T20:40:57.793192+0000","last_unstale":"2024-09-10T20:41:25.023703+0000","last_undegraded":"2024-09-10T20:41:25.023703+0000","last_fullsized":"2024-09-10T20:41:25.023703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:04.659598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023685+0000","last_change":"2024-09-10T20:40:56.781668+0000","last_active":"2024-09-10T20:41:25.023685+0000","last_peered":"2024-09-10T20:41:25.023685+0000","last_clean":"2024-09-10T20:41:25.023685+0000","last_became_active":"2024-09-10T20:40:56.781402+0000","last_became_peered":"2024-09-10T20:40:56.781402+0000","last_unstale":"2024-09-10T20:41:25.023685+0000","last_undegraded":"2024-09-10T20:41:25.023685+0000","last_fullsized":"2024-09-10T20:41:25.023685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:35.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001449+0000","last_change":"2024-09-10T20:41:24.002138+0000","last_active":"2024-09-10T20:41:25.001449+0000","last_peered":"2024-09-10T20:41:25.001449+0000","last_clean":"2024-09-10T20:41:25.001449+0000","last_became_active":"2024-09-10T20:41:24.001620+0000","last_became_peered":"2024-09-10T20:41:24.001620+0000","last_unstale":"2024-09-10T20:41:25.001449+0000","last_undegraded":"2024-09-10T20:41:25.001449+0000","last_fullsized":"2024-09-10T20:41:25.001449+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:13.979541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267202+0000","last_change":"2024-09-10T20:40:57.789700+0000","last_active":"2024-09-10T20:41:25.267202+0000","last_peered":"2024-09-10T20:41:25.267202+0000","last_clean":"2024-09-10T20:41:25.267202+0000","last_became_active":"2024-09-10T20:40:57.789433+0000","last_became_peered":"2024-09-10T20:40:57.789433+0000","last_unstale":"2024-09-10T20:41:25.267202+0000","last_undegraded":"2024-09-10T20:41:25.267202+0000","last_fullsized":"2024-09-10T20:41:25.267202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:28.800368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002615+0000","last_change":"2024-09-10T20:40:56.795619+0000","last_active":"2024-09-10T20:41:25.002615+0000","last_peered":"2024-09-10T20:41:25.002615+0000","last_clean":"2024-09-10T20:41:25.002615+0000","last_became_active":"2024-09-10T20:40:56.795292+0000","last_became_peered":"2024-09-10T20:40:56.795292+0000","last_unstale":"2024-09-10T20:41:25.002615+0000","last_undegraded":"2024-09-10T20:41:25.002615+0000","last_fullsized":"2024-09-10T20:41:25.002615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:09.500262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-10T20:41:22.970028+0000","last_change":"2024-09-10T20:41:22.970028+0000","last_active":"2024-09-10T20:41:22.962532+0000","last_peered":"2024-09-10T20:41:22.962532+0000","last_clean":"2024-09-10T20:41:22.962532+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-10T20:41:22.970028+0000","last_undegraded":"2024-09-10T20:41:22.970028+0000","last_fullsized":"2024-09-10T20:41:22.970028+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024030+0000","last_change":"2024-09-10T20:40:57.784029+0000","last_active":"2024-09-10T20:41:25.024030+0000","last_peered":"2024-09-10T20:41:25.024030+0000","last_clean":"2024-09-10T20:41:25.024030+0000","last_became_active":"2024-09-10T20:40:57.783716+0000","last_became_peered":"2024-09-10T20:40:57.783716+0000","last_unstale":"2024-09-10T20:41:25.024030+0000","last_undegraded":"2024-09-10T20:41:25.024030+0000","last_fullsized":"2024-09-10T20:41:25.024030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:31.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267214+0000","last_change":"2024-09-10T20:40:56.785344+0000","last_active":"2024-09-10T20:41:25.267214+0000","last_peered":"2024-09-10T20:41:25.267214+0000","last_clean":"2024-09-10T20:41:25.267214+0000","last_became_active":"2024-09-10T20:40:56.785096+0000","last_became_peered":"2024-09-10T20:40:56.785096+0000","last_unstale":"2024-09-10T20:41:25.267214+0000","last_undegraded":"2024-09-10T20:41:25.267214+0000","last_fullsized":"2024-09-10T20:41:25.267214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":159,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002333+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:25.002333+0000","last_peered":"2024-09-10T20:41:25.002333+0000","last_clean":"2024-09-10T20:41:25.002333+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:25.002333+0000","last_undegraded":"2024-09-10T20:41:25.002333+0000","last_fullsized":"2024-09-10T20:41:25.002333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":98,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6844416,"data_stored":6540388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":540672,"data_stored":241676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1146880,"data_stored":839300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29616,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342224,"statfs":{"total":96636764160,"available":96606437376,"internally_reserved":0,"allocated":2650112,"data_stored":2346084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":5180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":5304320,"data_stored":5011475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:32.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:33.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.068+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1921078736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0406ed70 msgr2=0x7fdb040cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.068+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1921078736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0406ed70 0x7fdb040cd5a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009830 tx=0x7fdaf002a5c0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.068+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1921078736 shutdown_connections 2024-09-10T20:41:33.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.068+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1921078736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb0406ed70 0x7fdb040cd5a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.068+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1921078736 >> 172.21.15.81:0/1921078736 conn(0x7fdb04068f90 msgr2=0x7fdb0406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.068+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1921078736 shutdown_connections 2024-09-10T20:41:33.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.068+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1921078736 wait complete. 2024-09-10T20:41:33.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.070+0000 7fdb0ac00640 1 Processor -- start 2024-09-10T20:41:33.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.070+0000 7fdb0ac00640 1 -- start start 2024-09-10T20:41:33.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb0ac00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb0406ed70 0x7fdb0413f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb0ac00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb040b35a0 0x7fdb041e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb0ac00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb041453e0 0x7fdb041f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb0ac00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb040b4260 con 0x7fdb040b35a0 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb0ac00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdb040b40e0 con 0x7fdb041453e0 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb0ac00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdb040b43e0 con 0x7fdb0406ed70 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb03400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb040b35a0 0x7fdb041e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb03400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb040b35a0 0x7fdb041e6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41284/0 (socket says 172.21.15.81:41284) 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb03400640 1 -- 172.21.15.81:0/1597030437 learned_addr learned my addr 172.21.15.81:0/1597030437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb08c00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb041453e0 0x7fdb041f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.071+0000 7fdb03e00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb0406ed70 0x7fdb0413f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb03400640 1 -- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb0406ed70 msgr2=0x7fdb0413f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb03400640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb0406ed70 0x7fdb0413f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb03400640 1 -- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb041453e0 msgr2=0x7fdb041f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb03400640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb041453e0 0x7fdb041f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb03400640 1 -- 172.21.15.81:0/1597030437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb041e61e0 con 0x7fdb040b35a0 2024-09-10T20:41:33.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb03400640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb040b35a0 0x7fdb041e6fa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009950 tx=0x7fdaf0032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdafbe00640 1 -- 172.21.15.81:0/1597030437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0040070 con 0x7fdb040b35a0 2024-09-10T20:41:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdafbe00640 1 -- 172.21.15.81:0/1597030437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaf0005310 con 0x7fdb040b35a0 2024-09-10T20:41:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdafbe00640 1 -- 172.21.15.81:0/1597030437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00047a0 con 0x7fdb040b35a0 2024-09-10T20:41:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb041e64c0 con 0x7fdb040b35a0 2024-09-10T20:41:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.072+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb041e5ed0 con 0x7fdb040b35a0 2024-09-10T20:41:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.073+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb040cd5a0 con 0x7fdb040b35a0 2024-09-10T20:41:33.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.074+0000 7fdafbe00640 1 -- 172.21.15.81:0/1597030437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fdaf0004940 con 0x7fdb040b35a0 2024-09-10T20:41:33.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.075+0000 7fdafbe00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdae4077f70 0x7fdae407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.075+0000 7fdafbe00640 1 -- 172.21.15.81:0/1597030437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7fdaf00bb630 con 0x7fdb040b35a0 2024-09-10T20:41:33.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.076+0000 7fdb03e00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdae4077f70 0x7fdae407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.077+0000 7fdb03e00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdae4077f70 0x7fdae407a430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4000f60 tx=0x7fdaf4009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.080+0000 7fdafbe00640 1 -- 172.21.15.81:0/1597030437 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fdaf0083600 con 0x7fdb040b35a0 2024-09-10T20:41:33.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.259+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb0413fdd0 con 0x7fdae4077f70 2024-09-10T20:41:33.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.266+0000 7fdafbe00640 1 -- 172.21.15.81:0/1597030437 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332439 (secure 0 0 0) 0x7fdaf4001440 con 0x7fdae4077f70 2024-09-10T20:41:33.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:33.276 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdae4077f70 msgr2=0x7fdae407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdae4077f70 0x7fdae407a430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4000f60 tx=0x7fdaf4009040 comp rx=0 tx=0).stop 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb040b35a0 msgr2=0x7fdb041e6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb040b35a0 0x7fdb041e6fa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009950 tx=0x7fdaf0032c00 comp rx=0 tx=0).stop 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 shutdown_connections 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fdae4077f70 0x7fdae407a430 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb041453e0 0x7fdb041f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb040b35a0 0x7fdb041e6fa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 --2- 172.21.15.81:0/1597030437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdb0406ed70 0x7fdb0413f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 >> 172.21.15.81:0/1597030437 conn(0x7fdb04068f90 msgr2=0x7fdb0406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 shutdown_connections 2024-09-10T20:41:33.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.270+0000 7fdb0ac00640 1 -- 172.21.15.81:0/1597030437 wait complete. 2024-09-10T20:41:33.292 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-10T20:41:33.033447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":203,"num_write_kb":7813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":661,"ondisk_log_size":661,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":252,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234008,"kb_used_data":17768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740712,"statfs":{"total":773094113280,"available":772854489088,"internally_reserved":0,"allocated":18194432,"data_stored":15755104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.034738"},"pg_stats":[{"pgid":"6.3f","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002280+0000","last_change":"2024-09-10T20:40:57.808566+0000","last_active":"2024-09-10T20:41:25.002280+0000","last_peered":"2024-09-10T20:41:25.002280+0000","last_clean":"2024-09-10T20:41:25.002280+0000","last_became_active":"2024-09-10T20:40:57.808299+0000","last_became_peered":"2024-09-10T20:40:57.808299+0000","last_unstale":"2024-09-10T20:41:25.002280+0000","last_undegraded":"2024-09-10T20:41:25.002280+0000","last_fullsized":"2024-09-10T20:41:25.002280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:57:11.202752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.785246+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.784969+0000","last_became_peered":"2024-09-10T20:40:57.784969+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:26.513133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002056+0000","last_change":"2024-09-10T20:40:57.798413+0000","last_active":"2024-09-10T20:41:25.002056+0000","last_peered":"2024-09-10T20:41:25.002056+0000","last_clean":"2024-09-10T20:41:25.002056+0000","last_became_active":"2024-09-10T20:40:57.798085+0000","last_became_peered":"2024-09-10T20:40:57.798085+0000","last_unstale":"2024-09-10T20:41:25.002056+0000","last_undegraded":"2024-09-10T20:41:25.002056+0000","last_fullsized":"2024-09-10T20:41:25.002056+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:33.904500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002674+0000","last_change":"2024-09-10T20:40:57.793918+0000","last_active":"2024-09-10T20:41:25.002674+0000","last_peered":"2024-09-10T20:41:25.002674+0000","last_clean":"2024-09-10T20:41:25.002674+0000","last_became_active":"2024-09-10T20:40:57.793335+0000","last_became_peered":"2024-09-10T20:40:57.793335+0000","last_unstale":"2024-09-10T20:41:25.002674+0000","last_undegraded":"2024-09-10T20:41:25.002674+0000","last_fullsized":"2024-09-10T20:41:25.002674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:12.740619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"40'4","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724486+0000","last_change":"2024-09-10T20:40:57.802056+0000","last_active":"2024-09-10T20:41:26.724486+0000","last_peered":"2024-09-10T20:41:26.724486+0000","last_clean":"2024-09-10T20:41:26.724486+0000","last_became_active":"2024-09-10T20:40:57.801252+0000","last_became_peered":"2024-09-10T20:40:57.801252+0000","last_unstale":"2024-09-10T20:41:26.724486+0000","last_undegraded":"2024-09-10T20:41:26.724486+0000","last_fullsized":"2024-09-10T20:41:26.724486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:43.552747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295818+0000","last_change":"2024-09-10T20:40:57.781646+0000","last_active":"2024-09-10T20:41:25.295818+0000","last_peered":"2024-09-10T20:41:25.295818+0000","last_clean":"2024-09-10T20:41:25.295818+0000","last_became_active":"2024-09-10T20:40:57.781350+0000","last_became_peered":"2024-09-10T20:40:57.781350+0000","last_unstale":"2024-09-10T20:41:25.295818+0000","last_undegraded":"2024-09-10T20:41:25.295818+0000","last_fullsized":"2024-09-10T20:41:25.295818+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:42.959912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001962+0000","last_change":"2024-09-10T20:40:57.797129+0000","last_active":"2024-09-10T20:41:25.001962+0000","last_peered":"2024-09-10T20:41:25.001962+0000","last_clean":"2024-09-10T20:41:25.001962+0000","last_became_active":"2024-09-10T20:40:57.796854+0000","last_became_peered":"2024-09-10T20:40:57.796854+0000","last_unstale":"2024-09-10T20:41:25.001962+0000","last_undegraded":"2024-09-10T20:41:25.001962+0000","last_fullsized":"2024-09-10T20:41:25.001962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:48:43.327598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001457+0000","last_change":"2024-09-10T20:40:57.808609+0000","last_active":"2024-09-10T20:41:25.001457+0000","last_peered":"2024-09-10T20:41:25.001457+0000","last_clean":"2024-09-10T20:41:25.001457+0000","last_became_active":"2024-09-10T20:40:57.807999+0000","last_became_peered":"2024-09-10T20:40:57.807999+0000","last_unstale":"2024-09-10T20:41:25.001457+0000","last_undegraded":"2024-09-10T20:41:25.001457+0000","last_fullsized":"2024-09-10T20:41:25.001457+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:30.890741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"40'11","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724934+0000","last_change":"2024-09-10T20:40:57.802618+0000","last_active":"2024-09-10T20:41:26.724934+0000","last_peered":"2024-09-10T20:41:26.724934+0000","last_clean":"2024-09-10T20:41:26.724934+0000","last_became_active":"2024-09-10T20:40:57.801991+0000","last_became_peered":"2024-09-10T20:40:57.801991+0000","last_unstale":"2024-09-10T20:41:26.724934+0000","last_undegraded":"2024-09-10T20:41:26.724934+0000","last_fullsized":"2024-09-10T20:41:26.724934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:57.479228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002527+0000","last_change":"2024-09-10T20:40:57.805178+0000","last_active":"2024-09-10T20:41:25.002527+0000","last_peered":"2024-09-10T20:41:25.002527+0000","last_clean":"2024-09-10T20:41:25.002527+0000","last_became_active":"2024-09-10T20:40:57.804919+0000","last_became_peered":"2024-09-10T20:40:57.804919+0000","last_unstale":"2024-09-10T20:41:25.002527+0000","last_undegraded":"2024-09-10T20:41:25.002527+0000","last_fullsized":"2024-09-10T20:41:25.002527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:34.267791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267431+0000","last_change":"2024-09-10T20:40:57.797147+0000","last_active":"2024-09-10T20:41:25.267431+0000","last_peered":"2024-09-10T20:41:25.267431+0000","last_clean":"2024-09-10T20:41:25.267431+0000","last_became_active":"2024-09-10T20:40:57.796910+0000","last_became_peered":"2024-09-10T20:40:57.796910+0000","last_unstale":"2024-09-10T20:41:25.267431+0000","last_undegraded":"2024-09-10T20:41:25.267431+0000","last_fullsized":"2024-09-10T20:41:25.267431+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:43.015903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724446+0000","last_change":"2024-09-10T20:40:57.804510+0000","last_active":"2024-09-10T20:41:26.724446+0000","last_peered":"2024-09-10T20:41:26.724446+0000","last_clean":"2024-09-10T20:41:26.724446+0000","last_became_active":"2024-09-10T20:40:57.804220+0000","last_became_peered":"2024-09-10T20:40:57.804220+0000","last_unstale":"2024-09-10T20:41:26.724446+0000","last_undegraded":"2024-09-10T20:41:26.724446+0000","last_fullsized":"2024-09-10T20:41:26.724446+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:55.727449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002169+0000","last_change":"2024-09-10T20:40:57.795473+0000","last_active":"2024-09-10T20:41:25.002169+0000","last_peered":"2024-09-10T20:41:25.002169+0000","last_clean":"2024-09-10T20:41:25.002169+0000","last_became_active":"2024-09-10T20:40:57.795179+0000","last_became_peered":"2024-09-10T20:40:57.795179+0000","last_unstale":"2024-09-10T20:41:25.002169+0000","last_undegraded":"2024-09-10T20:41:25.002169+0000","last_fullsized":"2024-09-10T20:41:25.002169+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:55:26.860136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.723892+0000","last_change":"2024-09-10T20:40:57.801649+0000","last_active":"2024-09-10T20:41:26.723892+0000","last_peered":"2024-09-10T20:41:26.723892+0000","last_clean":"2024-09-10T20:41:26.723892+0000","last_became_active":"2024-09-10T20:40:57.797096+0000","last_became_peered":"2024-09-10T20:40:57.797096+0000","last_unstale":"2024-09-10T20:41:26.723892+0000","last_undegraded":"2024-09-10T20:41:26.723892+0000","last_fullsized":"2024-09-10T20:41:26.723892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:21:05.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023428+0000","last_change":"2024-09-10T20:40:57.779842+0000","last_active":"2024-09-10T20:41:25.023428+0000","last_peered":"2024-09-10T20:41:25.023428+0000","last_clean":"2024-09-10T20:41:25.023428+0000","last_became_active":"2024-09-10T20:40:57.779564+0000","last_became_peered":"2024-09-10T20:40:57.779564+0000","last_unstale":"2024-09-10T20:41:25.023428+0000","last_undegraded":"2024-09-10T20:41:25.023428+0000","last_fullsized":"2024-09-10T20:41:25.023428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:22:23.588509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001997+0000","last_change":"2024-09-10T20:40:57.806288+0000","last_active":"2024-09-10T20:41:25.001997+0000","last_peered":"2024-09-10T20:41:25.001997+0000","last_clean":"2024-09-10T20:41:25.001997+0000","last_became_active":"2024-09-10T20:40:57.804491+0000","last_became_peered":"2024-09-10T20:40:57.804491+0000","last_unstale":"2024-09-10T20:41:25.001997+0000","last_undegraded":"2024-09-10T20:41:25.001997+0000","last_fullsized":"2024-09-10T20:41:25.001997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:18.810090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024138+0000","last_change":"2024-09-10T20:40:57.781946+0000","last_active":"2024-09-10T20:41:25.024138+0000","last_peered":"2024-09-10T20:41:25.024138+0000","last_clean":"2024-09-10T20:41:25.024138+0000","last_became_active":"2024-09-10T20:40:57.781711+0000","last_became_peered":"2024-09-10T20:40:57.781711+0000","last_unstale":"2024-09-10T20:41:25.024138+0000","last_undegraded":"2024-09-10T20:41:25.024138+0000","last_fullsized":"2024-09-10T20:41:25.024138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:57.437327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023982+0000","last_change":"2024-09-10T20:40:57.781131+0000","last_active":"2024-09-10T20:41:25.023982+0000","last_peered":"2024-09-10T20:41:25.023982+0000","last_clean":"2024-09-10T20:41:25.023982+0000","last_became_active":"2024-09-10T20:40:57.780857+0000","last_became_peered":"2024-09-10T20:40:57.780857+0000","last_unstale":"2024-09-10T20:41:25.023982+0000","last_undegraded":"2024-09-10T20:41:25.023982+0000","last_fullsized":"2024-09-10T20:41:25.023982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:18.298699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"40'7","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002484+0000","last_change":"2024-09-10T20:40:57.799870+0000","last_active":"2024-09-10T20:41:25.002484+0000","last_peered":"2024-09-10T20:41:25.002484+0000","last_clean":"2024-09-10T20:41:25.002484+0000","last_became_active":"2024-09-10T20:40:57.799593+0000","last_became_peered":"2024-09-10T20:40:57.799593+0000","last_unstale":"2024-09-10T20:41:25.002484+0000","last_undegraded":"2024-09-10T20:41:25.002484+0000","last_fullsized":"2024-09-10T20:41:25.002484+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:06.770370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267232+0000","last_change":"2024-09-10T20:40:57.788576+0000","last_active":"2024-09-10T20:41:25.267232+0000","last_peered":"2024-09-10T20:41:25.267232+0000","last_clean":"2024-09-10T20:41:25.267232+0000","last_became_active":"2024-09-10T20:40:57.788342+0000","last_became_peered":"2024-09-10T20:40:57.788342+0000","last_unstale":"2024-09-10T20:41:25.267232+0000","last_undegraded":"2024-09-10T20:41:25.267232+0000","last_fullsized":"2024-09-10T20:41:25.267232+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:56.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"40'11","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267138+0000","last_change":"2024-09-10T20:40:57.797333+0000","last_active":"2024-09-10T20:41:25.267138+0000","last_peered":"2024-09-10T20:41:25.267138+0000","last_clean":"2024-09-10T20:41:25.267138+0000","last_became_active":"2024-09-10T20:40:57.794482+0000","last_became_peered":"2024-09-10T20:40:57.794482+0000","last_unstale":"2024-09-10T20:41:25.267138+0000","last_undegraded":"2024-09-10T20:41:25.267138+0000","last_fullsized":"2024-09-10T20:41:25.267138+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:33.113187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267051+0000","last_change":"2024-09-10T20:40:57.785890+0000","last_active":"2024-09-10T20:41:25.267051+0000","last_peered":"2024-09-10T20:41:25.267051+0000","last_clean":"2024-09-10T20:41:25.267051+0000","last_became_active":"2024-09-10T20:40:57.785582+0000","last_became_peered":"2024-09-10T20:40:57.785582+0000","last_unstale":"2024-09-10T20:41:25.267051+0000","last_undegraded":"2024-09-10T20:41:25.267051+0000","last_fullsized":"2024-09-10T20:41:25.267051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:02:51.491322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023468+0000","last_change":"2024-09-10T20:40:57.786174+0000","last_active":"2024-09-10T20:41:25.023468+0000","last_peered":"2024-09-10T20:41:25.023468+0000","last_clean":"2024-09-10T20:41:25.023468+0000","last_became_active":"2024-09-10T20:40:57.785175+0000","last_became_peered":"2024-09-10T20:40:57.785175+0000","last_unstale":"2024-09-10T20:41:25.023468+0000","last_undegraded":"2024-09-10T20:41:25.023468+0000","last_fullsized":"2024-09-10T20:41:25.023468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:08:23.271959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001563+0000","last_change":"2024-09-10T20:40:57.808222+0000","last_active":"2024-09-10T20:41:25.001563+0000","last_peered":"2024-09-10T20:41:25.001563+0000","last_clean":"2024-09-10T20:41:25.001563+0000","last_became_active":"2024-09-10T20:40:57.807578+0000","last_became_peered":"2024-09-10T20:40:57.807578+0000","last_unstale":"2024-09-10T20:41:25.001563+0000","last_undegraded":"2024-09-10T20:41:25.001563+0000","last_fullsized":"2024-09-10T20:41:25.001563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:58:25.893234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"40'2","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724034+0000","last_change":"2024-09-10T20:40:57.803089+0000","last_active":"2024-09-10T20:41:26.724034+0000","last_peered":"2024-09-10T20:41:26.724034+0000","last_clean":"2024-09-10T20:41:26.724034+0000","last_became_active":"2024-09-10T20:40:57.802606+0000","last_became_peered":"2024-09-10T20:40:57.802606+0000","last_unstale":"2024-09-10T20:41:26.724034+0000","last_undegraded":"2024-09-10T20:41:26.724034+0000","last_fullsized":"2024-09-10T20:41:26.724034+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002118+0000","last_change":"2024-09-10T20:40:57.804633+0000","last_active":"2024-09-10T20:41:25.002118+0000","last_peered":"2024-09-10T20:41:25.002118+0000","last_clean":"2024-09-10T20:41:25.002118+0000","last_became_active":"2024-09-10T20:40:57.804388+0000","last_became_peered":"2024-09-10T20:40:57.804388+0000","last_unstale":"2024-09-10T20:41:25.002118+0000","last_undegraded":"2024-09-10T20:41:25.002118+0000","last_fullsized":"2024-09-10T20:41:25.002118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:17.686400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"40'6","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267480+0000","last_change":"2024-09-10T20:40:57.790304+0000","last_active":"2024-09-10T20:41:25.267480+0000","last_peered":"2024-09-10T20:41:25.267480+0000","last_clean":"2024-09-10T20:41:25.267480+0000","last_became_active":"2024-09-10T20:40:57.790064+0000","last_became_peered":"2024-09-10T20:40:57.790064+0000","last_unstale":"2024-09-10T20:41:25.267480+0000","last_undegraded":"2024-09-10T20:41:25.267480+0000","last_fullsized":"2024-09-10T20:41:25.267480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:18:03.995020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"40'4","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002320+0000","last_change":"2024-09-10T20:40:57.811854+0000","last_active":"2024-09-10T20:41:25.002320+0000","last_peered":"2024-09-10T20:41:25.002320+0000","last_clean":"2024-09-10T20:41:25.002320+0000","last_became_active":"2024-09-10T20:40:57.811532+0000","last_became_peered":"2024-09-10T20:40:57.811532+0000","last_unstale":"2024-09-10T20:41:25.002320+0000","last_undegraded":"2024-09-10T20:41:25.002320+0000","last_fullsized":"2024-09-10T20:41:25.002320+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:39.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023478+0000","last_change":"2024-09-10T20:40:57.783995+0000","last_active":"2024-09-10T20:41:25.023478+0000","last_peered":"2024-09-10T20:41:25.023478+0000","last_clean":"2024-09-10T20:41:25.023478+0000","last_became_active":"2024-09-10T20:40:57.782195+0000","last_became_peered":"2024-09-10T20:40:57.782195+0000","last_unstale":"2024-09-10T20:41:25.023478+0000","last_undegraded":"2024-09-10T20:41:25.023478+0000","last_fullsized":"2024-09-10T20:41:25.023478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:47:53.576166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023603+0000","last_change":"2024-09-10T20:40:57.778945+0000","last_active":"2024-09-10T20:41:25.023603+0000","last_peered":"2024-09-10T20:41:25.023603+0000","last_clean":"2024-09-10T20:41:25.023603+0000","last_became_active":"2024-09-10T20:40:57.778659+0000","last_became_peered":"2024-09-10T20:40:57.778659+0000","last_unstale":"2024-09-10T20:41:25.023603+0000","last_undegraded":"2024-09-10T20:41:25.023603+0000","last_fullsized":"2024-09-10T20:41:25.023603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:42.767732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"40'12","reported_seq":41,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002065+0000","last_change":"2024-09-10T20:40:57.796477+0000","last_active":"2024-09-10T20:41:25.002065+0000","last_peered":"2024-09-10T20:41:25.002065+0000","last_clean":"2024-09-10T20:41:25.002065+0000","last_became_active":"2024-09-10T20:40:57.796191+0000","last_became_peered":"2024-09-10T20:40:57.796191+0000","last_unstale":"2024-09-10T20:41:25.002065+0000","last_undegraded":"2024-09-10T20:41:25.002065+0000","last_fullsized":"2024-09-10T20:41:25.002065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:00.682250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001687+0000","last_change":"2024-09-10T20:40:57.813103+0000","last_active":"2024-09-10T20:41:25.001687+0000","last_peered":"2024-09-10T20:41:25.001687+0000","last_clean":"2024-09-10T20:41:25.001687+0000","last_became_active":"2024-09-10T20:40:57.812863+0000","last_became_peered":"2024-09-10T20:40:57.812863+0000","last_unstale":"2024-09-10T20:41:25.001687+0000","last_undegraded":"2024-09-10T20:41:25.001687+0000","last_fullsized":"2024-09-10T20:41:25.001687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:50:03.255660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002271+0000","last_change":"2024-09-10T20:41:24.005328+0000","last_active":"2024-09-10T20:41:25.002271+0000","last_peered":"2024-09-10T20:41:25.002271+0000","last_clean":"2024-09-10T20:41:25.002271+0000","last_became_active":"2024-09-10T20:41:24.004998+0000","last_became_peered":"2024-09-10T20:41:24.004998+0000","last_unstale":"2024-09-10T20:41:25.002271+0000","last_undegraded":"2024-09-10T20:41:25.002271+0000","last_fullsized":"2024-09-10T20:41:25.002271+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:07.029328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023852+0000","last_change":"2024-09-10T20:40:57.806845+0000","last_active":"2024-09-10T20:41:25.023852+0000","last_peered":"2024-09-10T20:41:25.023852+0000","last_clean":"2024-09-10T20:41:25.023852+0000","last_became_active":"2024-09-10T20:40:57.806562+0000","last_became_peered":"2024-09-10T20:40:57.806562+0000","last_unstale":"2024-09-10T20:41:25.023852+0000","last_undegraded":"2024-09-10T20:41:25.023852+0000","last_fullsized":"2024-09-10T20:41:25.023852+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:32.177438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"44'8","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724140+0000","last_change":"2024-09-10T20:40:56.787360+0000","last_active":"2024-09-10T20:41:26.724140+0000","last_peered":"2024-09-10T20:41:26.724140+0000","last_clean":"2024-09-10T20:41:26.724140+0000","last_became_active":"2024-09-10T20:40:56.787113+0000","last_became_peered":"2024-09-10T20:40:56.787113+0000","last_unstale":"2024-09-10T20:41:26.724140+0000","last_undegraded":"2024-09-10T20:41:26.724140+0000","last_fullsized":"2024-09-10T20:41:26.724140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724045+0000","last_change":"2024-09-10T20:41:23.997577+0000","last_active":"2024-09-10T20:41:26.724045+0000","last_peered":"2024-09-10T20:41:26.724045+0000","last_clean":"2024-09-10T20:41:26.724045+0000","last_became_active":"2024-09-10T20:41:23.997315+0000","last_became_peered":"2024-09-10T20:41:23.997315+0000","last_unstale":"2024-09-10T20:41:26.724045+0000","last_undegraded":"2024-09-10T20:41:26.724045+0000","last_fullsized":"2024-09-10T20:41:26.724045+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:14:16.542393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'15","reported_seq":44,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296022+0000","last_change":"2024-09-10T20:40:57.794642+0000","last_active":"2024-09-10T20:41:25.296022+0000","last_peered":"2024-09-10T20:41:25.296022+0000","last_clean":"2024-09-10T20:41:25.296022+0000","last_became_active":"2024-09-10T20:40:57.794432+0000","last_became_peered":"2024-09-10T20:40:57.794432+0000","last_unstale":"2024-09-10T20:41:25.296022+0000","last_undegraded":"2024-09-10T20:41:25.296022+0000","last_fullsized":"2024-09-10T20:41:25.296022+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:59.893364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296194+0000","last_change":"2024-09-10T20:40:56.790001+0000","last_active":"2024-09-10T20:41:25.296194+0000","last_peered":"2024-09-10T20:41:25.296194+0000","last_clean":"2024-09-10T20:41:25.296194+0000","last_became_active":"2024-09-10T20:40:56.789708+0000","last_became_peered":"2024-09-10T20:40:56.789708+0000","last_unstale":"2024-09-10T20:41:25.296194+0000","last_undegraded":"2024-09-10T20:41:25.296194+0000","last_fullsized":"2024-09-10T20:41:25.296194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:56.266862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267602+0000","last_change":"2024-09-10T20:41:24.001301+0000","last_active":"2024-09-10T20:41:25.267602+0000","last_peered":"2024-09-10T20:41:25.267602+0000","last_clean":"2024-09-10T20:41:25.267602+0000","last_became_active":"2024-09-10T20:41:24.000986+0000","last_became_peered":"2024-09-10T20:41:24.000986+0000","last_unstale":"2024-09-10T20:41:25.267602+0000","last_undegraded":"2024-09-10T20:41:25.267602+0000","last_fullsized":"2024-09-10T20:41:25.267602+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:45.971209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024106+0000","last_change":"2024-09-10T20:40:57.804223+0000","last_active":"2024-09-10T20:41:25.024106+0000","last_peered":"2024-09-10T20:41:25.024106+0000","last_clean":"2024-09-10T20:41:25.024106+0000","last_became_active":"2024-09-10T20:40:57.800934+0000","last_became_peered":"2024-09-10T20:40:57.800934+0000","last_unstale":"2024-09-10T20:41:25.024106+0000","last_undegraded":"2024-09-10T20:41:25.024106+0000","last_fullsized":"2024-09-10T20:41:25.024106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:05:43.140106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"44'3","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002486+0000","last_change":"2024-09-10T20:40:56.798617+0000","last_active":"2024-09-10T20:41:25.002486+0000","last_peered":"2024-09-10T20:41:25.002486+0000","last_clean":"2024-09-10T20:41:25.002486+0000","last_became_active":"2024-09-10T20:40:56.798233+0000","last_became_peered":"2024-09-10T20:40:56.798233+0000","last_unstale":"2024-09-10T20:41:25.002486+0000","last_undegraded":"2024-09-10T20:41:25.002486+0000","last_fullsized":"2024-09-10T20:41:25.002486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:55.548605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724847+0000","last_change":"2024-09-10T20:41:23.999098+0000","last_active":"2024-09-10T20:41:26.724847+0000","last_peered":"2024-09-10T20:41:26.724847+0000","last_clean":"2024-09-10T20:41:26.724847+0000","last_became_active":"2024-09-10T20:41:23.998720+0000","last_became_peered":"2024-09-10T20:41:23.998720+0000","last_unstale":"2024-09-10T20:41:26.724847+0000","last_undegraded":"2024-09-10T20:41:26.724847+0000","last_fullsized":"2024-09-10T20:41:26.724847+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:30:32.311724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296273+0000","last_change":"2024-09-10T20:40:57.790493+0000","last_active":"2024-09-10T20:41:25.296273+0000","last_peered":"2024-09-10T20:41:25.296273+0000","last_clean":"2024-09-10T20:41:25.296273+0000","last_became_active":"2024-09-10T20:40:57.789768+0000","last_became_peered":"2024-09-10T20:40:57.789768+0000","last_unstale":"2024-09-10T20:41:25.296273+0000","last_undegraded":"2024-09-10T20:41:25.296273+0000","last_fullsized":"2024-09-10T20:41:25.296273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.004069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"44'3","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724298+0000","last_change":"2024-09-10T20:40:56.798645+0000","last_active":"2024-09-10T20:41:26.724298+0000","last_peered":"2024-09-10T20:41:26.724298+0000","last_clean":"2024-09-10T20:41:26.724298+0000","last_became_active":"2024-09-10T20:40:56.798325+0000","last_became_peered":"2024-09-10T20:40:56.798325+0000","last_unstale":"2024-09-10T20:41:26.724298+0000","last_undegraded":"2024-09-10T20:41:26.724298+0000","last_fullsized":"2024-09-10T20:41:26.724298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:42:18.678416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023770+0000","last_change":"2024-09-10T20:41:23.999199+0000","last_active":"2024-09-10T20:41:25.023770+0000","last_peered":"2024-09-10T20:41:25.023770+0000","last_clean":"2024-09-10T20:41:25.023770+0000","last_became_active":"2024-09-10T20:41:23.998893+0000","last_became_peered":"2024-09-10T20:41:23.998893+0000","last_unstale":"2024-09-10T20:41:25.023770+0000","last_undegraded":"2024-09-10T20:41:25.023770+0000","last_fullsized":"2024-09-10T20:41:25.023770+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:26.712353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001816+0000","last_change":"2024-09-10T20:40:57.792035+0000","last_active":"2024-09-10T20:41:25.001816+0000","last_peered":"2024-09-10T20:41:25.001816+0000","last_clean":"2024-09-10T20:41:25.001816+0000","last_became_active":"2024-09-10T20:40:57.791743+0000","last_became_peered":"2024-09-10T20:40:57.791743+0000","last_unstale":"2024-09-10T20:41:25.001816+0000","last_undegraded":"2024-09-10T20:41:25.001816+0000","last_fullsized":"2024-09-10T20:41:25.001816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:26:35.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724246+0000","last_change":"2024-09-10T20:40:56.778488+0000","last_active":"2024-09-10T20:41:26.724246+0000","last_peered":"2024-09-10T20:41:26.724246+0000","last_clean":"2024-09-10T20:41:26.724246+0000","last_became_active":"2024-09-10T20:40:56.778241+0000","last_became_peered":"2024-09-10T20:40:56.778241+0000","last_unstale":"2024-09-10T20:41:26.724246+0000","last_undegraded":"2024-09-10T20:41:26.724246+0000","last_fullsized":"2024-09-10T20:41:26.724246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002542+0000","last_change":"2024-09-10T20:41:23.996850+0000","last_active":"2024-09-10T20:41:25.002542+0000","last_peered":"2024-09-10T20:41:25.002542+0000","last_clean":"2024-09-10T20:41:25.002542+0000","last_became_active":"2024-09-10T20:41:23.996537+0000","last_became_peered":"2024-09-10T20:41:23.996537+0000","last_unstale":"2024-09-10T20:41:25.002542+0000","last_undegraded":"2024-09-10T20:41:25.002542+0000","last_fullsized":"2024-09-10T20:41:25.002542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:11:09.881621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267021+0000","last_change":"2024-09-10T20:40:57.787640+0000","last_active":"2024-09-10T20:41:25.267021+0000","last_peered":"2024-09-10T20:41:25.267021+0000","last_clean":"2024-09-10T20:41:25.267021+0000","last_became_active":"2024-09-10T20:40:57.787374+0000","last_became_peered":"2024-09-10T20:40:57.787374+0000","last_unstale":"2024-09-10T20:41:25.267021+0000","last_undegraded":"2024-09-10T20:41:25.267021+0000","last_fullsized":"2024-09-10T20:41:25.267021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:29.579080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002354+0000","last_change":"2024-09-10T20:40:56.799544+0000","last_active":"2024-09-10T20:41:25.002354+0000","last_peered":"2024-09-10T20:41:25.002354+0000","last_clean":"2024-09-10T20:41:25.002354+0000","last_became_active":"2024-09-10T20:40:56.799273+0000","last_became_peered":"2024-09-10T20:40:56.799273+0000","last_unstale":"2024-09-10T20:41:25.002354+0000","last_undegraded":"2024-09-10T20:41:25.002354+0000","last_fullsized":"2024-09-10T20:41:25.002354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:24.776937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001061+0000","last_change":"2024-09-10T20:41:24.000751+0000","last_active":"2024-09-10T20:41:25.001061+0000","last_peered":"2024-09-10T20:41:25.001061+0000","last_clean":"2024-09-10T20:41:25.001061+0000","last_became_active":"2024-09-10T20:41:24.000476+0000","last_became_peered":"2024-09-10T20:41:24.000476+0000","last_unstale":"2024-09-10T20:41:25.001061+0000","last_undegraded":"2024-09-10T20:41:25.001061+0000","last_fullsized":"2024-09-10T20:41:25.001061+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:50.959302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023652+0000","last_change":"2024-09-10T20:40:57.790412+0000","last_active":"2024-09-10T20:41:25.023652+0000","last_peered":"2024-09-10T20:41:25.023652+0000","last_clean":"2024-09-10T20:41:25.023652+0000","last_became_active":"2024-09-10T20:40:57.788308+0000","last_became_peered":"2024-09-10T20:40:57.788308+0000","last_unstale":"2024-09-10T20:41:25.023652+0000","last_undegraded":"2024-09-10T20:41:25.023652+0000","last_fullsized":"2024-09-10T20:41:25.023652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:34:27.492132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001391+0000","last_change":"2024-09-10T20:40:56.795211+0000","last_active":"2024-09-10T20:41:25.001391+0000","last_peered":"2024-09-10T20:41:25.001391+0000","last_clean":"2024-09-10T20:41:25.001391+0000","last_became_active":"2024-09-10T20:40:56.794869+0000","last_became_peered":"2024-09-10T20:40:56.794869+0000","last_unstale":"2024-09-10T20:41:25.001391+0000","last_undegraded":"2024-09-10T20:41:25.001391+0000","last_fullsized":"2024-09-10T20:41:25.001391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:29:54.724711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023595+0000","last_change":"2024-09-10T20:41:23.992976+0000","last_active":"2024-09-10T20:41:25.023595+0000","last_peered":"2024-09-10T20:41:25.023595+0000","last_clean":"2024-09-10T20:41:25.023595+0000","last_became_active":"2024-09-10T20:41:23.992286+0000","last_became_peered":"2024-09-10T20:41:23.992286+0000","last_unstale":"2024-09-10T20:41:25.023595+0000","last_undegraded":"2024-09-10T20:41:25.023595+0000","last_fullsized":"2024-09-10T20:41:25.023595+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:38.417982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.296059+0000","last_change":"2024-09-10T20:40:57.799569+0000","last_active":"2024-09-10T20:41:25.296059+0000","last_peered":"2024-09-10T20:41:25.296059+0000","last_clean":"2024-09-10T20:41:25.296059+0000","last_became_active":"2024-09-10T20:40:57.799219+0000","last_became_peered":"2024-09-10T20:40:57.799219+0000","last_unstale":"2024-09-10T20:41:25.296059+0000","last_undegraded":"2024-09-10T20:41:25.296059+0000","last_fullsized":"2024-09-10T20:41:25.296059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:29.475021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002246+0000","last_change":"2024-09-10T20:40:56.779639+0000","last_active":"2024-09-10T20:41:25.002246+0000","last_peered":"2024-09-10T20:41:25.002246+0000","last_clean":"2024-09-10T20:41:25.002246+0000","last_became_active":"2024-09-10T20:40:56.779311+0000","last_became_peered":"2024-09-10T20:40:56.779311+0000","last_unstale":"2024-09-10T20:41:25.002246+0000","last_undegraded":"2024-09-10T20:41:25.002246+0000","last_fullsized":"2024-09-10T20:41:25.002246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:39.771929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023992+0000","last_change":"2024-09-10T20:41:24.003499+0000","last_active":"2024-09-10T20:41:25.023992+0000","last_peered":"2024-09-10T20:41:25.023992+0000","last_clean":"2024-09-10T20:41:25.023992+0000","last_became_active":"2024-09-10T20:41:24.003230+0000","last_became_peered":"2024-09-10T20:41:24.003230+0000","last_unstale":"2024-09-10T20:41:25.023992+0000","last_undegraded":"2024-09-10T20:41:25.023992+0000","last_fullsized":"2024-09-10T20:41:25.023992+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:49.321950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'11","reported_seq":40,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002775+0000","last_change":"2024-09-10T20:40:57.793647+0000","last_active":"2024-09-10T20:41:25.002775+0000","last_peered":"2024-09-10T20:41:25.002775+0000","last_clean":"2024-09-10T20:41:25.002775+0000","last_became_active":"2024-09-10T20:40:57.792950+0000","last_became_peered":"2024-09-10T20:40:57.792950+0000","last_unstale":"2024-09-10T20:41:25.002775+0000","last_undegraded":"2024-09-10T20:41:25.002775+0000","last_fullsized":"2024-09-10T20:41:25.002775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:17.034966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002385+0000","last_change":"2024-09-10T20:40:56.799456+0000","last_active":"2024-09-10T20:41:25.002385+0000","last_peered":"2024-09-10T20:41:25.002385+0000","last_clean":"2024-09-10T20:41:25.002385+0000","last_became_active":"2024-09-10T20:40:56.799162+0000","last_became_peered":"2024-09-10T20:40:56.799162+0000","last_unstale":"2024-09-10T20:41:25.002385+0000","last_undegraded":"2024-09-10T20:41:25.002385+0000","last_fullsized":"2024-09-10T20:41:25.002385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:44.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001628+0000","last_change":"2024-09-10T20:41:24.003152+0000","last_active":"2024-09-10T20:41:25.001628+0000","last_peered":"2024-09-10T20:41:25.001628+0000","last_clean":"2024-09-10T20:41:25.001628+0000","last_became_active":"2024-09-10T20:41:24.001574+0000","last_became_peered":"2024-09-10T20:41:24.001574+0000","last_unstale":"2024-09-10T20:41:25.001628+0000","last_undegraded":"2024-09-10T20:41:25.001628+0000","last_fullsized":"2024-09-10T20:41:25.001628+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:27.997983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724121+0000","last_change":"2024-09-10T20:40:57.802645+0000","last_active":"2024-09-10T20:41:26.724121+0000","last_peered":"2024-09-10T20:41:26.724121+0000","last_clean":"2024-09-10T20:41:26.724121+0000","last_became_active":"2024-09-10T20:40:57.802283+0000","last_became_peered":"2024-09-10T20:40:57.802283+0000","last_unstale":"2024-09-10T20:41:26.724121+0000","last_undegraded":"2024-09-10T20:41:26.724121+0000","last_fullsized":"2024-09-10T20:41:26.724121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:17.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023984+0000","last_change":"2024-09-10T20:40:56.787551+0000","last_active":"2024-09-10T20:41:25.023984+0000","last_peered":"2024-09-10T20:41:25.023984+0000","last_clean":"2024-09-10T20:41:25.023984+0000","last_became_active":"2024-09-10T20:40:56.786720+0000","last_became_peered":"2024-09-10T20:40:56.786720+0000","last_unstale":"2024-09-10T20:41:25.023984+0000","last_undegraded":"2024-09-10T20:41:25.023984+0000","last_fullsized":"2024-09-10T20:41:25.023984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:58.890626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002375+0000","last_change":"2024-09-10T20:41:23.994183+0000","last_active":"2024-09-10T20:41:25.002375+0000","last_peered":"2024-09-10T20:41:25.002375+0000","last_clean":"2024-09-10T20:41:25.002375+0000","last_became_active":"2024-09-10T20:41:23.993219+0000","last_became_peered":"2024-09-10T20:41:23.993219+0000","last_unstale":"2024-09-10T20:41:25.002375+0000","last_undegraded":"2024-09-10T20:41:25.002375+0000","last_fullsized":"2024-09-10T20:41:25.002375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:55.786567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"40'10","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002227+0000","last_change":"2024-09-10T20:40:57.805104+0000","last_active":"2024-09-10T20:41:25.002227+0000","last_peered":"2024-09-10T20:41:25.002227+0000","last_clean":"2024-09-10T20:41:25.002227+0000","last_became_active":"2024-09-10T20:40:57.804894+0000","last_became_peered":"2024-09-10T20:40:57.804894+0000","last_unstale":"2024-09-10T20:41:25.002227+0000","last_undegraded":"2024-09-10T20:41:25.002227+0000","last_fullsized":"2024-09-10T20:41:25.002227+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:06:02.247029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"44'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024048+0000","last_change":"2024-09-10T20:40:56.798785+0000","last_active":"2024-09-10T20:41:25.024048+0000","last_peered":"2024-09-10T20:41:25.024048+0000","last_clean":"2024-09-10T20:41:25.024048+0000","last_became_active":"2024-09-10T20:40:56.798390+0000","last_became_peered":"2024-09-10T20:40:56.798390+0000","last_unstale":"2024-09-10T20:41:25.024048+0000","last_undegraded":"2024-09-10T20:41:25.024048+0000","last_fullsized":"2024-09-10T20:41:25.024048+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:39.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002349+0000","last_change":"2024-09-10T20:41:23.993848+0000","last_active":"2024-09-10T20:41:25.002349+0000","last_peered":"2024-09-10T20:41:25.002349+0000","last_clean":"2024-09-10T20:41:25.002349+0000","last_became_active":"2024-09-10T20:41:23.993558+0000","last_became_peered":"2024-09-10T20:41:23.993558+0000","last_unstale":"2024-09-10T20:41:25.002349+0000","last_undegraded":"2024-09-10T20:41:25.002349+0000","last_fullsized":"2024-09-10T20:41:25.002349+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:05.240195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"40'9","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002434+0000","last_change":"2024-09-10T20:40:57.807154+0000","last_active":"2024-09-10T20:41:25.002434+0000","last_peered":"2024-09-10T20:41:25.002434+0000","last_clean":"2024-09-10T20:41:25.002434+0000","last_became_active":"2024-09-10T20:40:57.806970+0000","last_became_peered":"2024-09-10T20:40:57.806970+0000","last_unstale":"2024-09-10T20:41:25.002434+0000","last_undegraded":"2024-09-10T20:41:25.002434+0000","last_fullsized":"2024-09-10T20:41:25.002434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:25:40.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"44'24","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002928+0000","last_change":"2024-09-10T20:40:56.798461+0000","last_active":"2024-09-10T20:41:25.002928+0000","last_peered":"2024-09-10T20:41:25.002928+0000","last_clean":"2024-09-10T20:41:25.002928+0000","last_became_active":"2024-09-10T20:40:56.798136+0000","last_became_peered":"2024-09-10T20:40:56.798136+0000","last_unstale":"2024-09-10T20:41:25.002928+0000","last_undegraded":"2024-09-10T20:41:25.002928+0000","last_fullsized":"2024-09-10T20:41:25.002928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:51:08.271880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.723926+0000","last_change":"2024-09-10T20:41:23.994788+0000","last_active":"2024-09-10T20:41:26.723926+0000","last_peered":"2024-09-10T20:41:26.723926+0000","last_clean":"2024-09-10T20:41:26.723926+0000","last_became_active":"2024-09-10T20:41:23.994527+0000","last_became_peered":"2024-09-10T20:41:23.994527+0000","last_unstale":"2024-09-10T20:41:26.723926+0000","last_undegraded":"2024-09-10T20:41:26.723926+0000","last_fullsized":"2024-09-10T20:41:26.723926+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:02.794438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001987+0000","last_change":"2024-09-10T20:40:57.800593+0000","last_active":"2024-09-10T20:41:25.001987+0000","last_peered":"2024-09-10T20:41:25.001987+0000","last_clean":"2024-09-10T20:41:25.001987+0000","last_became_active":"2024-09-10T20:40:57.796067+0000","last_became_peered":"2024-09-10T20:40:57.796067+0000","last_unstale":"2024-09-10T20:41:25.001987+0000","last_undegraded":"2024-09-10T20:41:25.001987+0000","last_fullsized":"2024-09-10T20:41:25.001987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:53:13.660313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"44'5","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001700+0000","last_change":"2024-09-10T20:40:56.798892+0000","last_active":"2024-09-10T20:41:25.001700+0000","last_peered":"2024-09-10T20:41:25.001700+0000","last_clean":"2024-09-10T20:41:25.001700+0000","last_became_active":"2024-09-10T20:40:56.798574+0000","last_became_peered":"2024-09-10T20:40:56.798574+0000","last_unstale":"2024-09-10T20:41:25.001700+0000","last_undegraded":"2024-09-10T20:41:25.001700+0000","last_fullsized":"2024-09-10T20:41:25.001700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:12.809899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724419+0000","last_change":"2024-09-10T20:41:23.997814+0000","last_active":"2024-09-10T20:41:26.724419+0000","last_peered":"2024-09-10T20:41:26.724419+0000","last_clean":"2024-09-10T20:41:26.724419+0000","last_became_active":"2024-09-10T20:41:23.997261+0000","last_became_peered":"2024-09-10T20:41:23.997261+0000","last_unstale":"2024-09-10T20:41:26.724419+0000","last_undegraded":"2024-09-10T20:41:26.724419+0000","last_fullsized":"2024-09-10T20:41:26.724419+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:32.851631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295687+0000","last_change":"2024-09-10T20:40:57.789344+0000","last_active":"2024-09-10T20:41:25.295687+0000","last_peered":"2024-09-10T20:41:25.295687+0000","last_clean":"2024-09-10T20:41:25.295687+0000","last_became_active":"2024-09-10T20:40:57.789092+0000","last_became_peered":"2024-09-10T20:40:57.789092+0000","last_unstale":"2024-09-10T20:41:25.295687+0000","last_undegraded":"2024-09-10T20:41:25.295687+0000","last_fullsized":"2024-09-10T20:41:25.295687+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:40.377370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295848+0000","last_change":"2024-09-10T20:40:56.787899+0000","last_active":"2024-09-10T20:41:25.295848+0000","last_peered":"2024-09-10T20:41:25.295848+0000","last_clean":"2024-09-10T20:41:25.295848+0000","last_became_active":"2024-09-10T20:40:56.787509+0000","last_became_peered":"2024-09-10T20:40:56.787509+0000","last_unstale":"2024-09-10T20:41:25.295848+0000","last_undegraded":"2024-09-10T20:41:25.295848+0000","last_fullsized":"2024-09-10T20:41:25.295848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:31:12.249527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724463+0000","last_change":"2024-09-10T20:41:23.993761+0000","last_active":"2024-09-10T20:41:26.724463+0000","last_peered":"2024-09-10T20:41:26.724463+0000","last_clean":"2024-09-10T20:41:26.724463+0000","last_became_active":"2024-09-10T20:41:23.993477+0000","last_became_peered":"2024-09-10T20:41:23.993477+0000","last_unstale":"2024-09-10T20:41:26.724463+0000","last_undegraded":"2024-09-10T20:41:26.724463+0000","last_fullsized":"2024-09-10T20:41:26.724463+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:06.631396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"40'10","reported_seq":38,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267196+0000","last_change":"2024-09-10T20:40:57.786588+0000","last_active":"2024-09-10T20:41:25.267196+0000","last_peered":"2024-09-10T20:41:25.267196+0000","last_clean":"2024-09-10T20:41:25.267196+0000","last_became_active":"2024-09-10T20:40:57.786296+0000","last_became_peered":"2024-09-10T20:40:57.786296+0000","last_unstale":"2024-09-10T20:41:25.267196+0000","last_undegraded":"2024-09-10T20:41:25.267196+0000","last_fullsized":"2024-09-10T20:41:25.267196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:58:36.701688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023573+0000","last_change":"2024-09-10T20:40:56.783758+0000","last_active":"2024-09-10T20:41:25.023573+0000","last_peered":"2024-09-10T20:41:25.023573+0000","last_clean":"2024-09-10T20:41:25.023573+0000","last_became_active":"2024-09-10T20:40:56.783512+0000","last_became_peered":"2024-09-10T20:40:56.783512+0000","last_unstale":"2024-09-10T20:41:25.023573+0000","last_undegraded":"2024-09-10T20:41:25.023573+0000","last_fullsized":"2024-09-10T20:41:25.023573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:39.374632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002192+0000","last_change":"2024-09-10T20:41:24.000925+0000","last_active":"2024-09-10T20:41:25.002192+0000","last_peered":"2024-09-10T20:41:25.002192+0000","last_clean":"2024-09-10T20:41:25.002192+0000","last_became_active":"2024-09-10T20:41:23.999216+0000","last_became_peered":"2024-09-10T20:41:23.999216+0000","last_unstale":"2024-09-10T20:41:25.002192+0000","last_undegraded":"2024-09-10T20:41:25.002192+0000","last_fullsized":"2024-09-10T20:41:25.002192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:36.479766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'15","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724617+0000","last_change":"2024-09-10T20:40:57.801745+0000","last_active":"2024-09-10T20:41:26.724617+0000","last_peered":"2024-09-10T20:41:26.724617+0000","last_clean":"2024-09-10T20:41:26.724617+0000","last_became_active":"2024-09-10T20:40:57.801484+0000","last_became_peered":"2024-09-10T20:40:57.801484+0000","last_unstale":"2024-09-10T20:41:26.724617+0000","last_undegraded":"2024-09-10T20:41:26.724617+0000","last_fullsized":"2024-09-10T20:41:26.724617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:10.503000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"44'15","reported_seq":45,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.723937+0000","last_change":"2024-09-10T20:40:56.779692+0000","last_active":"2024-09-10T20:41:26.723937+0000","last_peered":"2024-09-10T20:41:26.723937+0000","last_clean":"2024-09-10T20:41:26.723937+0000","last_became_active":"2024-09-10T20:40:56.779447+0000","last_became_peered":"2024-09-10T20:40:56.779447+0000","last_unstale":"2024-09-10T20:41:26.723937+0000","last_undegraded":"2024-09-10T20:41:26.723937+0000","last_fullsized":"2024-09-10T20:41:26.723937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:26:15.261201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002291+0000","last_change":"2024-09-10T20:41:23.999605+0000","last_active":"2024-09-10T20:41:25.002291+0000","last_peered":"2024-09-10T20:41:25.002291+0000","last_clean":"2024-09-10T20:41:25.002291+0000","last_became_active":"2024-09-10T20:41:23.998539+0000","last_became_peered":"2024-09-10T20:41:23.998539+0000","last_unstale":"2024-09-10T20:41:25.002291+0000","last_undegraded":"2024-09-10T20:41:25.002291+0000","last_fullsized":"2024-09-10T20:41:25.002291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:26.825035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"40'6","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295947+0000","last_change":"2024-09-10T20:40:57.795777+0000","last_active":"2024-09-10T20:41:25.295947+0000","last_peered":"2024-09-10T20:41:25.295947+0000","last_clean":"2024-09-10T20:41:25.295947+0000","last_became_active":"2024-09-10T20:40:57.795521+0000","last_became_peered":"2024-09-10T20:40:57.795521+0000","last_unstale":"2024-09-10T20:41:25.295947+0000","last_undegraded":"2024-09-10T20:41:25.295947+0000","last_fullsized":"2024-09-10T20:41:25.295947+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:15.958954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"44'2","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002456+0000","last_change":"2024-09-10T20:40:56.792708+0000","last_active":"2024-09-10T20:41:25.002456+0000","last_peered":"2024-09-10T20:41:25.002456+0000","last_clean":"2024-09-10T20:41:25.002456+0000","last_became_active":"2024-09-10T20:40:56.792427+0000","last_became_peered":"2024-09-10T20:40:56.792427+0000","last_unstale":"2024-09-10T20:41:25.002456+0000","last_undegraded":"2024-09-10T20:41:25.002456+0000","last_fullsized":"2024-09-10T20:41:25.002456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:56:40.781428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724124+0000","last_change":"2024-09-10T20:41:24.005055+0000","last_active":"2024-09-10T20:41:26.724124+0000","last_peered":"2024-09-10T20:41:26.724124+0000","last_clean":"2024-09-10T20:41:26.724124+0000","last_became_active":"2024-09-10T20:41:24.004760+0000","last_became_peered":"2024-09-10T20:41:24.004760+0000","last_unstale":"2024-09-10T20:41:26.724124+0000","last_undegraded":"2024-09-10T20:41:26.724124+0000","last_fullsized":"2024-09-10T20:41:26.724124+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:26.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'7","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002465+0000","last_change":"2024-09-10T20:40:57.805292+0000","last_active":"2024-09-10T20:41:25.002465+0000","last_peered":"2024-09-10T20:41:25.002465+0000","last_clean":"2024-09-10T20:41:25.002465+0000","last_became_active":"2024-09-10T20:40:57.804999+0000","last_became_peered":"2024-09-10T20:40:57.804999+0000","last_unstale":"2024-09-10T20:41:25.002465+0000","last_undegraded":"2024-09-10T20:41:25.002465+0000","last_fullsized":"2024-09-10T20:41:25.002465+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:56.651005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024199+0000","last_change":"2024-09-10T20:40:56.798769+0000","last_active":"2024-09-10T20:41:25.024199+0000","last_peered":"2024-09-10T20:41:25.024199+0000","last_clean":"2024-09-10T20:41:25.024199+0000","last_became_active":"2024-09-10T20:40:56.798317+0000","last_became_peered":"2024-09-10T20:40:56.798317+0000","last_unstale":"2024-09-10T20:41:25.024199+0000","last_undegraded":"2024-09-10T20:41:25.024199+0000","last_fullsized":"2024-09-10T20:41:25.024199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:25.510395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724767+0000","last_change":"2024-09-10T20:41:23.999829+0000","last_active":"2024-09-10T20:41:26.724767+0000","last_peered":"2024-09-10T20:41:26.724767+0000","last_clean":"2024-09-10T20:41:26.724767+0000","last_became_active":"2024-09-10T20:41:23.999579+0000","last_became_peered":"2024-09-10T20:41:23.999579+0000","last_unstale":"2024-09-10T20:41:26.724767+0000","last_undegraded":"2024-09-10T20:41:26.724767+0000","last_fullsized":"2024-09-10T20:41:26.724767+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:10.886331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002530+0000","last_change":"2024-09-10T20:40:57.795506+0000","last_active":"2024-09-10T20:41:25.002530+0000","last_peered":"2024-09-10T20:41:25.002530+0000","last_clean":"2024-09-10T20:41:25.002530+0000","last_became_active":"2024-09-10T20:40:57.795238+0000","last_became_peered":"2024-09-10T20:40:57.795238+0000","last_unstale":"2024-09-10T20:41:25.002530+0000","last_undegraded":"2024-09-10T20:41:25.002530+0000","last_fullsized":"2024-09-10T20:41:25.002530+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:06.644143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"44'2","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724594+0000","last_change":"2024-09-10T20:40:56.792843+0000","last_active":"2024-09-10T20:41:26.724594+0000","last_peered":"2024-09-10T20:41:26.724594+0000","last_clean":"2024-09-10T20:41:26.724594+0000","last_became_active":"2024-09-10T20:40:56.792439+0000","last_became_peered":"2024-09-10T20:40:56.792439+0000","last_unstale":"2024-09-10T20:41:26.724594+0000","last_undegraded":"2024-09-10T20:41:26.724594+0000","last_fullsized":"2024-09-10T20:41:26.724594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:49.054542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724734+0000","last_change":"2024-09-10T20:41:23.997742+0000","last_active":"2024-09-10T20:41:26.724734+0000","last_peered":"2024-09-10T20:41:26.724734+0000","last_clean":"2024-09-10T20:41:26.724734+0000","last_became_active":"2024-09-10T20:41:23.997137+0000","last_became_peered":"2024-09-10T20:41:23.997137+0000","last_unstale":"2024-09-10T20:41:26.724734+0000","last_undegraded":"2024-09-10T20:41:26.724734+0000","last_fullsized":"2024-09-10T20:41:26.724734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:40.302580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'9","reported_seq":39,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002615+0000","last_change":"2024-09-10T20:40:57.798663+0000","last_active":"2024-09-10T20:41:25.002615+0000","last_peered":"2024-09-10T20:41:25.002615+0000","last_clean":"2024-09-10T20:41:25.002615+0000","last_became_active":"2024-09-10T20:40:57.798333+0000","last_became_peered":"2024-09-10T20:40:57.798333+0000","last_unstale":"2024-09-10T20:41:25.002615+0000","last_undegraded":"2024-09-10T20:41:25.002615+0000","last_fullsized":"2024-09-10T20:41:25.002615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:38.583327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001861+0000","last_change":"2024-09-10T20:40:56.789841+0000","last_active":"2024-09-10T20:41:25.001861+0000","last_peered":"2024-09-10T20:41:25.001861+0000","last_clean":"2024-09-10T20:41:25.001861+0000","last_became_active":"2024-09-10T20:40:56.789524+0000","last_became_peered":"2024-09-10T20:40:56.789524+0000","last_unstale":"2024-09-10T20:41:25.001861+0000","last_undegraded":"2024-09-10T20:41:25.001861+0000","last_fullsized":"2024-09-10T20:41:25.001861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:09:06.139874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.000981+0000","last_change":"2024-09-10T20:41:24.004828+0000","last_active":"2024-09-10T20:41:25.000981+0000","last_peered":"2024-09-10T20:41:25.000981+0000","last_clean":"2024-09-10T20:41:25.000981+0000","last_became_active":"2024-09-10T20:41:24.004435+0000","last_became_peered":"2024-09-10T20:41:24.004435+0000","last_unstale":"2024-09-10T20:41:25.000981+0000","last_undegraded":"2024-09-10T20:41:25.000981+0000","last_fullsized":"2024-09-10T20:41:25.000981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:07:18.597238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023403+0000","last_change":"2024-09-10T20:40:57.779901+0000","last_active":"2024-09-10T20:41:25.023403+0000","last_peered":"2024-09-10T20:41:25.023403+0000","last_clean":"2024-09-10T20:41:25.023403+0000","last_became_active":"2024-09-10T20:40:57.779489+0000","last_became_peered":"2024-09-10T20:40:57.779489+0000","last_unstale":"2024-09-10T20:41:25.023403+0000","last_undegraded":"2024-09-10T20:41:25.023403+0000","last_fullsized":"2024-09-10T20:41:25.023403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.265123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"44'4","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001474+0000","last_change":"2024-09-10T20:40:56.787107+0000","last_active":"2024-09-10T20:41:25.001474+0000","last_peered":"2024-09-10T20:41:25.001474+0000","last_clean":"2024-09-10T20:41:25.001474+0000","last_became_active":"2024-09-10T20:40:56.786778+0000","last_became_peered":"2024-09-10T20:40:56.786778+0000","last_unstale":"2024-09-10T20:41:25.001474+0000","last_undegraded":"2024-09-10T20:41:25.001474+0000","last_fullsized":"2024-09-10T20:41:25.001474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:21.098826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.000798+0000","last_change":"2024-09-10T20:41:24.003478+0000","last_active":"2024-09-10T20:41:25.000798+0000","last_peered":"2024-09-10T20:41:25.000798+0000","last_clean":"2024-09-10T20:41:25.000798+0000","last_became_active":"2024-09-10T20:41:24.003125+0000","last_became_peered":"2024-09-10T20:41:24.003125+0000","last_unstale":"2024-09-10T20:41:25.000798+0000","last_undegraded":"2024-09-10T20:41:25.000798+0000","last_fullsized":"2024-09-10T20:41:25.000798+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:07.210027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"40'2","reported_seq":31,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001262+0000","last_change":"2024-09-10T20:40:57.805036+0000","last_active":"2024-09-10T20:41:25.001262+0000","last_peered":"2024-09-10T20:41:25.001262+0000","last_clean":"2024-09-10T20:41:25.001262+0000","last_became_active":"2024-09-10T20:40:57.804826+0000","last_became_peered":"2024-09-10T20:40:57.804826+0000","last_unstale":"2024-09-10T20:41:25.001262+0000","last_undegraded":"2024-09-10T20:41:25.001262+0000","last_fullsized":"2024-09-10T20:41:25.001262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:26.742701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295936+0000","last_change":"2024-09-10T20:40:56.792580+0000","last_active":"2024-09-10T20:41:25.295936+0000","last_peered":"2024-09-10T20:41:25.295936+0000","last_clean":"2024-09-10T20:41:25.295936+0000","last_became_active":"2024-09-10T20:40:56.792296+0000","last_became_peered":"2024-09-10T20:40:56.792296+0000","last_unstale":"2024-09-10T20:41:25.295936+0000","last_undegraded":"2024-09-10T20:41:25.295936+0000","last_fullsized":"2024-09-10T20:41:25.295936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:34.728794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295921+0000","last_change":"2024-09-10T20:41:23.999776+0000","last_active":"2024-09-10T20:41:25.295921+0000","last_peered":"2024-09-10T20:41:25.295921+0000","last_clean":"2024-09-10T20:41:25.295921+0000","last_became_active":"2024-09-10T20:41:23.999315+0000","last_became_peered":"2024-09-10T20:41:23.999315+0000","last_unstale":"2024-09-10T20:41:25.295921+0000","last_undegraded":"2024-09-10T20:41:25.295921+0000","last_fullsized":"2024-09-10T20:41:25.295921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:22.338151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267170+0000","last_change":"2024-09-10T20:40:57.798757+0000","last_active":"2024-09-10T20:41:25.267170+0000","last_peered":"2024-09-10T20:41:25.267170+0000","last_clean":"2024-09-10T20:41:25.267170+0000","last_became_active":"2024-09-10T20:40:57.796635+0000","last_became_peered":"2024-09-10T20:40:57.796635+0000","last_unstale":"2024-09-10T20:41:25.267170+0000","last_undegraded":"2024-09-10T20:41:25.267170+0000","last_fullsized":"2024-09-10T20:41:25.267170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:19.855245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002083+0000","last_change":"2024-09-10T20:40:56.779612+0000","last_active":"2024-09-10T20:41:25.002083+0000","last_peered":"2024-09-10T20:41:25.002083+0000","last_clean":"2024-09-10T20:41:25.002083+0000","last_became_active":"2024-09-10T20:40:56.779319+0000","last_became_peered":"2024-09-10T20:40:56.779319+0000","last_unstale":"2024-09-10T20:41:25.002083+0000","last_undegraded":"2024-09-10T20:41:25.002083+0000","last_fullsized":"2024-09-10T20:41:25.002083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:20.129458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001203+0000","last_change":"2024-09-10T20:41:24.002621+0000","last_active":"2024-09-10T20:41:25.001203+0000","last_peered":"2024-09-10T20:41:25.001203+0000","last_clean":"2024-09-10T20:41:25.001203+0000","last_became_active":"2024-09-10T20:41:24.001969+0000","last_became_peered":"2024-09-10T20:41:24.001969+0000","last_unstale":"2024-09-10T20:41:25.001203+0000","last_undegraded":"2024-09-10T20:41:25.001203+0000","last_fullsized":"2024-09-10T20:41:25.001203+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:38.113389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'8","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001137+0000","last_change":"2024-09-10T20:40:57.794987+0000","last_active":"2024-09-10T20:41:25.001137+0000","last_peered":"2024-09-10T20:41:25.001137+0000","last_clean":"2024-09-10T20:41:25.001137+0000","last_became_active":"2024-09-10T20:40:57.794701+0000","last_became_peered":"2024-09-10T20:40:57.794701+0000","last_unstale":"2024-09-10T20:41:25.001137+0000","last_undegraded":"2024-09-10T20:41:25.001137+0000","last_fullsized":"2024-09-10T20:41:25.001137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:35.070564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295553+0000","last_change":"2024-09-10T20:40:56.796619+0000","last_active":"2024-09-10T20:41:25.295553+0000","last_peered":"2024-09-10T20:41:25.295553+0000","last_clean":"2024-09-10T20:41:25.295553+0000","last_became_active":"2024-09-10T20:40:56.796334+0000","last_became_peered":"2024-09-10T20:40:56.796334+0000","last_unstale":"2024-09-10T20:41:25.295553+0000","last_undegraded":"2024-09-10T20:41:25.295553+0000","last_fullsized":"2024-09-10T20:41:25.295553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:35:18.035879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024094+0000","last_change":"2024-09-10T20:41:24.002545+0000","last_active":"2024-09-10T20:41:25.024094+0000","last_peered":"2024-09-10T20:41:25.024094+0000","last_clean":"2024-09-10T20:41:25.024094+0000","last_became_active":"2024-09-10T20:41:24.002269+0000","last_became_peered":"2024-09-10T20:41:24.002269+0000","last_unstale":"2024-09-10T20:41:25.024094+0000","last_undegraded":"2024-09-10T20:41:25.024094+0000","last_fullsized":"2024-09-10T20:41:25.024094+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:11:29.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"40'9","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724546+0000","last_change":"2024-09-10T20:40:57.797064+0000","last_active":"2024-09-10T20:41:26.724546+0000","last_peered":"2024-09-10T20:41:26.724546+0000","last_clean":"2024-09-10T20:41:26.724546+0000","last_became_active":"2024-09-10T20:40:57.796778+0000","last_became_peered":"2024-09-10T20:40:57.796778+0000","last_unstale":"2024-09-10T20:41:26.724546+0000","last_undegraded":"2024-09-10T20:41:26.724546+0000","last_fullsized":"2024-09-10T20:41:26.724546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:02:13.812637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"44'3","reported_seq":32,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024157+0000","last_change":"2024-09-10T20:40:56.781802+0000","last_active":"2024-09-10T20:41:25.024157+0000","last_peered":"2024-09-10T20:41:25.024157+0000","last_clean":"2024-09-10T20:41:25.024157+0000","last_became_active":"2024-09-10T20:40:56.781430+0000","last_became_peered":"2024-09-10T20:40:56.781430+0000","last_unstale":"2024-09-10T20:41:25.024157+0000","last_undegraded":"2024-09-10T20:41:25.024157+0000","last_fullsized":"2024-09-10T20:41:25.024157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:58:52.211948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002451+0000","last_change":"2024-09-10T20:41:23.999122+0000","last_active":"2024-09-10T20:41:25.002451+0000","last_peered":"2024-09-10T20:41:25.002451+0000","last_clean":"2024-09-10T20:41:25.002451+0000","last_became_active":"2024-09-10T20:41:23.996737+0000","last_became_peered":"2024-09-10T20:41:23.996737+0000","last_unstale":"2024-09-10T20:41:25.002451+0000","last_undegraded":"2024-09-10T20:41:25.002451+0000","last_fullsized":"2024-09-10T20:41:25.002451+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:04.584893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"40'5","reported_seq":33,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267543+0000","last_change":"2024-09-10T20:40:57.797088+0000","last_active":"2024-09-10T20:41:25.267543+0000","last_peered":"2024-09-10T20:41:25.267543+0000","last_clean":"2024-09-10T20:41:25.267543+0000","last_became_active":"2024-09-10T20:40:57.796516+0000","last_became_peered":"2024-09-10T20:40:57.796516+0000","last_unstale":"2024-09-10T20:41:25.267543+0000","last_undegraded":"2024-09-10T20:41:25.267543+0000","last_fullsized":"2024-09-10T20:41:25.267543+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:23.886368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"44'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724991+0000","last_change":"2024-09-10T20:40:56.792746+0000","last_active":"2024-09-10T20:41:26.724991+0000","last_peered":"2024-09-10T20:41:26.724991+0000","last_clean":"2024-09-10T20:41:26.724991+0000","last_became_active":"2024-09-10T20:40:56.792409+0000","last_became_peered":"2024-09-10T20:40:56.792409+0000","last_unstale":"2024-09-10T20:41:26.724991+0000","last_undegraded":"2024-09-10T20:41:26.724991+0000","last_fullsized":"2024-09-10T20:41:26.724991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:11.802685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024072+0000","last_change":"2024-09-10T20:41:24.001797+0000","last_active":"2024-09-10T20:41:25.024072+0000","last_peered":"2024-09-10T20:41:25.024072+0000","last_clean":"2024-09-10T20:41:25.024072+0000","last_became_active":"2024-09-10T20:41:24.001549+0000","last_became_peered":"2024-09-10T20:41:24.001549+0000","last_unstale":"2024-09-10T20:41:25.024072+0000","last_undegraded":"2024-09-10T20:41:25.024072+0000","last_fullsized":"2024-09-10T20:41:25.024072+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:51:51.657538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"40'7","reported_seq":37,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001609+0000","last_change":"2024-09-10T20:40:57.780255+0000","last_active":"2024-09-10T20:41:25.001609+0000","last_peered":"2024-09-10T20:41:25.001609+0000","last_clean":"2024-09-10T20:41:25.001609+0000","last_became_active":"2024-09-10T20:40:57.779962+0000","last_became_peered":"2024-09-10T20:40:57.779962+0000","last_unstale":"2024-09-10T20:41:25.001609+0000","last_undegraded":"2024-09-10T20:41:25.001609+0000","last_fullsized":"2024-09-10T20:41:25.001609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:15.246352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724599+0000","last_change":"2024-09-10T20:40:56.800962+0000","last_active":"2024-09-10T20:41:26.724599+0000","last_peered":"2024-09-10T20:41:26.724599+0000","last_clean":"2024-09-10T20:41:26.724599+0000","last_became_active":"2024-09-10T20:40:56.800727+0000","last_became_peered":"2024-09-10T20:40:56.800727+0000","last_unstale":"2024-09-10T20:41:26.724599+0000","last_undegraded":"2024-09-10T20:41:26.724599+0000","last_fullsized":"2024-09-10T20:41:26.724599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:52.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.723971+0000","last_change":"2024-09-10T20:41:24.001291+0000","last_active":"2024-09-10T20:41:26.723971+0000","last_peered":"2024-09-10T20:41:26.723971+0000","last_clean":"2024-09-10T20:41:26.723971+0000","last_became_active":"2024-09-10T20:41:24.000871+0000","last_became_peered":"2024-09-10T20:41:24.000871+0000","last_unstale":"2024-09-10T20:41:26.723971+0000","last_undegraded":"2024-09-10T20:41:26.723971+0000","last_fullsized":"2024-09-10T20:41:26.723971+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:42:07.175663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:26.724287+0000","last_change":"2024-09-10T20:40:57.793540+0000","last_active":"2024-09-10T20:41:26.724287+0000","last_peered":"2024-09-10T20:41:26.724287+0000","last_clean":"2024-09-10T20:41:26.724287+0000","last_became_active":"2024-09-10T20:40:57.793231+0000","last_became_peered":"2024-09-10T20:40:57.793231+0000","last_unstale":"2024-09-10T20:41:26.724287+0000","last_undegraded":"2024-09-10T20:41:26.724287+0000","last_fullsized":"2024-09-10T20:41:26.724287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:43.458885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001847+0000","last_change":"2024-09-10T20:40:56.795661+0000","last_active":"2024-09-10T20:41:25.001847+0000","last_peered":"2024-09-10T20:41:25.001847+0000","last_clean":"2024-09-10T20:41:25.001847+0000","last_became_active":"2024-09-10T20:40:56.794893+0000","last_became_peered":"2024-09-10T20:40:56.794893+0000","last_unstale":"2024-09-10T20:41:25.001847+0000","last_undegraded":"2024-09-10T20:41:25.001847+0000","last_fullsized":"2024-09-10T20:41:25.001847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:55:56.476490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001972+0000","last_change":"2024-09-10T20:41:23.999188+0000","last_active":"2024-09-10T20:41:25.001972+0000","last_peered":"2024-09-10T20:41:25.001972+0000","last_clean":"2024-09-10T20:41:25.001972+0000","last_became_active":"2024-09-10T20:41:23.998882+0000","last_became_peered":"2024-09-10T20:41:23.998882+0000","last_unstale":"2024-09-10T20:41:25.001972+0000","last_undegraded":"2024-09-10T20:41:25.001972+0000","last_fullsized":"2024-09-10T20:41:25.001972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:06.148067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"40'5","reported_seq":34,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.295734+0000","last_change":"2024-09-10T20:40:57.777674+0000","last_active":"2024-09-10T20:41:25.295734+0000","last_peered":"2024-09-10T20:41:25.295734+0000","last_clean":"2024-09-10T20:41:25.295734+0000","last_became_active":"2024-09-10T20:40:57.776652+0000","last_became_peered":"2024-09-10T20:40:57.776652+0000","last_unstale":"2024-09-10T20:41:25.295734+0000","last_undegraded":"2024-09-10T20:41:25.295734+0000","last_fullsized":"2024-09-10T20:41:25.295734+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:02:22.672592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267291+0000","last_change":"2024-09-10T20:40:56.786260+0000","last_active":"2024-09-10T20:41:25.267291+0000","last_peered":"2024-09-10T20:41:25.267291+0000","last_clean":"2024-09-10T20:41:25.267291+0000","last_became_active":"2024-09-10T20:40:56.785702+0000","last_became_peered":"2024-09-10T20:40:56.785702+0000","last_unstale":"2024-09-10T20:41:25.267291+0000","last_undegraded":"2024-09-10T20:41:25.267291+0000","last_fullsized":"2024-09-10T20:41:25.267291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:39:13.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001269+0000","last_change":"2024-09-10T20:41:24.001135+0000","last_active":"2024-09-10T20:41:25.001269+0000","last_peered":"2024-09-10T20:41:25.001269+0000","last_clean":"2024-09-10T20:41:25.001269+0000","last_became_active":"2024-09-10T20:41:24.000808+0000","last_became_peered":"2024-09-10T20:41:24.000808+0000","last_unstale":"2024-09-10T20:41:25.001269+0000","last_undegraded":"2024-09-10T20:41:25.001269+0000","last_fullsized":"2024-09-10T20:41:25.001269+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:08:37.693958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023703+0000","last_change":"2024-09-10T20:40:57.793392+0000","last_active":"2024-09-10T20:41:25.023703+0000","last_peered":"2024-09-10T20:41:25.023703+0000","last_clean":"2024-09-10T20:41:25.023703+0000","last_became_active":"2024-09-10T20:40:57.793192+0000","last_became_peered":"2024-09-10T20:40:57.793192+0000","last_unstale":"2024-09-10T20:41:25.023703+0000","last_undegraded":"2024-09-10T20:41:25.023703+0000","last_fullsized":"2024-09-10T20:41:25.023703+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:25:04.659598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.023685+0000","last_change":"2024-09-10T20:40:56.781668+0000","last_active":"2024-09-10T20:41:25.023685+0000","last_peered":"2024-09-10T20:41:25.023685+0000","last_clean":"2024-09-10T20:41:25.023685+0000","last_became_active":"2024-09-10T20:40:56.781402+0000","last_became_peered":"2024-09-10T20:40:56.781402+0000","last_unstale":"2024-09-10T20:41:25.023685+0000","last_undegraded":"2024-09-10T20:41:25.023685+0000","last_fullsized":"2024-09-10T20:41:25.023685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:31:35.584212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001449+0000","last_change":"2024-09-10T20:41:24.002138+0000","last_active":"2024-09-10T20:41:25.001449+0000","last_peered":"2024-09-10T20:41:25.001449+0000","last_clean":"2024-09-10T20:41:25.001449+0000","last_became_active":"2024-09-10T20:41:24.001620+0000","last_became_peered":"2024-09-10T20:41:24.001620+0000","last_unstale":"2024-09-10T20:41:25.001449+0000","last_undegraded":"2024-09-10T20:41:25.001449+0000","last_fullsized":"2024-09-10T20:41:25.001449+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:13.979541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"40'7","reported_seq":35,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267202+0000","last_change":"2024-09-10T20:40:57.789700+0000","last_active":"2024-09-10T20:41:25.267202+0000","last_peered":"2024-09-10T20:41:25.267202+0000","last_clean":"2024-09-10T20:41:25.267202+0000","last_became_active":"2024-09-10T20:40:57.789433+0000","last_became_peered":"2024-09-10T20:40:57.789433+0000","last_unstale":"2024-09-10T20:41:25.267202+0000","last_undegraded":"2024-09-10T20:41:25.267202+0000","last_fullsized":"2024-09-10T20:41:25.267202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:28.800368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002615+0000","last_change":"2024-09-10T20:40:56.795619+0000","last_active":"2024-09-10T20:41:25.002615+0000","last_peered":"2024-09-10T20:41:25.002615+0000","last_clean":"2024-09-10T20:41:25.002615+0000","last_became_active":"2024-09-10T20:40:56.795292+0000","last_became_peered":"2024-09-10T20:40:56.795292+0000","last_unstale":"2024-09-10T20:41:25.002615+0000","last_undegraded":"2024-09-10T20:41:25.002615+0000","last_fullsized":"2024-09-10T20:41:25.002615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:23:09.500262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.001466+0000","last_change":"2024-09-10T20:41:24.003609+0000","last_active":"2024-09-10T20:41:25.001466+0000","last_peered":"2024-09-10T20:41:25.001466+0000","last_clean":"2024-09-10T20:41:25.001466+0000","last_became_active":"2024-09-10T20:41:24.002344+0000","last_became_peered":"2024-09-10T20:41:24.002344+0000","last_unstale":"2024-09-10T20:41:25.001466+0000","last_undegraded":"2024-09-10T20:41:25.001466+0000","last_fullsized":"2024-09-10T20:41:25.001466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:41:22.962532+0000","last_clean_scrub_stamp":"2024-09-10T20:41:22.962532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:49.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'8","reported_seq":36,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.024030+0000","last_change":"2024-09-10T20:40:57.784029+0000","last_active":"2024-09-10T20:41:25.024030+0000","last_peered":"2024-09-10T20:41:25.024030+0000","last_clean":"2024-09-10T20:41:25.024030+0000","last_became_active":"2024-09-10T20:40:57.783716+0000","last_became_peered":"2024-09-10T20:40:57.783716+0000","last_unstale":"2024-09-10T20:41:25.024030+0000","last_undegraded":"2024-09-10T20:41:25.024030+0000","last_fullsized":"2024-09-10T20:41:25.024030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:56.755044+0000","last_clean_scrub_stamp":"2024-09-10T20:40:56.755044+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:02:31.876811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.267214+0000","last_change":"2024-09-10T20:40:56.785344+0000","last_active":"2024-09-10T20:41:25.267214+0000","last_peered":"2024-09-10T20:41:25.267214+0000","last_clean":"2024-09-10T20:41:25.267214+0000","last_became_active":"2024-09-10T20:40:56.785096+0000","last_became_peered":"2024-09-10T20:40:56.785096+0000","last_unstale":"2024-09-10T20:41:25.267214+0000","last_undegraded":"2024-09-10T20:41:25.267214+0000","last_fullsized":"2024-09-10T20:41:25.267214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:40:55.752306+0000","last_clean_scrub_stamp":"2024-09-10T20:40:55.752306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:41:17.289786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":159,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-10T20:41:25.002333+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:25.002333+0000","last_peered":"2024-09-10T20:41:25.002333+0000","last_clean":"2024-09-10T20:41:25.002333+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:25.002333+0000","last_undegraded":"2024-09-10T20:41:25.002333+0000","last_fullsized":"2024-09-10T20:41:25.002333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":98,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6844416,"data_stored":6540388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":248932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1146880,"data_stored":839300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29616,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342224,"statfs":{"total":96636764160,"available":96606437376,"internally_reserved":0,"allocated":2650112,"data_stored":2346084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":5216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":5341184,"data_stored":5033604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:33.297 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:41:33.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -s 2024-09-10T20:41:33.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 -- 172.21.15.81:0/1123656828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba80d2870 msgr2=0x7f4ba80cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 --2- 172.21.15.81:0/1123656828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba80d2870 0x7f4ba80cf0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0005fd0 tx=0x7f4ba002a8a0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 -- 172.21.15.81:0/1123656828 shutdown_connections 2024-09-10T20:41:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 --2- 172.21.15.81:0/1123656828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba80d2870 0x7f4ba80cf0a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 --2- 172.21.15.81:0/1123656828 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ba8161120 0x7f4ba806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 -- 172.21.15.81:0/1123656828 >> 172.21.15.81:0/1123656828 conn(0x7f4ba80d3c20 msgr2=0x7f4ba80d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 -- 172.21.15.81:0/1123656828 shutdown_connections 2024-09-10T20:41:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.481+0000 7f4bad000640 1 -- 172.21.15.81:0/1123656828 wait complete. 2024-09-10T20:41:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.483+0000 7f4bad000640 1 Processor -- start 2024-09-10T20:41:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.483+0000 7f4bad000640 1 -- start start 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4bad000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ba80d0d20 0x7f4ba815ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4bad000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ba80d2870 0x7f4ba81f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4bad000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8161120 0x7f4ba81f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4bad000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba806d260 con 0x7f4ba8161120 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4bad000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba806d0e0 con 0x7f4ba80d2870 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4bad000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba80d4740 con 0x7f4ba80d0d20 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8161120 0x7f4ba81f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8161120 0x7f4ba81f8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41300/0 (socket says 172.21.15.81:41300) 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 -- 172.21.15.81:0/2120310512 learned_addr learned my addr 172.21.15.81:0/2120310512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4b9fe00640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ba80d2870 0x7f4ba81f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7400640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ba80d0d20 0x7f4ba815ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 -- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ba80d0d20 msgr2=0x7f4ba815ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ba80d0d20 0x7f4ba815ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 -- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ba80d2870 msgr2=0x7f4ba81f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ba80d2870 0x7f4ba81f7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7e00640 1 -- 172.21.15.81:0/2120310512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba81f52e0 con 0x7f4ba8161120 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4ba7400640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ba80d0d20 0x7f4ba815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.484+0000 7f4b9fe00640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ba80d2870 0x7f4ba81f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.485+0000 7f4ba7e00640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8161120 0x7f4ba81f8040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009b30 tx=0x7f4ba0032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.485+0000 7f4b9f400640 1 -- 172.21.15.81:0/2120310512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0031430 con 0x7f4ba8161120 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.485+0000 7f4b9f400640 1 -- 172.21.15.81:0/2120310512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ba0004450 con 0x7f4ba8161120 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.485+0000 7f4b9f400640 1 -- 172.21.15.81:0/2120310512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0045410 con 0x7f4ba8161120 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.485+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba80c7750 con 0x7f4ba8161120 2024-09-10T20:41:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.485+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba80c7d10 con 0x7f4ba8161120 2024-09-10T20:41:33.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.486+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba806cba0 con 0x7f4ba8161120 2024-09-10T20:41:33.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.487+0000 7f4b9f400640 1 -- 172.21.15.81:0/2120310512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4ba0030070 con 0x7f4ba8161120 2024-09-10T20:41:33.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.488+0000 7f4b9f400640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4b84077f70 0x7f4b8407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.488+0000 7f4b9f400640 1 -- 172.21.15.81:0/2120310512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f4ba002e020 con 0x7f4ba8161120 2024-09-10T20:41:33.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.489+0000 7f4ba7400640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4b84077f70 0x7f4b8407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.489+0000 7f4ba7400640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4b84077f70 0x7f4b8407a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800a850 tx=0x7f4b98008040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.492+0000 7f4b9f400640 1 -- 172.21.15.81:0/2120310512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4ba00836d0 con 0x7f4ba8161120 2024-09-10T20:41:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.742+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f4ba80d11d0 con 0x7f4ba8161120 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.743+0000 7f4b9f400640 1 -- 172.21.15.81:0/2120310512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+546 (secure 0 0 0) 0x7f4ba0088100 con 0x7f4ba8161120 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: cluster: 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: id: 0ea88071-0b16-46b5-b258-7e2fd8f41721 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: health: HEALTH_ERR 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2 filesystems are degraded 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2 filesystems are offline 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: services: 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-09-10T20:41:33.748 INFO:teuthology.orchestra.run.smithi081.stdout: mgr: x(active, since 2m), standbys: y 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: mds: 0/2 daemons up (2 failed), 4 standby 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: osd: 8 osds: 8 up (since 112s), 8 in (since 2m) 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: data: 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: volumes: 0/2 healthy, 2 failed 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: pools: 4 pools, 129 pgs 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: objects: 4 objects, 6.6 MiB 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: usage: 229 MiB used, 720 GiB / 720 GiB avail 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: pgs: 129 active+clean 2024-09-10T20:41:33.749 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4b84077f70 msgr2=0x7f4b8407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4b84077f70 0x7f4b8407a430 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800a850 tx=0x7f4b98008040 comp rx=0 tx=0).stop 2024-09-10T20:41:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8161120 msgr2=0x7f4ba81f8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8161120 0x7f4ba81f8040 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009b30 tx=0x7f4ba0032d30 comp rx=0 tx=0).stop 2024-09-10T20:41:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 shutdown_connections 2024-09-10T20:41:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4b84077f70 0x7f4b8407a430 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ba8161120 0x7f4ba81f8040 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4ba80d2870 0x7f4ba81f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 --2- 172.21.15.81:0/2120310512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4ba80d0d20 0x7f4ba815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 >> 172.21.15.81:0/2120310512 conn(0x7f4ba80d3c20 msgr2=0x7f4ba80b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 shutdown_connections 2024-09-10T20:41:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.746+0000 7f4bad000640 1 -- 172.21.15.81:0/2120310512 wait complete. 2024-09-10T20:41:33.765 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init --force-init --filesystem recovery_fs --alternate-pool recovery_fs_metadata 2024-09-10T20:41:33.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.836+0000 7f428fe0c740 1 -- start start 2024-09-10T20:41:33.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.836+0000 7f428fe0c740 1 Processor -- start 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.837+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c62d6c00 0x55c6c6456000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.837+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c62d7800 0x55c6c6456580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.837+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c62d7c00 0x55c6c6456b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.837+0000 7f428fe0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c6c70b8180 con 0x55c6c62d7800 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.837+0000 7f428fe0c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c6c70b8300 con 0x55c6c62d6c00 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.837+0000 7f428fe0c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55c6c70b8480 con 0x55c6c62d7c00 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c62d7800 0x55c6c6456580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c62d7800 0x55c6c6456580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41320/0 (socket says 172.21.15.81:41320) 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 -- 172.21.15.81:0/510956711 learned_addr learned my addr 172.21.15.81:0/510956711 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428de00640 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c62d7c00 0x55c6c6456b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428d400640 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c62d6c00 0x55c6c6456000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 -- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c62d7c00 msgr2=0x55c6c6456b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c62d7c00 0x55c6c6456b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 -- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c62d6c00 msgr2=0x55c6c6456000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c62d6c00 0x55c6c6456000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 -- 172.21.15.81:0/510956711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6c6303680 con 0x55c6c62d7800 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428de00640 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c62d7c00 0x55c6c6456b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428d400640 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c62d6c00 0x55c6c6456000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428ca00640 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c62d7800 0x55c6c6456580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55c6c71b4120 tx=0x55c6c7086fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59eda45619cb2759 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.838+0000 7f428a200640 1 -- 172.21.15.81:0/510956711 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c6c62fcea0 con 0x55c6c62d7800 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428a200640 1 -- 172.21.15.81:0/510956711 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c6c632c8c0 con 0x55c6c62d7800 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428a200640 1 -- 172.21.15.81:0/510956711 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c6c62fd380 con 0x55c6c62d7800 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428fe0c740 1 -- 172.21.15.81:0/510956711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6c6303860 con 0x55c6c62d7800 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428fe0c740 1 -- 172.21.15.81:0/510956711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55c6c63032c0 con 0x55c6c62d7800 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428fe0c740 4 waiting for MDS map... 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428a200640 1 -- 172.21.15.81:0/510956711 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x55c6c71ba600 con 0x55c6c62d7800 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428a200640 1 -- 172.21.15.81:0/510956711 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x55c6c6331180 con 0x55c6c62d7800 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428fe0c740 4 Got MDS map 25 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428fe0c740 4 datascan.main: Using metadata pool output 2024-09-10T20:41:33.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.839+0000 7f428fe0c740 4 datascan.main: connecting to RADOS... 2024-09-10T20:41:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.840+0000 7f428fe0c740 1 Processor -- start 2024-09-10T20:41:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.840+0000 7f428fe0c740 1 -- start start 2024-09-10T20:41:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bdc00 0x55c6c6457080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c7210000 0x55c6c6457600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c7210400 0x55c6c6457b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428fe0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c6c70b8600 con 0x55c6c71bdc00 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428fe0c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c6c70b8780 con 0x55c6c7210400 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428fe0c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55c6c70b8900 con 0x55c6c7210000 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bdc00 0x55c6c6457080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bdc00 0x55c6c6457080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41334/0 (socket says 172.21.15.81:41334) 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 -- 172.21.15.81:0/998242467 learned_addr learned my addr 172.21.15.81:0/998242467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428d400640 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c7210000 0x55c6c6457600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428ca00640 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c7210400 0x55c6c6457b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 -- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c7210000 msgr2=0x55c6c6457600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c7210000 0x55c6c6457600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 -- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c7210400 msgr2=0x55c6c6457b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c7210400 0x55c6c6457b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.841+0000 7f428de00640 1 -- 172.21.15.81:0/998242467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6c63034a0 con 0x55c6c71bdc00 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428de00640 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bdc00 0x55c6c6457080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55c6c71017a0 tx=0x55c6c71ccc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4d264572e406e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f4287a00640 1 -- 172.21.15.81:0/998242467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c6c62fc340 con 0x55c6c71bdc00 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f4287a00640 1 -- 172.21.15.81:0/998242467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c6c632cfc0 con 0x55c6c71bdc00 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f4287a00640 1 -- 172.21.15.81:0/998242467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c6c62fcea0 con 0x55c6c71bdc00 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 -- 172.21.15.81:0/998242467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bdc00 msgr2=0x55c6c6457080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bdc00 0x55c6c6457080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55c6c71017a0 tx=0x55c6c71ccc00 comp rx=0 tx=0).stop 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 -- 172.21.15.81:0/998242467 shutdown_connections 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c7210400 0x55c6c6457b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c7210000 0x55c6c6457600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 --2- 172.21.15.81:0/998242467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bdc00 0x55c6c6457080 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 -- 172.21.15.81:0/998242467 >> 172.21.15.81:0/998242467 conn(0x55c6c71bd800 msgr2=0x55c6c63c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 -- 172.21.15.81:0/998242467 shutdown_connections 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.842+0000 7f428fe0c740 1 -- 172.21.15.81:0/998242467 wait complete. 2024-09-10T20:41:33.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.843+0000 7f428fe0c740 1 Processor -- start 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.843+0000 7f428fe0c740 1 -- start start 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bd800 0x55c6c6457080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c721c000 0x55c6c6457600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428fe0c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c721c400 0x55c6c6457b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428fe0c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c6c6339980 con 0x55c6c71bd800 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428fe0c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c6c70b9e00 con 0x55c6c721c000 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428fe0c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55c6c70b8d80 con 0x55c6c721c400 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bd800 0x55c6c6457080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bd800 0x55c6c6457080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41340/0 (socket says 172.21.15.81:41340) 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 -- 172.21.15.81:0/3424466075 learned_addr learned my addr 172.21.15.81:0/3424466075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428ca00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c721c400 0x55c6c6457b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428d400640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c721c000 0x55c6c6457600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 -- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c721c400 msgr2=0x55c6c6457b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c721c400 0x55c6c6457b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 -- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c721c000 msgr2=0x55c6c6457600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c721c000 0x55c6c6457600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428de00640 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6c6303680 con 0x55c6c71bd800 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.844+0000 7f428d400640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c721c000 0x55c6c6457600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.845+0000 7f428de00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bd800 0x55c6c6457080 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55c6c71b57a0 tx=0x55c6c7060300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.845+0000 7f4285c00640 1 -- 172.21.15.81:0/3424466075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c6c62fd380 con 0x55c6c71bd800 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.845+0000 7f4285c00640 1 -- 172.21.15.81:0/3424466075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c6c632ce00 con 0x55c6c71bd800 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.845+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6c6303860 con 0x55c6c71bd800 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.845+0000 7f4285c00640 1 -- 172.21.15.81:0/3424466075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c6c62fd040 con 0x55c6c71bd800 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.845+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6c63030e0 con 0x55c6c71bd800 2024-09-10T20:41:33.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.845+0000 7f428fe0c740 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-09-10T20:41:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.847+0000 7f4285c00640 1 -- 172.21.15.81:0/3424466075 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x55c6c6331500 con 0x55c6c71bd800 2024-09-10T20:41:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.847+0000 7f4285c00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55c6c6678000 0x55c6c6458100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.847+0000 7f4285c00640 1 -- 172.21.15.81:0/3424466075 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x55c6c70ea600 con 0x55c6c71bd800 2024-09-10T20:41:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.848+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55c6c721c800 0x55c6c6458680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.848+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:1 7.14 7:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x55c6c721cc00 con 0x55c6c721c800 2024-09-10T20:41:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.848+0000 7f428d400640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55c6c6678000 0x55c6c6458100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.848+0000 7f428ca00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55c6c721c800 0x55c6c6458680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.849+0000 7f428d400640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55c6c6678000 0x55c6c6458100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55c6c71b4000 tx=0x55c6c667e3c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.849+0000 7f428ca00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55c6c721c800 0x55c6c6458680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.849+0000 7f428ca00640 1 -- 172.21.15.81:0/3424466075 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 160+0+0 (crc 0 0 0) 0x55c6c63e0000 con 0x55c6c721c800 2024-09-10T20:41:33.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.849+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:2 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x55c6c721d000 con 0x55c6c721c800 2024-09-10T20:41:33.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.851+0000 7f428ca00640 1 -- 172.21.15.81:0/3424466075 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~582] v50'1 uv1 ondisk = 0) ==== 160+0+0 (crc 0 0 0) 0x55c6c63e0000 con 0x55c6c721c800 2024-09-10T20:41:33.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.851+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55c6c721d400 0x55c6c6458c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.851+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:3 7.1f 7:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x55c6c721d800 con 0x55c6c721d400 2024-09-10T20:41:33.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.851+0000 7f428de00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55c6c721d400 0x55c6c6458c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.852+0000 7f428de00640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55c6c721d400 0x55c6c6458c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.852+0000 7f428de00640 1 -- 172.21.15.81:0/3424466075 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 162+0+0 (crc 0 0 0) 0x55c6c63e0500 con 0x55c6c721d400 2024-09-10T20:41:33.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.852+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:4 7.1f 7:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x55c6c721dc00 con 0x55c6c721d400 2024-09-10T20:41:33.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.854+0000 7f428de00640 1 -- 172.21.15.81:0/3424466075 <== osd.0 v2:172.21.15.81:6800/4080460515 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~582] v50'1 uv1 ondisk = 0) ==== 162+0+0 (crc 0 0 0) 0x55c6c63e0500 con 0x55c6c721d400 2024-09-10T20:41:33.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.854+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55c6c6679000 0x55c6c6459180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.854+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:5 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x55c6c6679400 con 0x55c6c6679000 2024-09-10T20:41:33.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.855+0000 7f428d400640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55c6c6679000 0x55c6c6459180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.856+0000 7f428d400640 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55c6c6679000 0x55c6c6459180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.856+0000 7f428d400640 1 -- 172.21.15.81:0/3424466075 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55c6c63e0780 con 0x55c6c6679000 2024-09-10T20:41:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.856+0000 7f428fe0c740 10 datascan.find_or_create_dirfrag: read_version = 0 2024-09-10T20:41:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.856+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:6 7.13 7:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x55c6c6679800 con 0x55c6c6679000 2024-09-10T20:41:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.857+0000 7f428d400640 1 -- 172.21.15.81:0/3424466075 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v50'1 uv1 ondisk = 0) ==== 198+0+0 (crc 0 0 0) 0x55c6c63e0780 con 0x55c6c6679000 2024-09-10T20:41:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.857+0000 7f428fe0c740 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2024-09-10T20:41:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.857+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55c6c721d400 msgr2=0x55c6c6458c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55c6c721d400 0x55c6c6458c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55c6c721c800 msgr2=0x55c6c6458680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55c6c721c800 0x55c6c6458680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55c6c6679000 msgr2=0x55c6c6459180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55c6c6679000 0x55c6c6459180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428d400640 1 -- 172.21.15.81:0/3424466075 reap_dead start 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55c6c6678000 msgr2=0x55c6c6458100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55c6c6678000 0x55c6c6458100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55c6c71b4000 tx=0x55c6c667e3c0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bd800 msgr2=0x55c6c6457080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bd800 0x55c6c6457080 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55c6c71b57a0 tx=0x55c6c7060300 comp rx=0 tx=0).stop 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 shutdown_connections 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55c6c6678000 0x55c6c6458100 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/3424466075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c71bd800 0x55c6c6457080 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 >> 172.21.15.81:0/3424466075 conn(0x55c6c71bdc00 msgr2=0x55c6c63c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 shutdown_connections 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/3424466075 wait complete. 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/510956711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c62d7800 msgr2=0x55c6c6456580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c62d7800 0x55c6c6456580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55c6c71b4120 tx=0x55c6c7086fc0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/510956711 shutdown_connections 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c6c62d7c00 0x55c6c6456b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6c62d7800 0x55c6c6456580 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 --2- 172.21.15.81:0/510956711 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c6c62d6c00 0x55c6c6456000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.858+0000 7f428fe0c740 1 -- 172.21.15.81:0/510956711 >> 172.21.15.81:0/510956711 conn(0x55c6c62d7000 msgr2=0x55c6c63c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.859+0000 7f428fe0c740 1 -- 172.21.15.81:0/510956711 shutdown_connections 2024-09-10T20:41:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.859+0000 7f428fe0c740 1 -- 172.21.15.81:0/510956711 wait complete. 2024-09-10T20:41:33.869 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init', '--force-init', '--filesystem', 'recovery_fs', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.103282, result: 2024-09-10T20:41:33.869 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset session 2024-09-10T20:41:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 -- start start 2024-09-10T20:41:33.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 Processor -- start 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae20b42c00 0x55ae2191a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae20b43800 0x55ae2191a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae20b43c00 0x55ae2191ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae21a12180 con 0x55ae20b43c00 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ae21a12300 con 0x55ae20b43800 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.936+0000 7f2bcec17280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ae21a12480 con 0x55ae20b42c00 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae20b43c00 0x55ae2191ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae20b43c00 0x55ae2191ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41358/0 (socket says 172.21.15.81:41358) 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 -- 172.21.15.81:0/380005937 learned_addr learned my addr 172.21.15.81:0/380005937 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcb600640 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae20b43800 0x55ae2191a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcc000640 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae20b42c00 0x55ae2191a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 -- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae20b42c00 msgr2=0x55ae2191a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae20b42c00 0x55ae2191a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 -- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae20b43800 msgr2=0x55ae2191a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae20b43800 0x55ae2191a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 -- 172.21.15.81:0/380005937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae20b7a780 con 0x55ae20b43c00 2024-09-10T20:41:33.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.937+0000 7f2bcca00640 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae20b43c00 0x55ae2191ab00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55ae219697d0 tx=0x55ae218eefc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b4a5112eb00fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bc8e00640 1 -- 172.21.15.81:0/380005937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ae20b68ea0 con 0x55ae20b43c00 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bc8e00640 1 -- 172.21.15.81:0/380005937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ae20b6f180 con 0x55ae20b43c00 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bc8e00640 1 -- 172.21.15.81:0/380005937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ae20b69380 con 0x55ae20b43c00 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bcec17280 1 -- 172.21.15.81:0/380005937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae20b7b4a0 con 0x55ae20b43c00 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bcec17280 1 -- 172.21.15.81:0/380005937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55ae20b7a000 con 0x55ae20b43c00 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bcec17280 4 waiting for MDS map... 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bc8e00640 1 -- 172.21.15.81:0/380005937 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x55ae21a28600 con 0x55ae20b43c00 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bc8e00640 1 -- 172.21.15.81:0/380005937 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x55ae20b9d180 con 0x55ae20b43c00 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bcec17280 4 Got MDS map 25 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bcec17280 10 main: main 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.938+0000 7f2bcec17280 4 main: connecting to RADOS... 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.939+0000 7f2bcec17280 1 Processor -- start 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.939+0000 7f2bcec17280 1 -- start start 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21927c00 0x55ae2191b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 0x55ae2191b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcec17280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae21a12600 con 0x55ae21927c00 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcec17280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ae21a12780 con 0x55ae21a7c400 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcec17280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ae21a12900 con 0x55ae21a7c000 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcb600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21927c00 0x55ae2191b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcb600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21927c00 0x55ae2191b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41368/0 (socket says 172.21.15.81:41368) 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcb600640 1 -- 172.21.15.81:0/3618260597 learned_addr learned my addr 172.21.15.81:0/3618260597 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcc000640 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 0x55ae2191b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcb600640 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.940+0000 7f2bcb600640 1 -- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 msgr2=0x55ae2191b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcb600640 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 0x55ae2191b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcb600640 1 -- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21a7c400 msgr2=0x55ae2191bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcb600640 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcb600640 1 -- 172.21.15.81:0/3618260597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae20b7a3c0 con 0x55ae21927c00 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcb600640 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21927c00 0x55ae2191b080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55ae21a327b0 tx=0x55ae21a38c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca246b35118b699 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bc6600640 1 -- 172.21.15.81:0/3618260597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ae20b68340 con 0x55ae21927c00 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bc6600640 1 -- 172.21.15.81:0/3618260597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ae20b6efc0 con 0x55ae21927c00 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bc6600640 1 -- 172.21.15.81:0/3618260597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ae20b68ea0 con 0x55ae21927c00 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcec17280 1 -- 172.21.15.81:0/3618260597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21927c00 msgr2=0x55ae2191b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcec17280 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21927c00 0x55ae2191b080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55ae21a327b0 tx=0x55ae21a38c60 comp rx=0 tx=0).stop 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcec17280 1 -- 172.21.15.81:0/3618260597 shutdown_connections 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcec17280 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcec17280 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 0x55ae2191b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcec17280 1 --2- 172.21.15.81:0/3618260597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21927c00 0x55ae2191b080 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.941+0000 7f2bcec17280 1 -- 172.21.15.81:0/3618260597 >> 172.21.15.81:0/3618260597 conn(0x55ae21927800 msgr2=0x55ae218e7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.942+0000 7f2bcec17280 1 -- 172.21.15.81:0/3618260597 shutdown_connections 2024-09-10T20:41:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.942+0000 7f2bcec17280 1 -- 172.21.15.81:0/3618260597 wait complete. 2024-09-10T20:41:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.942+0000 7f2bcec17280 1 Processor -- start 2024-09-10T20:41:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.942+0000 7f2bcec17280 1 -- start start 2024-09-10T20:41:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21927800 0x55ae2191b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 0x55ae2191b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcec17280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcec17280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55ae20ba5980 con 0x55ae21a7c400 2024-09-10T20:41:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcec17280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ae21a13e00 con 0x55ae21927800 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcec17280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ae21a12d80 con 0x55ae21a7c000 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcb600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcb600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41376/0 (socket says 172.21.15.81:41376) 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcb600640 1 -- 172.21.15.81:0/1440033036 learned_addr learned my addr 172.21.15.81:0/1440033036 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcc000640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 0x55ae2191b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.943+0000 7f2bcb600640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21927800 0x55ae2191b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcb600640 1 -- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 msgr2=0x55ae2191b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcb600640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae21a7c000 0x55ae2191b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcb600640 1 -- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21927800 msgr2=0x55ae2191b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcb600640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae21927800 0x55ae2191b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcb600640 1 -- 172.21.15.81:0/1440033036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae20b7a780 con 0x55ae21a7c400 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcb600640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55ae21a32ae0 tx=0x55ae21a39200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bc4800640 1 -- 172.21.15.81:0/1440033036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ae20b69380 con 0x55ae21a7c400 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bc4800640 1 -- 172.21.15.81:0/1440033036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55ae20b6ee00 con 0x55ae21a7c400 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae20b7b4a0 con 0x55ae21a7c400 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bc4800640 1 -- 172.21.15.81:0/1440033036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ae20b69040 con 0x55ae21a7c400 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae20b7a960 con 0x55ae21a7c400 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.944+0000 7f2bcec17280 4 main: resolving pool 7 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.946+0000 7f2bc4800640 1 -- 172.21.15.81:0/1440033036 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x55ae20b9d500 con 0x55ae21a7c400 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.947+0000 7f2bc4800640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55ae20ee8000 0x55ae2191c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.947+0000 7f2bc4800640 1 -- 172.21.15.81:0/1440033036 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x55ae21a96600 con 0x55ae21a7c400 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.947+0000 7f2bcec17280 4 main: creating IoCtx.. 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.947+0000 7f2bcec17280 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55ae21a7c800 0x55ae2191c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.947+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:1 7.b 7:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x55ae21a7cc00 con 0x55ae21a7c800 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.947+0000 7f2bcc000640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55ae20ee8000 0x55ae2191c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.947+0000 7f2bcb600640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55ae21a7c800 0x55ae2191c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:33.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.948+0000 7f2bcb600640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55ae21a7c800 0x55ae2191c680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.948+0000 7f2bcc000640 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55ae20ee8000 0x55ae2191c100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55ae20cc4e10 tx=0x55ae20eee3c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:33.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcb600640 1 -- 172.21.15.81:0/1440033036 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v50'1 uv1 ondisk = 0) ==== 201+0+0 (crc 0 0 0) 0x55ae20c44000 con 0x55ae21a7c800 2024-09-10T20:41:33.955 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "0": { 2024-09-10T20:41:33.955 INFO:teuthology.orchestra.run.smithi081.stdout: "data": {}, 2024-09-10T20:41:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0 2024-09-10T20:41:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:41:33.956 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:33.956 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55ae21a7c800 msgr2=0x55ae2191c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55ae21a7c800 0x55ae2191c680 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55ae20ee8000 msgr2=0x55ae2191c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55ae20ee8000 0x55ae2191c100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55ae20cc4e10 tx=0x55ae20eee3c0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21a7c400 msgr2=0x55ae2191bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 --2- 172.21.15.81:0/1440033036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae21a7c400 0x55ae2191bb80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55ae21a32ae0 tx=0x55ae21a39200 comp rx=0 tx=0).stop 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcc000640 1 -- 172.21.15.81:0/1440033036 reap_dead start 2024-09-10T20:41:33.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 shutdown_connections 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 >> 172.21.15.81:0/1440033036 conn(0x55ae21927c00 msgr2=0x55ae218e7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 shutdown_connections 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.950+0000 7f2bcec17280 1 -- 172.21.15.81:0/1440033036 wait complete. 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 -- 172.21.15.81:0/380005937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae20b43c00 msgr2=0x55ae2191ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae20b43c00 0x55ae2191ab00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55ae219697d0 tx=0x55ae218eefc0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 -- 172.21.15.81:0/380005937 shutdown_connections 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae20b43c00 0x55ae2191ab00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ae20b43800 0x55ae2191a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 --2- 172.21.15.81:0/380005937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ae20b42c00 0x55ae2191a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 -- 172.21.15.81:0/380005937 >> 172.21.15.81:0/380005937 conn(0x55ae20b43000 msgr2=0x55ae218e6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 -- 172.21.15.81:0/380005937 shutdown_connections 2024-09-10T20:41:33.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:33.951+0000 7f2bcec17280 1 -- 172.21.15.81:0/380005937 wait complete. 2024-09-10T20:41:33.960 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'session'] in time 0:00:00.091338, result: { "0": { "data": {}, "result": 0 } } 2024-09-10T20:41:33.960 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset snap 2024-09-10T20:41:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 -- start start 2024-09-10T20:41:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 Processor -- start 2024-09-10T20:41:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563575d82c00 0x563576b56000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563575d83800 0x563576b56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563575d83c00 0x563576b56b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563576c4a180 con 0x563575d83800 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563576c4a300 con 0x563575d82c00 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.028+0000 7ffa0b217280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563576c4a480 con 0x563575d83c00 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563575d83800 0x563576b56580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563575d83800 0x563576b56580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41398/0 (socket says 172.21.15.81:41398) 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 -- 172.21.15.81:0/1055667963 learned_addr learned my addr 172.21.15.81:0/1055667963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa09200640 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563575d82c00 0x563576b56000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 -- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563575d83c00 msgr2=0x563576b56b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563575d83c00 0x563576b56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 -- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563575d82c00 msgr2=0x563576b56000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563575d82c00 0x563576b56000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 -- 172.21.15.81:0/1055667963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563575dba780 con 0x563575d83800 2024-09-10T20:41:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa09200640 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563575d82c00 0x563576b56000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.029+0000 7ffa08800640 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563575d83800 0x563576b56580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x563576bad7d0 tx=0x563576b28ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4686fa377814c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa06000640 1 -- 172.21.15.81:0/1055667963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563575da8ea0 con 0x563575d83800 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa06000640 1 -- 172.21.15.81:0/1055667963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563575daf180 con 0x563575d83800 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa06000640 1 -- 172.21.15.81:0/1055667963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563575da9380 con 0x563575d83800 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa0b217280 1 -- 172.21.15.81:0/1055667963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563575dbb4a0 con 0x563575d83800 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa0b217280 1 -- 172.21.15.81:0/1055667963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x563575dba000 con 0x563575d83800 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa0b217280 4 waiting for MDS map... 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa06000640 1 -- 172.21.15.81:0/1055667963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x563576c56600 con 0x563575d83800 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa06000640 1 -- 172.21.15.81:0/1055667963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x563575ddd180 con 0x563575d83800 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa0b217280 4 Got MDS map 25 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa0b217280 10 main: main 2024-09-10T20:41:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.030+0000 7ffa0b217280 4 main: connecting to RADOS... 2024-09-10T20:41:34.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.031+0000 7ffa0b217280 1 Processor -- start 2024-09-10T20:41:34.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.031+0000 7ffa0b217280 1 -- start start 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59c00 0x563576b57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4000 0x563576b57600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc4400 0x563576b57b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa0b217280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563576c4a600 con 0x563576c59c00 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa0b217280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563576c4a780 con 0x563576cc4000 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa0b217280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563576c4a900 con 0x563576cc4400 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59c00 0x563576b57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59c00 0x563576b57080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41410/0 (socket says 172.21.15.81:41410) 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 -- 172.21.15.81:0/2151630165 learned_addr learned my addr 172.21.15.81:0/2151630165 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 -- 172.21.15.81:0/2151630165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc4400 msgr2=0x563576b57b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 --2- 172.21.15.81:0/2151630165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc4400 0x563576b57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 -- 172.21.15.81:0/2151630165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4000 msgr2=0x563576b57600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 --2- 172.21.15.81:0/2151630165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4000 0x563576b57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.032+0000 7ffa09c00640 1 -- 172.21.15.81:0/2151630165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563575dba3c0 con 0x563576c59c00 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa09c00640 1 --2- 172.21.15.81:0/2151630165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59c00 0x563576b57080 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x563576bad9b0 tx=0x563576c74d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eef22636fba954c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa03800640 1 -- 172.21.15.81:0/2151630165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563575da8ea0 con 0x563576c59c00 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa03800640 1 -- 172.21.15.81:0/2151630165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563575dae380 con 0x563576c59c00 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa03800640 1 -- 172.21.15.81:0/2151630165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563575da9380 con 0x563576c59c00 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 -- 172.21.15.81:0/2151630165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59c00 msgr2=0x563576b57080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2151630165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59c00 0x563576b57080 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x563576bad9b0 tx=0x563576c74d20 comp rx=0 tx=0).stop 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 -- 172.21.15.81:0/2151630165 shutdown_connections 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2151630165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc4400 0x563576b57b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2151630165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4000 0x563576b57600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2151630165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59c00 0x563576b57080 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 -- 172.21.15.81:0/2151630165 >> 172.21.15.81:0/2151630165 conn(0x563576c59800 msgr2=0x563576b27000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 -- 172.21.15.81:0/2151630165 shutdown_connections 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.033+0000 7ffa0b217280 1 -- 172.21.15.81:0/2151630165 wait complete. 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.034+0000 7ffa0b217280 1 Processor -- start 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.034+0000 7ffa0b217280 1 -- start start 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59800 0x563576b57080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc5000 0x563576b57600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa0b217280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4c00 0x563576b57b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa0b217280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563576c4a900 con 0x563576c59800 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa0b217280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563576c4aa80 con 0x563576cc4c00 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa0b217280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563576c4a780 con 0x563576cc5000 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59800 0x563576b57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59800 0x563576b57080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41418/0 (socket says 172.21.15.81:41418) 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 -- 172.21.15.81:0/2880716444 learned_addr learned my addr 172.21.15.81:0/2880716444 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09200640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc5000 0x563576b57600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa08800640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4c00 0x563576b57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 -- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc5000 msgr2=0x563576b57600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563576cc5000 0x563576b57600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 -- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4c00 msgr2=0x563576b57b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4c00 0x563576b57b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa09c00640 1 -- 172.21.15.81:0/2880716444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563575dba780 con 0x563576c59800 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.035+0000 7ffa08800640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563576cc4c00 0x563576b57b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.036+0000 7ffa09c00640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59800 0x563576b57080 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x563576c6d680 tx=0x563576c74f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.036+0000 7ffa01a00640 1 -- 172.21.15.81:0/2880716444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563575da9040 con 0x563576c59800 2024-09-10T20:41:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.036+0000 7ffa01a00640 1 -- 172.21.15.81:0/2880716444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563575daefc0 con 0x563576c59800 2024-09-10T20:41:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.036+0000 7ffa01a00640 1 -- 172.21.15.81:0/2880716444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x563575da8ea0 con 0x563576c59800 2024-09-10T20:41:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.036+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563575dbb4a0 con 0x563576c59800 2024-09-10T20:41:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.036+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563575dba960 con 0x563576c59800 2024-09-10T20:41:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.036+0000 7ffa0b217280 4 main: resolving pool 7 2024-09-10T20:41:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.038+0000 7ffa01a00640 1 -- 172.21.15.81:0/2880716444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x563575ddd500 con 0x563576c59800 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.039+0000 7ffa01a00640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x563576126000 0x563576b58100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.039+0000 7ffa01a00640 1 -- 172.21.15.81:0/2880716444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x563576cdca00 con 0x563576c59800 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.039+0000 7ffa0b217280 4 main: creating IoCtx.. 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.039+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x563576cc4800 0x563576b58680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.039+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:1 7.d 7:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x563576cc4400 con 0x563576cc4800 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.039+0000 7ffa09200640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x563576126000 0x563576b58100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.039+0000 7ffa08800640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x563576cc4800 0x563576b58680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.040+0000 7ffa08800640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x563576cc4800 0x563576b58680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.040+0000 7ffa09200640 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x563576126000 0x563576b58100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x563575f04180 tx=0x56357610c720 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa08800640 1 -- 172.21.15.81:0/2880716444 <== osd.1 v2:172.21.15.81:6810/310566059 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v50'1 uv1 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x563575e84000 con 0x563576cc4800 2024-09-10T20:41:34.050 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0 2024-09-10T20:41:34.050 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x563576cc4800 msgr2=0x563576b58680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x563576cc4800 0x563576b58680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x563576126000 msgr2=0x563576b58100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x563576126000 0x563576b58100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x563575f04180 tx=0x56357610c720 comp rx=0 tx=0).stop 2024-09-10T20:41:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59800 msgr2=0x563576b57080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 --2- 172.21.15.81:0/2880716444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563576c59800 0x563576b57080 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x563576c6d680 tx=0x563576c74f00 comp rx=0 tx=0).stop 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa09200640 1 -- 172.21.15.81:0/2880716444 reap_dead start 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 shutdown_connections 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 >> 172.21.15.81:0/2880716444 conn(0x563576c59c00 msgr2=0x563576b27000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.042+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 shutdown_connections 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 -- 172.21.15.81:0/2880716444 wait complete. 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 -- 172.21.15.81:0/1055667963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563575d83800 msgr2=0x563576b56580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563575d83800 0x563576b56580 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x563576bad7d0 tx=0x563576b28ea0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 -- 172.21.15.81:0/1055667963 shutdown_connections 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563575d83c00 0x563576b56b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563575d83800 0x563576b56580 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 --2- 172.21.15.81:0/1055667963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563575d82c00 0x563576b56000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 -- 172.21.15.81:0/1055667963 >> 172.21.15.81:0/1055667963 conn(0x563575d83000 msgr2=0x563576b26800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 -- 172.21.15.81:0/1055667963 shutdown_connections 2024-09-10T20:41:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.043+0000 7ffa0b217280 1 -- 172.21.15.81:0/1055667963 wait complete. 2024-09-10T20:41:34.054 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'snap'] in time 0:00:00.093558, result: { "result": 0 } 2024-09-10T20:41:34.054 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset inode 2024-09-10T20:41:34.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.121+0000 7f89d93ef280 1 -- start start 2024-09-10T20:41:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.121+0000 7f89d93ef280 1 Processor -- start 2024-09-10T20:41:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5560740acc00 0x556074e84000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5560740ad800 0x556074e84580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560740adc00 0x556074e84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d93ef280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556074e98600 con 0x5560740adc00 2024-09-10T20:41:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d93ef280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x556074e98480 con 0x5560740ad800 2024-09-10T20:41:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d93ef280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x556074e98300 con 0x5560740acc00 2024-09-10T20:41:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560740adc00 0x556074e84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560740adc00 0x556074e84b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41430/0 (socket says 172.21.15.81:41430) 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 -- 172.21.15.81:0/2667742548 learned_addr learned my addr 172.21.15.81:0/2667742548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5560740ad800 0x556074e84580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 -- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5560740acc00 msgr2=0x556074e84000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7400640 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5560740acc00 0x556074e84000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5560740acc00 0x556074e84000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 -- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5560740ad800 msgr2=0x556074e84580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5560740ad800 0x556074e84580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 -- 172.21.15.81:0/2667742548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560740e4780 con 0x5560740adc00 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5560740ad800 0x556074e84580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.123+0000 7f89d7e00640 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560740adc00 0x556074e84b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x556074ed3800 tx=0x556074e59260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcb4240bfa8da6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d4200640 1 -- 172.21.15.81:0/2667742548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560740d2ea0 con 0x5560740adc00 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d4200640 1 -- 172.21.15.81:0/2667742548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5560740d8fc0 con 0x5560740adc00 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d4200640 1 -- 172.21.15.81:0/2667742548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560740d3380 con 0x5560740adc00 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d93ef280 1 -- 172.21.15.81:0/2667742548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560740e43c0 con 0x5560740adc00 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d93ef280 1 -- 172.21.15.81:0/2667742548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5560740e5680 con 0x5560740adc00 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d93ef280 4 waiting for MDS map... 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d4200640 1 -- 172.21.15.81:0/2667742548 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x556074f8a600 con 0x5560740adc00 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d4200640 1 -- 172.21.15.81:0/2667742548 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x556074107180 con 0x5560740adc00 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d93ef280 4 Got MDS map 25 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d93ef280 10 main: main 2024-09-10T20:41:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.124+0000 7f89d93ef280 4 main: connecting to RADOS... 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.125+0000 7f89d93ef280 1 Processor -- start 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.125+0000 7f89d93ef280 1 -- start start 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074f8fc00 0x556074e85080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 0x556074e85600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074fee400 0x556074e85b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d93ef280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556074e98180 con 0x556074fee400 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d93ef280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55607410f380 con 0x556074f8fc00 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d93ef280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55607410f800 con 0x556074fee000 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074fee400 0x556074e85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074fee400 0x556074e85b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41442/0 (socket says 172.21.15.81:41442) 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d6a00640 1 -- 172.21.15.81:0/484690592 learned_addr learned my addr 172.21.15.81:0/484690592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d7400640 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 0x556074e85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.126+0000 7f89d6a00640 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074f8fc00 0x556074e85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d6a00640 1 -- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 msgr2=0x556074e85600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d6a00640 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 0x556074e85600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d6a00640 1 -- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074f8fc00 msgr2=0x556074e85080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d6a00640 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074f8fc00 0x556074e85080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d6a00640 1 -- 172.21.15.81:0/484690592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560740e54a0 con 0x556074fee400 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d6a00640 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074fee400 0x556074e85b80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x556074f9e5d0 tx=0x556074fa6d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5454aa7033b2331f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d1a00640 1 -- 172.21.15.81:0/484690592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560740d2340 con 0x556074fee400 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d1a00640 1 -- 172.21.15.81:0/484690592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5560740d8700 con 0x556074fee400 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.127+0000 7f89d1a00640 1 -- 172.21.15.81:0/484690592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560740d2ea0 con 0x556074fee400 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 -- 172.21.15.81:0/484690592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074fee400 msgr2=0x556074e85b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074fee400 0x556074e85b80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x556074f9e5d0 tx=0x556074fa6d80 comp rx=0 tx=0).stop 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 -- 172.21.15.81:0/484690592 shutdown_connections 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074fee400 0x556074e85b80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 0x556074e85600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 --2- 172.21.15.81:0/484690592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074f8fc00 0x556074e85080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 -- 172.21.15.81:0/484690592 >> 172.21.15.81:0/484690592 conn(0x556074f8f800 msgr2=0x556074e4e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 -- 172.21.15.81:0/484690592 shutdown_connections 2024-09-10T20:41:34.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 -- 172.21.15.81:0/484690592 wait complete. 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.128+0000 7f89d93ef280 1 Processor -- start 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 -- start start 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074f8f800 0x556074e85080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 0x556074e85600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074fee400 0x556074e85b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556074e99980 con 0x556074f8f800 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x556074e98180 con 0x556074fee400 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x556074e99800 con 0x556074fee000 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074f8f800 0x556074e85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074f8f800 0x556074e85080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41446/0 (socket says 172.21.15.81:41446) 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 -- 172.21.15.81:0/2384119613 learned_addr learned my addr 172.21.15.81:0/2384119613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d7400640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 0x556074e85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074fee400 0x556074e85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 -- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 msgr2=0x556074e85600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556074fee000 0x556074e85600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 -- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074fee400 msgr2=0x556074e85b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556074fee400 0x556074e85b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 -- 172.21.15.81:0/2384119613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560740e4780 con 0x556074f8f800 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074f8f800 0x556074e85080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x556074f9e6c0 tx=0x556074e28240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89cfc00640 1 -- 172.21.15.81:0/2384119613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560740d3380 con 0x556074f8f800 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89cfc00640 1 -- 172.21.15.81:0/2384119613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5560740d9a40 con 0x556074f8f800 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89cfc00640 1 -- 172.21.15.81:0/2384119613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5560740d3040 con 0x556074f8f800 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.130+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560740e43c0 con 0x556074f8f800 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.131+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560740e5680 con 0x556074f8f800 2024-09-10T20:41:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.131+0000 7f89d93ef280 4 main: resolving pool 7 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.132+0000 7f89cfc00640 1 -- 172.21.15.81:0/2384119613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x556074107500 con 0x556074f8f800 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.133+0000 7f89cfc00640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x556074450000 0x556074e86100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.133+0000 7f89cfc00640 1 -- 172.21.15.81:0/2384119613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x556074f80600 con 0x556074f8f800 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.133+0000 7f89d93ef280 4 main: creating IoCtx.. 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.133+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x556074fee800 0x556074e86680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.133+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:1 7.13 7:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x556074feec00 con 0x556074fee800 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.133+0000 7f89d7400640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x556074450000 0x556074e86100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.133+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x556074fee800 0x556074e86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.134+0000 7f89d6a00640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x556074fee800 0x556074e86680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.134+0000 7f89d7400640 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x556074450000 0x556074e86100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55607422ede0 tx=0x5560744563c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d6a00640 1 -- 172.21.15.81:0/2384119613 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v50'2 uv2 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x5560741ae000 con 0x556074fee800 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stdout: "0": { 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stdout: "data": {}, 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:34.142 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x556074fee800 msgr2=0x556074e86680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x556074fee800 0x556074e86680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x556074450000 msgr2=0x556074e86100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x556074450000 0x556074e86100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55607422ede0 tx=0x5560744563c0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074f8f800 msgr2=0x556074e85080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2384119613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556074f8f800 0x556074e85080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x556074f9e6c0 tx=0x556074e28240 comp rx=0 tx=0).stop 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d7400640 1 -- 172.21.15.81:0/2384119613 reap_dead start 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 shutdown_connections 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 >> 172.21.15.81:0/2384119613 conn(0x556074f8fc00 msgr2=0x556074e4e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 shutdown_connections 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.136+0000 7f89d93ef280 1 -- 172.21.15.81:0/2384119613 wait complete. 2024-09-10T20:41:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 -- 172.21.15.81:0/2667742548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560740adc00 msgr2=0x556074e84b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560740adc00 0x556074e84b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x556074ed3800 tx=0x556074e59260 comp rx=0 tx=0).stop 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 -- 172.21.15.81:0/2667742548 shutdown_connections 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560740adc00 0x556074e84b00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5560740ad800 0x556074e84580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 --2- 172.21.15.81:0/2667742548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5560740acc00 0x556074e84000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 -- 172.21.15.81:0/2667742548 >> 172.21.15.81:0/2667742548 conn(0x5560740ad000 msgr2=0x556074e4f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 -- 172.21.15.81:0/2667742548 shutdown_connections 2024-09-10T20:41:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.137+0000 7f89d93ef280 1 -- 172.21.15.81:0/2667742548 wait complete. 2024-09-10T20:41:34.147 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'inode'] in time 0:00:00.093178, result: { "0": { "data": {}, "result": 0 } } 2024-09-10T20:41:34.148 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --alternate-pool recovery_fs_metadata --filesystem cephfs cephfs_data 2024-09-10T20:41:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.219+0000 7f47f781c740 1 -- start start 2024-09-10T20:41:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.219+0000 7f47f781c740 1 Processor -- start 2024-09-10T20:41:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f781c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a175b68c00 0x55a175ce8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f781c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a175b69800 0x55a175ce8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f781c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a175b69c00 0x55a175ce8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f781c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a176a38180 con 0x55a175b69c00 2024-09-10T20:41:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f781c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a176a38300 con 0x55a175b68c00 2024-09-10T20:41:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f781c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a176a38480 con 0x55a175b69800 2024-09-10T20:41:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f5600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a175b69c00 0x55a175ce8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f5600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a175b69c00 0x55a175ce8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41454/0 (socket says 172.21.15.81:41454) 2024-09-10T20:41:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f5600640 1 -- 172.21.15.81:0/1479649805 learned_addr learned my addr 172.21.15.81:0/1479649805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.220+0000 7f47f4c00640 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a175b68c00 0x55a175ce8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f4200640 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a175b69800 0x55a175ce8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f5600640 1 -- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a175b69800 msgr2=0x55a175ce8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f5600640 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a175b69800 0x55a175ce8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f5600640 1 -- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a175b68c00 msgr2=0x55a175ce8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f5600640 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a175b68c00 0x55a175ce8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f5600640 1 -- 172.21.15.81:0/1479649805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a175b95680 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f5600640 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a175b69c00 0x55a175ce8b00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55a176993860 tx=0x55a176919260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c465057077112fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f1a00640 1 -- 172.21.15.81:0/1479649805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a175b8e340 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f1a00640 1 -- 172.21.15.81:0/1479649805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a175bbefc0 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f1a00640 1 -- 172.21.15.81:0/1479649805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a175b8eea0 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f781c740 1 -- 172.21.15.81:0/1479649805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a175b95860 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f781c740 1 -- 172.21.15.81:0/1479649805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a175b952c0 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.221+0000 7f47f781c740 4 waiting for MDS map... 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.222+0000 7f47f1a00640 1 -- 172.21.15.81:0/1479649805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x55a176a54200 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.222+0000 7f47f1a00640 1 -- 172.21.15.81:0/1479649805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x55a175bc3180 con 0x55a175b69c00 2024-09-10T20:41:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.222+0000 7f47f781c740 4 Got MDS map 25 2024-09-10T20:41:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.222+0000 7f47f781c740 4 datascan.main: Using metadata pool output 2024-09-10T20:41:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.222+0000 7f47f781c740 4 datascan.main: connecting to RADOS... 2024-09-10T20:41:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 Processor -- start 2024-09-10T20:41:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 -- start start 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b400 0x55a175ce9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b800 0x55a175ce9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a176a38600 con 0x55a17694b000 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a176a38780 con 0x55a17694b400 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.223+0000 7f47f781c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a176a38900 con 0x55a17694b800 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41462/0 (socket says 172.21.15.81:41462) 2024-09-10T20:41:34.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 -- 172.21.15.81:0/4041071214 learned_addr learned my addr 172.21.15.81:0/4041071214 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4c00640 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b400 0x55a175ce9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b800 0x55a175ce9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 -- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b800 msgr2=0x55a175ce9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b800 0x55a175ce9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 -- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b400 msgr2=0x55a175ce9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b400 0x55a175ce9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 -- 172.21.15.81:0/4041071214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a175b954a0 con 0x55a17694b000 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.224+0000 7f47f4200640 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55a17697b500 tx=0x55a176954c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c5cbfeb09119b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47ef200640 1 -- 172.21.15.81:0/4041071214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a175b8e340 con 0x55a17694b000 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47ef200640 1 -- 172.21.15.81:0/4041071214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a175bbec40 con 0x55a17694b000 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47ef200640 1 -- 172.21.15.81:0/4041071214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a175b8eea0 con 0x55a17694b000 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 -- 172.21.15.81:0/4041071214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 msgr2=0x55a175ce9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55a17697b500 tx=0x55a176954c60 comp rx=0 tx=0).stop 2024-09-10T20:41:34.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 -- 172.21.15.81:0/4041071214 shutdown_connections 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b800 0x55a175ce9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b400 0x55a175ce9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 --2- 172.21.15.81:0/4041071214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 -- 172.21.15.81:0/4041071214 >> 172.21.15.81:0/4041071214 conn(0x55a17694ac00 msgr2=0x55a175c5b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 -- 172.21.15.81:0/4041071214 shutdown_connections 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.225+0000 7f47f781c740 1 -- 172.21.15.81:0/4041071214 wait complete. 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.226+0000 7f47f781c740 1 Processor -- start 2024-09-10T20:41:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.226+0000 7f47f781c740 1 -- start start 2024-09-10T20:41:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f781c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f781c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b400 0x55a175ce9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f781c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b800 0x55a175ce9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f781c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a176a39980 con 0x55a17694b000 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f781c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a176a38300 con 0x55a17694b800 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f781c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a176a38c00 con 0x55a17694b400 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41464/0 (socket says 172.21.15.81:41464) 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 learned_addr learned my addr 172.21.15.81:0/3388426223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b400 msgr2=0x55a175ce9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a17694b400 0x55a175ce9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b800 msgr2=0x55a175ce9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a17694b800 0x55a175ce9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a175b950e0 con 0x55a17694b000 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.227+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55a176ab20c0 tx=0x55a176954de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.228+0000 7f47ed400640 1 -- 172.21.15.81:0/3388426223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a175b8f040 con 0x55a17694b000 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.228+0000 7f47ed400640 1 -- 172.21.15.81:0/3388426223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a175bbe000 con 0x55a17694b000 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.228+0000 7f47ed400640 1 -- 172.21.15.81:0/3388426223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a175b8e340 con 0x55a17694b000 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.228+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a175b95a40 con 0x55a17694b000 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.228+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a175b943c0 con 0x55a17694b000 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.228+0000 7f47f781c740 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.229+0000 7f47ed400640 1 -- 172.21.15.81:0/3388426223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x55a175bc3500 con 0x55a17694b000 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.230+0000 7f47ed400640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55a176aba800 0x55a175cea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.230+0000 7f47ed400640 1 -- 172.21.15.81:0/3388426223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x55a176ab0a00 con 0x55a17694b000 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.230+0000 7f47f781c740 4 datascan.main: data pool 'cephfs_data' has ID 6 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.230+0000 7f47f781c740 4 datascan.main: opening data pool 'cephfs_data' 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.230+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55a176abac00 0x55a175cea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.230+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a176abb000 con 0x55a176abac00 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.231+0000 7f47f4c00640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55a176aba800 0x55a175cea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.231+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55a176abac00 0x55a175cea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.231+0000 7f47f4c00640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55a176aba800 0x55a175cea100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55a17690d5c0 tx=0x55a175f0a3c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.231+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55a176abac00 0x55a175cea680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.232+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(1 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.232+0000 7f47ee800640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x55a175f1ac00 0x55a175f2c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.232+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:2 6.20 6:04000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b000 con 0x55a175f1ac00 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.232+0000 7f47f5600640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x55a175f1ac00 0x55a175f2c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.233+0000 7f47f5600640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x55a175f1ac00 0x55a175f2c000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.233+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 1 ==== osd_op_reply(2 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.233+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:3 6.10 6:08000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b800 con 0x55a175f1ac00 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.233+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 2 ==== osd_op_reply(3 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.233+0000 7f47ee800640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x55a175f1b400 0x55a175f2c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.234+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:4 6.30 6:0c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1bc00 con 0x55a175f1b400 2024-09-10T20:41:34.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.234+0000 7f47f4c00640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x55a175f1b400 0x55a175f2c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.234+0000 7f47f4c00640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x55a175f1b400 0x55a175f2c580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.235+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 1 ==== osd_op_reply(4 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.235+0000 7f47ef200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x55a175f3a000 0x55a175f2d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.235+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:5 6.8 6:10000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3a400 con 0x55a175f3a000 2024-09-10T20:41:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.235+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x55a175f3a000 0x55a175f2d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.235+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x55a175f3a000 0x55a175f2d080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.236+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 1 ==== osd_op_reply(5 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.236+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:6 6.28 6:14000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3a800 con 0x55a176abac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.236+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== osd_op_reply(6 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.236+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:7 6.18 6:18000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3b800 con 0x55a175f1ac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.237+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 3 ==== osd_op_reply(7 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.237+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:8 6.38 6:1c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3ac00 con 0x55a175f1ac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.237+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 4 ==== osd_op_reply(8 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.237+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:9 6.4 6:20000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3bc00 con 0x55a176abac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.237+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 3 ==== osd_op_reply(9 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.237+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:10 6.24 6:24000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3b000 con 0x55a175f1b400 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.238+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 2 ==== osd_op_reply(10 [pgnls start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.238+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:11 6.14 6:28000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3a400 con 0x55a175f1ac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.238+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 5 ==== osd_op_reply(11 [pgnls start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.238+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:12 6.34 6:2c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3b400 con 0x55a176abac00 2024-09-10T20:41:34.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.239+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 4 ==== osd_op_reply(12 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.239+0000 7f47ef200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55a175f3a800 0x55a175f2d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.239+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:13 6.c 6:30000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3bc00 con 0x55a175f3a800 2024-09-10T20:41:34.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.239+0000 7f47f5600640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55a175f3a800 0x55a175f2d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.240+0000 7f47f5600640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55a175f3a800 0x55a175f2d600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.240+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== osd_op_reply(13 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.240+0000 7f47ee800640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55a175f3b800 0x55a175f2cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.241+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:14 6.2c 6:34000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3ac00 con 0x55a175f3b800 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.241+0000 7f47f4c00640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55a175f3b800 0x55a175f2cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.241+0000 7f47f4c00640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55a175f3b800 0x55a175f2cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.242+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== osd_op_reply(14 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.242+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:15 6.1c 6:38000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a176abb000 con 0x55a175f3a000 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.242+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 2 ==== osd_op_reply(15 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.242+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:16 6.3c 6:3c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b000 con 0x55a175f1ac00 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.242+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 6 ==== osd_op_reply(16 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.242+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:17 6.2 6:40000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3b000 con 0x55a175f3a000 2024-09-10T20:41:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.243+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 3 ==== osd_op_reply(17 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.243+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:18 6.22 6:44000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b800 con 0x55a175f3a000 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.243+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 4 ==== osd_op_reply(18 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.243+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:19 6.12 6:48000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3ac00 con 0x55a175f3b800 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.243+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 2 ==== osd_op_reply(19 [pgnls start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.243+0000 7f47ee800640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x55a176963c00 0x55a175f2e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.243+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:20 6.32 6:4c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52000 con 0x55a176963c00 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.244+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x55a176963c00 0x55a175f2e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.244+0000 7f47f4200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x55a176963c00 0x55a175f2e100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.244+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.2 v2:172.21.15.81:6809/2010302829 1 ==== osd_op_reply(20 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176963c00 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.244+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:21 6.a 6:50000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3a400 con 0x55a175f3b800 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.245+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 3 ==== osd_op_reply(21 [pgnls start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.245+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:22 6.2a 6:54000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52400 con 0x55a175f3b800 2024-09-10T20:41:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.245+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 4 ==== osd_op_reply(22 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.245+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:23 6.1a 6:58000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1a800 con 0x55a175f3a000 2024-09-10T20:41:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.245+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 5 ==== osd_op_reply(23 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.245+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:24 6.3a 6:5c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52800 con 0x55a175f3a800 2024-09-10T20:41:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.246+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 2 ==== osd_op_reply(24 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.246+0000 7f47ef200640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55a175f1bc00 0x55a175f2db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.246+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:25 6.6 6:60000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52000 con 0x55a175f1bc00 2024-09-10T20:41:34.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.246+0000 7f47f5600640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55a175f1bc00 0x55a175f2db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.247+0000 7f47f5600640 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55a175f1bc00 0x55a175f2db80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.248+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== osd_op_reply(25 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1bc00 2024-09-10T20:41:34.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.248+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:26 6.26 6:64000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52c00 con 0x55a175f1ac00 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.248+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 7 ==== osd_op_reply(26 [pgnls start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.248+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:27 6.16 6:68000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53800 con 0x55a175f1ac00 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.249+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 8 ==== osd_op_reply(27 [pgnls start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.249+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:28 6.36 6:6c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53000 con 0x55a175f1b400 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.249+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 3 ==== osd_op_reply(28 [pgnls start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.249+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:29 6.e 6:70000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b800 con 0x55a175f1b400 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.249+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 4 ==== osd_op_reply(29 [pgnls start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.249+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:30 6.2e 6:74000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53400 con 0x55a175f3a000 2024-09-10T20:41:34.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.250+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 6 ==== osd_op_reply(30 [pgnls start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.250+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:31 6.1e 6:78000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3b400 con 0x55a176abac00 2024-09-10T20:41:34.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.250+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 5 ==== osd_op_reply(31 [pgnls start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.250+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:32 6.3e 6:7c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52400 con 0x55a175f3a800 2024-09-10T20:41:34.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.251+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 3 ==== osd_op_reply(32 [pgnls start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.251+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:33 6.1 6:80000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3b000 con 0x55a175f3a800 2024-09-10T20:41:34.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.251+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 4 ==== osd_op_reply(33 [pgnls start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.251+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:34 6.21 6:84000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53000 con 0x55a175f1b400 2024-09-10T20:41:34.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.252+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 5 ==== osd_op_reply(34 [pgnls start_epoch 50 out=49b] v40'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.252+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:35 6.11 6:88000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a176abb000 con 0x55a175f3a800 2024-09-10T20:41:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.252+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 5 ==== osd_op_reply(35 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.252+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:36 6.31 6:8c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53c00 con 0x55a175f3a000 2024-09-10T20:41:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.252+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 7 ==== osd_op_reply(36 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.252+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:37 6.9 6:90000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52800 con 0x55a175f1ac00 2024-09-10T20:41:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.253+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 9 ==== osd_op_reply(37 [pgnls start_epoch 50 out=49b] v40'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.253+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:38 6.29 6:94000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b800 con 0x55a175f3a000 2024-09-10T20:41:34.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.254+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 8 ==== osd_op_reply(38 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.254+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:39 6.19 6:98000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52000 con 0x55a175f3b800 2024-09-10T20:41:34.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.254+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 5 ==== osd_op_reply(39 [pgnls start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.254+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:40 6.39 6:9c000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3ac00 con 0x55a175f1b400 2024-09-10T20:41:34.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.254+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 6 ==== osd_op_reply(40 [pgnls start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.254+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:41 6.5 6:a0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52c00 con 0x55a175f3b800 2024-09-10T20:41:34.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.254+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 6 ==== osd_op_reply(41 [pgnls start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.255+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:42 6.25 6:a4000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3a400 con 0x55a175f3b800 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.255+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 7 ==== osd_op_reply(42 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.255+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:43 6.15 6:a8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53800 con 0x55a176963c00 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.255+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.2 v2:172.21.15.81:6809/2010302829 2 ==== osd_op_reply(43 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176963c00 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.255+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:44 6.35 6:ac000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53400 con 0x55a175f3b800 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.255+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 8 ==== osd_op_reply(44 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.255+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:45 6.d 6:b0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52400 con 0x55a175f1b400 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.256+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 7 ==== osd_op_reply(45 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.256+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:46 6.2d 6:b4000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53c00 con 0x55a175f1bc00 2024-09-10T20:41:34.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.256+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== osd_op_reply(46 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1bc00 2024-09-10T20:41:34.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.256+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:47 6.1d 6:b8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b000 con 0x55a175f3a800 2024-09-10T20:41:34.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.257+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 6 ==== osd_op_reply(47 [pgnls start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.257+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:48 6.3d 6:bc000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53800 con 0x55a175f1ac00 2024-09-10T20:41:34.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.257+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 10 ==== osd_op_reply(48 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.257+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:49 6.3 6:c0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3bc00 con 0x55a175f3b800 2024-09-10T20:41:34.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.258+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 9 ==== osd_op_reply(49 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.258+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:50 6.23 6:c4000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1a800 con 0x55a175f3a000 2024-09-10T20:41:34.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.258+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 9 ==== osd_op_reply(50 [pgnls start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.258+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:51 6.13 6:c8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53000 con 0x55a176abac00 2024-09-10T20:41:34.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.258+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 6 ==== osd_op_reply(51 [pgnls start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.258+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:52 6.33 6:cc000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f1b800 con 0x55a175f1b400 2024-09-10T20:41:34.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.259+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.1 v2:172.21.15.81:6810/310566059 8 ==== osd_op_reply(52 [pgnls start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f1b400 2024-09-10T20:41:34.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.259+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:53 6.b 6:d0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52000 con 0x55a175f1ac00 2024-09-10T20:41:34.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.260+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 11 ==== osd_op_reply(53 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.260+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:54 6.2b 6:d4000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3b400 con 0x55a175f3b800 2024-09-10T20:41:34.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.260+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 <== osd.0 v2:172.21.15.81:6800/4080460515 10 ==== osd_op_reply(54 [pgnls start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72780 con 0x55a175f3b800 2024-09-10T20:41:34.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.260+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:55 6.1b 6:d8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52c00 con 0x55a175f3a800 2024-09-10T20:41:34.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.261+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 7 ==== osd_op_reply(55 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.261+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:56 6.3b 6:dc000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52800 con 0x55a176abac00 2024-09-10T20:41:34.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.261+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 7 ==== osd_op_reply(56 [pgnls start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.261+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:57 6.7 6:e0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53400 con 0x55a175f3a000 2024-09-10T20:41:34.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.261+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 10 ==== osd_op_reply(57 [pgnls start_epoch 50 out=81b] v40'8 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.261+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:58 6.7 6:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x55a176abb400 con 0x55a175f3a000 2024-09-10T20:41:34.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.262+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 11 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.262+0000 7f47f781c740 10 datascan.operator(): handling object 1099511627777.0 2024-09-10T20:41:34.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.262+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:59 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x55a176abb800 con 0x55a175f3a000 2024-09-10T20:41:34.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.264+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 12 ==== osd_op_reply(59 10000000001.00000000 [call] v50'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.264+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:60 6.27 6:e4000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a176abbc00 con 0x55a176963c00 2024-09-10T20:41:34.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.264+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.2 v2:172.21.15.81:6809/2010302829 3 ==== osd_op_reply(60 [pgnls start_epoch 50 out=49b] v40'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176963c00 2024-09-10T20:41:34.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.264+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:61 6.17 6:e8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3ac00 con 0x55a176963c00 2024-09-10T20:41:34.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.264+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.2 v2:172.21.15.81:6809/2010302829 4 ==== osd_op_reply(61 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176963c00 2024-09-10T20:41:34.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.264+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:62 6.37 6:ec000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53c00 con 0x55a176abac00 2024-09-10T20:41:34.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.265+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.7 v2:172.21.15.143:6810/3238341229 8 ==== osd_op_reply(62 [pgnls start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72000 con 0x55a176abac00 2024-09-10T20:41:34.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.265+0000 7f47ef200640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:63 6.f 6:f0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f3a400 con 0x55a175f1bc00 2024-09-10T20:41:34.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.265+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.5 v2:172.21.15.143:6802/1659339177 3 ==== osd_op_reply(63 [pgnls start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1bc00 2024-09-10T20:41:34.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.265+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:64 6.2f 6:f4000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53800 con 0x55a175f3a000 2024-09-10T20:41:34.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.266+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 13 ==== osd_op_reply(64 [pgnls start_epoch 50 out=81b] v40'9 uv1 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.266+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:65 6.2f 6:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x55a176abb400 con 0x55a175f3a000 2024-09-10T20:41:34.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.266+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 14 ==== osd_op_reply(65 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.266+0000 7f47f781c740 10 datascan.operator(): handling object 1099511627777.1 2024-09-10T20:41:34.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.266+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:66 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x55a176abb800 con 0x55a175f3a000 2024-09-10T20:41:34.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.267+0000 7f47f4200640 1 -- 172.21.15.81:0/3388426223 <== osd.3 v2:172.21.15.81:6808/906295494 15 ==== osd_op_reply(66 10000000001.00000000 [call] v50'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55a175c72000 con 0x55a175f3a000 2024-09-10T20:41:34.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.268+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:67 6.1f 6:f8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f53000 con 0x55a175f3a800 2024-09-10T20:41:34.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.268+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.6 v2:172.21.15.143:6818/294800477 8 ==== osd_op_reply(67 [pgnls start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f3a800 2024-09-10T20:41:34.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.268+0000 7f47ee800640 1 -- 172.21.15.81:0/3388426223 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:68 6.3f 6:fc000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x55a175f52000 con 0x55a175f1ac00 2024-09-10T20:41:34.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.268+0000 7f47f5600640 1 -- 172.21.15.81:0/3388426223 <== osd.4 v2:172.21.15.143:6826/4019230190 12 ==== osd_op_reply(68 [pgnls start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a175c72500 con 0x55a175f1ac00 2024-09-10T20:41:34.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.268+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55a175f3b800 msgr2=0x55a175f2cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.268+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x55a175f3b800 0x55a175f2cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x55a175f1b400 msgr2=0x55a175f2c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x55a175f1b400 0x55a175f2c580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x55a176963c00 msgr2=0x55a175f2e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x55a176963c00 0x55a175f2e100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x55a175f3a000 msgr2=0x55a175f2d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x55a175f3a000 0x55a175f2d080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x55a175f1ac00 msgr2=0x55a175f2c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x55a175f1ac00 0x55a175f2c000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55a175f1bc00 msgr2=0x55a175f2db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x55a175f1bc00 0x55a175f2db80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55a175f3a800 msgr2=0x55a175f2d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x55a175f3a800 0x55a175f2d600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55a176abac00 msgr2=0x55a175cea680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x55a176abac00 0x55a175cea680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 reap_dead start 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f4c00640 1 -- 172.21.15.81:0/3388426223 reap_dead start 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55a176aba800 msgr2=0x55a175cea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55a176aba800 0x55a175cea100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55a17690d5c0 tx=0x55a175f0a3c0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 msgr2=0x55a175ce9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55a176ab20c0 tx=0x55a176954de0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 shutdown_connections 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x55a176aba800 0x55a175cea100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 --2- 172.21.15.81:0/3388426223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a17694b000 0x55a175ce9080 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 >> 172.21.15.81:0/3388426223 conn(0x55a17694ac00 msgr2=0x55a175c5b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 shutdown_connections 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.269+0000 7f47f781c740 1 -- 172.21.15.81:0/3388426223 wait complete. 2024-09-10T20:41:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 -- 172.21.15.81:0/1479649805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a175b69c00 msgr2=0x55a175ce8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a175b69c00 0x55a175ce8b00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55a176993860 tx=0x55a176919260 comp rx=0 tx=0).stop 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 -- 172.21.15.81:0/1479649805 shutdown_connections 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a175b69c00 0x55a175ce8b00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a175b69800 0x55a175ce8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 --2- 172.21.15.81:0/1479649805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a175b68c00 0x55a175ce8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 -- 172.21.15.81:0/1479649805 >> 172.21.15.81:0/1479649805 conn(0x55a175b69000 msgr2=0x55a175c5a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 -- 172.21.15.81:0/1479649805 shutdown_connections 2024-09-10T20:41:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.270+0000 7f47f781c740 1 -- 172.21.15.81:0/1479649805 wait complete. 2024-09-10T20:41:34.279 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', 'cephfs_data'] in time 0:00:00.131455, result: 2024-09-10T20:41:34.279 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --alternate-pool recovery_fs_metadata --filesystem cephfs --force-corrupt --force-init cephfs_data 2024-09-10T20:41:34.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.354+0000 7f8c8000b740 1 -- start start 2024-09-10T20:41:34.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.354+0000 7f8c8000b740 1 Processor -- start 2024-09-10T20:41:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f0fb3000 0x5578f0352b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f0fb3400 0x5578f0353080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f0fb2400 0x5578f0352000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c8000b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578f0fce180 con 0x5578f0fb3400 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c8000b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5578f0fce600 con 0x5578f0fb3000 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c8000b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5578f0fce780 con 0x5578f0fb2400 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c7cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f0fb3400 0x5578f0353080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c7cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f0fb3400 0x5578f0353080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41494/0 (socket says 172.21.15.81:41494) 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.355+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1492822381 learned_addr learned my addr 172.21.15.81:0/1492822381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f0fb3000 0x5578f0352b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f0fb2400 0x5578f0352000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f0fb2400 msgr2=0x5578f0352000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f0fb2400 0x5578f0352000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f0fb3000 msgr2=0x5578f0352b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f0fb3000 0x5578f0352b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1492822381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f01ff680 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f0fb3400 0x5578f0353080 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5578f0fb60c0 tx=0x5578f0f5c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4760d735b01fe5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7a400640 1 -- 172.21.15.81:0/1492822381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5578f01f8340 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7a400640 1 -- 172.21.15.81:0/1492822381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5578f02288c0 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c7a400640 1 -- 172.21.15.81:0/1492822381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5578f01f9380 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c8000b740 1 -- 172.21.15.81:0/1492822381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f01ff2c0 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c8000b740 1 -- 172.21.15.81:0/1492822381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5578f01feb40 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.356+0000 7f8c8000b740 4 waiting for MDS map... 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.357+0000 7f8c7a400640 1 -- 172.21.15.81:0/1492822381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x5578f0ff6600 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.357+0000 7f8c7a400640 1 -- 172.21.15.81:0/1492822381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x5578f022d180 con 0x5578f0fb3400 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.357+0000 7f8c8000b740 4 Got MDS map 25 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.357+0000 7f8c8000b740 4 datascan.main: Using metadata pool output 2024-09-10T20:41:34.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.357+0000 7f8c8000b740 4 datascan.main: connecting to RADOS... 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.357+0000 7f8c8000b740 1 Processor -- start 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.358+0000 7f8c8000b740 1 -- start start 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.358+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f10b9800 0x5578f0353b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.358+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9c00 0x5578f0352580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.358+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f1122000 0x5578f0353600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.358+0000 7f8c8000b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578f0235980 con 0x5578f1122000 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.358+0000 7f8c8000b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5578f0fcf680 con 0x5578f10b9800 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.358+0000 7f8c8000b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5578f0fcf500 con 0x5578f10b9c00 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f1122000 0x5578f0353600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f1122000 0x5578f0353600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41510/0 (socket says 172.21.15.81:41510) 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 -- 172.21.15.81:0/3429503779 learned_addr learned my addr 172.21.15.81:0/3429503779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7d600640 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9c00 0x5578f0352580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7e000640 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f10b9800 0x5578f0353b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 -- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9c00 msgr2=0x5578f0352580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9c00 0x5578f0352580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 -- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f10b9800 msgr2=0x5578f0353b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f10b9800 0x5578f0353b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 -- 172.21.15.81:0/3429503779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f01fe3c0 con 0x5578f1122000 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f1122000 0x5578f0353600 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5578f0fb6780 tx=0x5578f0f5ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67db67f7cba166d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.359+0000 7f8c77c00640 1 -- 172.21.15.81:0/3429503779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5578f01f91e0 con 0x5578f1122000 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c77c00640 1 -- 172.21.15.81:0/3429503779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5578f0228fc0 con 0x5578f1122000 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c77c00640 1 -- 172.21.15.81:0/3429503779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5578f01f8340 con 0x5578f1122000 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 -- 172.21.15.81:0/3429503779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f1122000 msgr2=0x5578f0353600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f1122000 0x5578f0353600 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5578f0fb6780 tx=0x5578f0f5ca20 comp rx=0 tx=0).stop 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 -- 172.21.15.81:0/3429503779 shutdown_connections 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f1122000 0x5578f0353600 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9c00 0x5578f0352580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 --2- 172.21.15.81:0/3429503779 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f10b9800 0x5578f0353b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 -- 172.21.15.81:0/3429503779 >> 172.21.15.81:0/3429503779 conn(0x5578f0fb2000 msgr2=0x5578f02c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 -- 172.21.15.81:0/3429503779 shutdown_connections 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.360+0000 7f8c8000b740 1 -- 172.21.15.81:0/3429503779 wait complete. 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.361+0000 7f8c8000b740 1 Processor -- start 2024-09-10T20:41:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.361+0000 7f8c8000b740 1 -- start start 2024-09-10T20:41:34.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f10b9c00 0x5578f0353b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9800 0x5578f0352580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c8000b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f1123400 0x5578f0353600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c8000b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5578f0fce900 con 0x5578f10b9c00 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c8000b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5578f0fcea80 con 0x5578f1123400 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c8000b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5578f0fce300 con 0x5578f10b9800 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f10b9c00 0x5578f0353b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f10b9c00 0x5578f0353b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41526/0 (socket says 172.21.15.81:41526) 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 learned_addr learned my addr 172.21.15.81:0/1740951836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9800 0x5578f0352580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f1123400 0x5578f0353600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9800 msgr2=0x5578f0352580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f10b9800 0x5578f0352580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f1123400 msgr2=0x5578f0353600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f1123400 0x5578f0353600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f01ff680 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.362+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f1123400 0x5578f0353600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.363+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f10b9c00 0x5578f0353b80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5578f0f76780 tx=0x5578f10c8ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.363+0000 7f8c75e00640 1 -- 172.21.15.81:0/1740951836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5578f01f8ea0 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.363+0000 7f8c75e00640 1 -- 172.21.15.81:0/1740951836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5578f0228c40 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.363+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578f01ff2c0 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.363+0000 7f8c75e00640 1 -- 172.21.15.81:0/1740951836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5578f01f91e0 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.363+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f01ffa40 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.363+0000 7f8c8000b740 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.364+0000 7f8c75e00640 1 -- 172.21.15.81:0/1740951836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x5578f022d500 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.365+0000 7f8c75e00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x5578f0592000 0x5578f0354c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.365+0000 7f8c75e00640 1 -- 172.21.15.81:0/1740951836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x5578f113a800 con 0x5578f10b9c00 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.365+0000 7f8c8000b740 4 datascan.main: data pool 'cephfs_data' has ID 6 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.365+0000 7f8c8000b740 4 datascan.main: opening data pool 'cephfs_data' 2024-09-10T20:41:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.365+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5578f1123000 0x5578f0354100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.365+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:1 7.14 7:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122c00 con 0x5578f1123000 2024-09-10T20:41:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.366+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x5578f0592000 0x5578f0354c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.366+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5578f1123000 0x5578f0354100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.366+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x5578f0592000 0x5578f0354c00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5578f0f77740 tx=0x5578f05606c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.366+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5578f1123000 0x5578f0354100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.367+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x5578f02dc000 con 0x5578f1123000 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.367+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x5578f1122800 0x5578f0354680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.367+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:2 7.1f 7:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122400 con 0x5578f1122800 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.367+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x5578f1122800 0x5578f0354680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.367+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x5578f1122800 0x5578f0354680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.368+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.368+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5578f1122000 0x5578f0355180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.368+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:3 6.0 6:00000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593000 con 0x5578f1122000 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.368+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5578f1122000 0x5578f0355180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.369+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5578f1122000 0x5578f0355180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.369+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.369+0000 7f8c77200640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x5578f05aa000 0x5578f05b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.369+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:4 6.20 6:04000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aa400 con 0x5578f05aa000 2024-09-10T20:41:34.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.370+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x5578f05aa000 0x5578f05b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.370+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x5578f05aa000 0x5578f05b0000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.371+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.371+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:5 6.10 6:08000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aac00 con 0x5578f05aa000 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.371+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.371+0000 7f8c77200640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x5578f05aa800 0x5578f05b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.371+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:6 6.30 6:0c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab000 con 0x5578f05aa800 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.371+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x5578f05aa800 0x5578f05b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.372+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x5578f05aa800 0x5578f05b0580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.372+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.372+0000 7f8c77c00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x5578f05abc00 0x5578f05b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.372+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:7 6.8 6:10000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8000 con 0x5578f05abc00 2024-09-10T20:41:34.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.372+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x5578f05abc00 0x5578f05b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.373+0000 7f8c7d600640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x5578f05abc00 0x5578f05b1080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.373+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.373+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:8 6.28 6:14000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab400 con 0x5578f1122000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.373+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.373+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:9 6.18 6:18000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8400 con 0x5578f05aa000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.374+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.374+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:10 6.38 6:1c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab800 con 0x5578f05aa000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.374+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 4 ==== osd_op_reply(10 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.374+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:11 6.4 6:20000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8800 con 0x5578f1122000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.375+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.375+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:12 6.24 6:24000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0592c00 con 0x5578f05aa800 2024-09-10T20:41:34.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.375+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 2 ==== osd_op_reply(12 [pgnls-filter start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.375+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:13 6.14 6:28000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aa400 con 0x5578f05aa000 2024-09-10T20:41:34.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.375+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 5 ==== osd_op_reply(13 [pgnls-filter start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.375+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:14 6.34 6:2c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123800 con 0x5578f1122000 2024-09-10T20:41:34.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.376+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 4 ==== osd_op_reply(14 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.376+0000 7f8c77c00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x5578f05aac00 0x5578f05b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.376+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:15 6.c 6:30000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab400 con 0x5578f05aac00 2024-09-10T20:41:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.377+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x5578f05aac00 0x5578f05b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.377+0000 7f8c7cc00640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x5578f05aac00 0x5578f05b1600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.378+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== osd_op_reply(15 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.378+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:16 6.2c 6:34000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123c00 con 0x5578f1122800 2024-09-10T20:41:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.378+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 2 ==== osd_op_reply(16 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.378+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:17 6.1c 6:38000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593000 con 0x5578f05abc00 2024-09-10T20:41:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.378+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.378+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:18 6.3c 6:3c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122c00 con 0x5578f05aa000 2024-09-10T20:41:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.379+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 6 ==== osd_op_reply(18 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.379+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:19 6.2 6:40000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8400 con 0x5578f05abc00 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.379+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.379+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:20 6.22 6:44000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9800 con 0x5578f05abc00 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.379+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 4 ==== osd_op_reply(20 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.379+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:21 6.12 6:48000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8000 con 0x5578f1122800 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.380+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.380+0000 7f8c77200640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x5578f05b9c00 0x5578f05b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.380+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:22 6.32 6:4c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0592c00 con 0x5578f05b9c00 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.380+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x5578f05b9c00 0x5578f05b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.380+0000 7f8c7e000640 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x5578f05b9c00 0x5578f05b0b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.381+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.2 v2:172.21.15.81:6809/2010302829 1 ==== osd_op_reply(22 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05b9c00 2024-09-10T20:41:34.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.381+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:23 6.a 6:50000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8c00 con 0x5578f1122800 2024-09-10T20:41:34.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.381+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.381+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:24 6.2a 6:54000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593000 con 0x5578f1122800 2024-09-10T20:41:34.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.381+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 5 ==== osd_op_reply(24 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.381+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:25 6.1a 6:58000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9000 con 0x5578f05abc00 2024-09-10T20:41:34.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.382+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.382+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:26 6.3a 6:5c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122400 con 0x5578f05aac00 2024-09-10T20:41:34.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.382+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 2 ==== osd_op_reply(26 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.382+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:27 6.6 6:60000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9400 con 0x5578f1123000 2024-09-10T20:41:34.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.383+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f1123000 2024-09-10T20:41:34.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.383+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:28 6.26 6:64000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123c00 con 0x5578f05aa000 2024-09-10T20:41:34.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.383+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 7 ==== osd_op_reply(28 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.383+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:29 6.16 6:68000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122c00 con 0x5578f05aa000 2024-09-10T20:41:34.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.383+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 8 ==== osd_op_reply(29 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.384+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:30 6.36 6:6c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123800 con 0x5578f05aa800 2024-09-10T20:41:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.384+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 3 ==== osd_op_reply(30 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.384+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:31 6.e 6:70000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122400 con 0x5578f05aa800 2024-09-10T20:41:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.384+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.384+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:32 6.2e 6:74000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab000 con 0x5578f05abc00 2024-09-10T20:41:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.385+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 6 ==== osd_op_reply(32 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.385+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:33 6.1e 6:78000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123c00 con 0x5578f1122000 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.385+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 5 ==== osd_op_reply(33 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.385+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:34 6.3e 6:7c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9400 con 0x5578f05aac00 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.386+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.386+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:35 6.1 6:80000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab800 con 0x5578f05aac00 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.386+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.386+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:36 6.21 6:84000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8000 con 0x5578f05aa800 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.386+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 5 ==== osd_op_reply(36 [pgnls-filter start_epoch 50 out=49b] v40'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.386+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:37 6.11 6:88000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aa400 con 0x5578f05aac00 2024-09-10T20:41:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.387+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 5 ==== osd_op_reply(37 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.387+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:38 6.31 6:8c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8800 con 0x5578f05abc00 2024-09-10T20:41:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.387+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 7 ==== osd_op_reply(38 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.387+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:39 6.9 6:90000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab400 con 0x5578f05aa000 2024-09-10T20:41:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.388+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 9 ==== osd_op_reply(39 [pgnls-filter start_epoch 50 out=49b] v40'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.388+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:40 6.29 6:94000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8400 con 0x5578f05abc00 2024-09-10T20:41:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.388+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 8 ==== osd_op_reply(40 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.388+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:41 6.19 6:98000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8c00 con 0x5578f1122800 2024-09-10T20:41:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.388+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.389+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:42 6.39 6:9c000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9800 con 0x5578f05aa800 2024-09-10T20:41:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.389+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 6 ==== osd_op_reply(42 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.389+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:43 6.5 6:a0000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8000 con 0x5578f1122800 2024-09-10T20:41:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.389+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 7 ==== osd_op_reply(43 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.389+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:44 6.25 6:a4000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4000 con 0x5578f1122800 2024-09-10T20:41:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.389+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 8 ==== osd_op_reply(44 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.389+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:45 6.15 6:a8000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123800 con 0x5578f05b9c00 2024-09-10T20:41:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.390+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.2 v2:172.21.15.81:6809/2010302829 2 ==== osd_op_reply(45 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05b9c00 2024-09-10T20:41:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.390+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:46 6.35 6:ac000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4400 con 0x5578f1122800 2024-09-10T20:41:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.390+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 9 ==== osd_op_reply(46 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.390+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:47 6.d 6:b0000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122400 con 0x5578f05aa800 2024-09-10T20:41:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.390+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.390+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:48 6.2d 6:b4000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4800 con 0x5578f1123000 2024-09-10T20:41:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.391+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.5 v2:172.21.15.143:6802/1659339177 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f1123000 2024-09-10T20:41:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.391+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:49 6.1d 6:b8000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0592c00 con 0x5578f05aac00 2024-09-10T20:41:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.392+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 6 ==== osd_op_reply(49 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.392+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:50 6.3d 6:bc000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4c00 con 0x5578f05aa000 2024-09-10T20:41:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.392+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 10 ==== osd_op_reply(50 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.392+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:51 6.3 6:c0000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593000 con 0x5578f1122800 2024-09-10T20:41:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.393+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 10 ==== osd_op_reply(51 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.393+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:52 6.23 6:c4000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5000 con 0x5578f05abc00 2024-09-10T20:41:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.393+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 9 ==== osd_op_reply(52 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.393+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:53 6.13 6:c8000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9000 con 0x5578f1122000 2024-09-10T20:41:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.394+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 6 ==== osd_op_reply(53 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.394+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:54 6.33 6:cc000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5400 con 0x5578f05aa800 2024-09-10T20:41:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.394+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.394+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:55 6.b 6:d0000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8800 con 0x5578f05aa000 2024-09-10T20:41:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.395+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 11 ==== osd_op_reply(55 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.395+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:56 6.2b 6:d4000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5800 con 0x5578f1122800 2024-09-10T20:41:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.395+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 11 ==== osd_op_reply(56 [pgnls-filter start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.395+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:57 6.1b 6:d8000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8400 con 0x5578f05aac00 2024-09-10T20:41:34.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.396+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 7 ==== osd_op_reply(57 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.396+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:58 6.3b 6:dc000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5c00 con 0x5578f1122000 2024-09-10T20:41:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.396+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.396+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:59 6.7 6:e0000000::::head [pgnls-filter start_epoch 50 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0592c00 con 0x5578f05abc00 2024-09-10T20:41:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.397+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 10 ==== osd_op_reply(59 [pgnls-filter start_epoch 50 out=81b] v50'10 uv10 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.397+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:60 6.0 6:00000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593400 con 0x5578f1122000 2024-09-10T20:41:34.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.397+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 8 ==== osd_op_reply(60 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.397+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:61 6.20 6:04000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab000 con 0x5578f05aa000 2024-09-10T20:41:34.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.398+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 12 ==== osd_op_reply(61 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.398+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:62 6.10 6:08000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5000 con 0x5578f05aa000 2024-09-10T20:41:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.398+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 13 ==== osd_op_reply(62 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.398+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:63 6.30 6:0c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab800 con 0x5578f05aa800 2024-09-10T20:41:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.399+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 9 ==== osd_op_reply(63 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.399+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4800 con 0x5578f05abc00 2024-09-10T20:41:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.399+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 11 ==== osd_op_reply(64 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.399+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:65 6.28 6:14000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aa400 con 0x5578f1122000 2024-09-10T20:41:34.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.400+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 9 ==== osd_op_reply(65 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.400+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:66 6.18 6:18000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4c00 con 0x5578f05aa000 2024-09-10T20:41:34.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.400+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 14 ==== osd_op_reply(66 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.400+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:67 6.38 6:1c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab400 con 0x5578f05aa000 2024-09-10T20:41:34.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.401+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 15 ==== osd_op_reply(67 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.401+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:68 6.4 6:20000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4000 con 0x5578f1122000 2024-09-10T20:41:34.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.402+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 10 ==== osd_op_reply(68 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.402+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:69 6.24 6:24000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123c00 con 0x5578f05aa800 2024-09-10T20:41:34.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.402+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 10 ==== osd_op_reply(69 [pgnls-filter start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.402+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:70 6.14 6:28000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4400 con 0x5578f05aa000 2024-09-10T20:41:34.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.403+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 16 ==== osd_op_reply(70 [pgnls-filter start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.403+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:71 6.34 6:2c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122c00 con 0x5578f1122000 2024-09-10T20:41:34.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.403+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 11 ==== osd_op_reply(71 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.403+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:72 6.c 6:30000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9400 con 0x5578f05aac00 2024-09-10T20:41:34.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.404+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 8 ==== osd_op_reply(72 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.404+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:73 6.2c 6:34000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5c00 con 0x5578f1122800 2024-09-10T20:41:34.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.404+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.404+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:74 6.1c 6:38000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8c00 con 0x5578f05abc00 2024-09-10T20:41:34.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.404+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 12 ==== osd_op_reply(74 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.404+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:75 6.3c 6:3c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4800 con 0x5578f05aa000 2024-09-10T20:41:34.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.405+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 17 ==== osd_op_reply(75 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.405+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:76 6.2 6:40000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9800 con 0x5578f05abc00 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.405+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 13 ==== osd_op_reply(76 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.405+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:77 6.22 6:44000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4000 con 0x5578f05abc00 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.405+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 14 ==== osd_op_reply(77 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.405+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:78 6.12 6:48000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8000 con 0x5578f1122800 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.406+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 13 ==== osd_op_reply(78 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.406+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:79 6.32 6:4c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aa400 con 0x5578f05b9c00 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.406+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.2 v2:172.21.15.81:6809/2010302829 3 ==== osd_op_reply(79 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05b9c00 2024-09-10T20:41:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.406+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:80 6.a 6:50000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5400 con 0x5578f1122800 2024-09-10T20:41:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.406+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 14 ==== osd_op_reply(80 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.406+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:81 6.2a 6:54000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0592c00 con 0x5578f1122800 2024-09-10T20:41:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.407+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.407+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:82 6.1a 6:58000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8000 con 0x5578f05abc00 2024-09-10T20:41:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.407+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 15 ==== osd_op_reply(82 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.407+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:83 6.3a 6:5c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593400 con 0x5578f05aac00 2024-09-10T20:41:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.407+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.407+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:84 6.6 6:60000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8800 con 0x5578f1123000 2024-09-10T20:41:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.408+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.5 v2:172.21.15.143:6802/1659339177 4 ==== osd_op_reply(84 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f1123000 2024-09-10T20:41:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.408+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:85 6.26 6:64000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9000 con 0x5578f05aa000 2024-09-10T20:41:34.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.408+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 18 ==== osd_op_reply(85 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.408+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:86 6.16 6:68000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8400 con 0x5578f05aa000 2024-09-10T20:41:34.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.409+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 19 ==== osd_op_reply(86 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.409+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:87 6.36 6:6c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123c00 con 0x5578f05aa800 2024-09-10T20:41:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.409+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 11 ==== osd_op_reply(87 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.409+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:88 6.e 6:70000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9400 con 0x5578f05aa800 2024-09-10T20:41:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.409+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 12 ==== osd_op_reply(88 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.409+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:89 6.2e 6:74000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123800 con 0x5578f05abc00 2024-09-10T20:41:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.410+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.410+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:90 6.1e 6:78000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab800 con 0x5578f1122000 2024-09-10T20:41:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.410+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 12 ==== osd_op_reply(90 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.410+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:91 6.3e 6:7c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122400 con 0x5578f05aac00 2024-09-10T20:41:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.411+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 10 ==== osd_op_reply(91 [pgnls-filter start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.411+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:92 6.1 6:80000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aa400 con 0x5578f05aac00 2024-09-10T20:41:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.411+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 11 ==== osd_op_reply(92 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.411+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:93 6.21 6:84000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5800 con 0x5578f05aa800 2024-09-10T20:41:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.412+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 13 ==== osd_op_reply(93 [pgnls-filter start_epoch 50 out=49b] v40'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.412+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:94 6.11 6:88000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab000 con 0x5578f05aac00 2024-09-10T20:41:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.412+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 12 ==== osd_op_reply(94 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.412+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:95 6.31 6:8c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5c00 con 0x5578f05abc00 2024-09-10T20:41:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.413+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 17 ==== osd_op_reply(95 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.413+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:96 6.9 6:90000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab400 con 0x5578f05aa000 2024-09-10T20:41:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.413+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 20 ==== osd_op_reply(96 [pgnls-filter start_epoch 50 out=49b] v40'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.414+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:97 6.29 6:94000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5000 con 0x5578f05abc00 2024-09-10T20:41:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.414+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 18 ==== osd_op_reply(97 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.414+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:98 6.19 6:98000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593000 con 0x5578f1122800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.414+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 16 ==== osd_op_reply(98 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.414+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:99 6.39 6:9c000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4c00 con 0x5578f05aa800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.414+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 14 ==== osd_op_reply(99 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.414+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:100 6.5 6:a0000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4000 con 0x5578f1122800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.415+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 17 ==== osd_op_reply(100 [pgnls-filter start_epoch 50 out=49b] v40'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.415+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:101 6.25 6:a4000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4400 con 0x5578f1122800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.415+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 18 ==== osd_op_reply(101 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.415+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:102 6.15 6:a8000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5c00 con 0x5578f05b9c00 2024-09-10T20:41:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.415+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.2 v2:172.21.15.81:6809/2010302829 4 ==== osd_op_reply(102 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05b9c00 2024-09-10T20:41:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.415+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:103 6.35 6:ac000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4800 con 0x5578f1122800 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.416+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.416+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:104 6.d 6:b0000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05ab800 con 0x5578f05aa800 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.416+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 15 ==== osd_op_reply(104 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.416+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:105 6.2d 6:b4000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5400 con 0x5578f1123000 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.416+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.5 v2:172.21.15.143:6802/1659339177 5 ==== osd_op_reply(105 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f1123000 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.416+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:106 6.1d 6:b8000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122c00 con 0x5578f05aac00 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.417+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 13 ==== osd_op_reply(106 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.417+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:107 6.3d 6:bc000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5800 con 0x5578f05aa000 2024-09-10T20:41:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.417+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 21 ==== osd_op_reply(107 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.417+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:108 6.3 6:c0000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123800 con 0x5578f1122800 2024-09-10T20:41:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.418+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 20 ==== osd_op_reply(108 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.418+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:109 6.23 6:c4000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4c00 con 0x5578f05abc00 2024-09-10T20:41:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.418+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 19 ==== osd_op_reply(109 [pgnls-filter start_epoch 50 out=49b] v40'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.418+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:110 6.13 6:c8000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8c00 con 0x5578f1122000 2024-09-10T20:41:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.419+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 13 ==== osd_op_reply(110 [pgnls-filter start_epoch 50 out=49b] v40'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.419+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:111 6.33 6:cc000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4000 con 0x5578f05aa800 2024-09-10T20:41:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.419+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.1 v2:172.21.15.81:6810/310566059 16 ==== osd_op_reply(111 [pgnls-filter start_epoch 50 out=49b] v40'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05aa800 2024-09-10T20:41:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.419+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:112 6.b 6:d0000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9800 con 0x5578f05aa000 2024-09-10T20:41:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.420+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 22 ==== osd_op_reply(112 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.420+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:113 6.2b 6:d4000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d4400 con 0x5578f1122800 2024-09-10T20:41:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.420+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.420+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:114 6.1b 6:d8000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b8000 con 0x5578f05aac00 2024-09-10T20:41:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.420+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 14 ==== osd_op_reply(114 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.420+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:115 6.3b 6:dc000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0592c00 con 0x5578f1122000 2024-09-10T20:41:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.421+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 14 ==== osd_op_reply(115 [pgnls-filter start_epoch 50 out=49b] v40'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.421+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:116 6.7 6:e0000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122400 con 0x5578f05abc00 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.421+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 20 ==== osd_op_reply(116 [pgnls-filter start_epoch 50 out=81b] v50'10 uv10 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.421+0000 7f8c8000b740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.421+0000 7f8c8000b740 10 datascan.operator(): handling object 10000000001.0 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.421+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:117 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593c00 con 0x5578f05abc00 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.422+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 21 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (95) out=95b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) ==== 416+0+163 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.422+0000 7f8c8000b740 20 datascan.operator(): loaded layout from xattr: pi: 6 os: 4194304 sc: 1 su: 4194304 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.422+0000 7f8c8000b740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.422+0000 7f8c8000b740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/sixmegs 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.422+0000 7f8c8000b740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=sixmegs 2024-09-10T20:41:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.422+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:118 7.10 7:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bc000 con 0x5578f1122000 2024-09-10T20:41:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.422+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 15 ==== osd_op_reply(118 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.423+0000 7f8c8000b740 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2024-09-10T20:41:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.423+0000 7f8c8000b740 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/sixmegs, will insert to root 2024-09-10T20:41:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.423+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:119 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bc400 con 0x5578f1122000 2024-09-10T20:41:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.423+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 16 ==== osd_op_reply(119 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.423+0000 7f8c8000b740 10 datascan.find_or_create_dirfrag: read_version = 0 2024-09-10T20:41:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.423+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:120 7.10 7:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bc800 con 0x5578f1122000 2024-09-10T20:41:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.425+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 17 ==== osd_op_reply(120 10000000000.00000000 [create,omap-set-header] v50'1 uv1 ondisk = 0) ==== 206+0+0 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.426+0000 7f8c8000b740 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2024-09-10T20:41:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.426+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:121 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bcc00 con 0x5578f1122000 2024-09-10T20:41:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.426+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 18 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.426+0000 7f8c8000b740 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2024-09-10T20:41:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.426+0000 7f8c8000b740 20 datascan.read_dentry: sixmegs_head not found in result 2024-09-10T20:41:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.426+0000 7f8c8000b740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/sixmegs with size=6291456 bytes 2024-09-10T20:41:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.426+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:122 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bd000 con 0x5578f1122000 2024-09-10T20:41:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.428+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 19 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v50'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.428+0000 7f8c8000b740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2024-09-10T20:41:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.428+0000 7f8c8000b740 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2024-09-10T20:41:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.428+0000 7f8c8000b740 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2024-09-10T20:41:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.428+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:123 7.1f 7:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bd400 con 0x5578f1122800 2024-09-10T20:41:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.429+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 22 ==== osd_op_reply(123 1.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 154+0+0 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.429+0000 7f8c8000b740 4 datascan.get_frag_of: Unexpected error on '1.00000000': (2) No such file or directory 2024-09-10T20:41:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.429+0000 7f8c8000b740 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2024-09-10T20:41:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.429+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:124 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bd800 con 0x5578f1122800 2024-09-10T20:41:34.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.429+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 23 ==== osd_op_reply(124 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 154+0+0 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.429+0000 7f8c8000b740 10 datascan.find_or_create_dirfrag: read_version = 0 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.429+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:125 7.1f 7:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bdc00 con 0x5578f1122800 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 24 ==== osd_op_reply(125 1.00000000 [create,omap-set-header] v50'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c8000b740 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:126 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bc000 con 0x5578f1122800 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 25 ==== osd_op_reply(126 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) ==== 154+0+4 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c8000b740 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c8000b740 20 datascan.read_dentry: subdir_head not found in result 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c8000b740 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:subdir 2024-09-10T20:41:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.431+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:127 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x5578f05bc400 con 0x5578f1122800 2024-09-10T20:41:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.433+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.0 v2:172.21.15.81:6800/4080460515 26 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v50'3 uv3 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x5578f02dc500 con 0x5578f1122800 2024-09-10T20:41:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.433+0000 7f8c8000b740 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2024-09-10T20:41:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.433+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:128 6.27 6:e4000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0592c00 con 0x5578f05b9c00 2024-09-10T20:41:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.433+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.2 v2:172.21.15.81:6809/2010302829 5 ==== osd_op_reply(128 [pgnls-filter start_epoch 50 out=49b] v40'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05b9c00 2024-09-10T20:41:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.433+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:129 6.17 6:e8000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1122c00 con 0x5578f05b9c00 2024-09-10T20:41:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.434+0000 7f8c7e000640 1 -- 172.21.15.81:0/1740951836 <== osd.2 v2:172.21.15.81:6809/2010302829 6 ==== osd_op_reply(129 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc500 con 0x5578f05b9c00 2024-09-10T20:41:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.434+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:130 6.37 6:ec000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f0593000 con 0x5578f1122000 2024-09-10T20:41:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.434+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.7 v2:172.21.15.143:6810/3238341229 20 ==== osd_op_reply(130 [pgnls-filter start_epoch 50 out=49b] v40'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f1122000 2024-09-10T20:41:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.434+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:131 6.f 6:f0000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05d5400 con 0x5578f1123000 2024-09-10T20:41:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.435+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.5 v2:172.21.15.143:6802/1659339177 6 ==== osd_op_reply(131 [pgnls-filter start_epoch 50 out=49b] v40'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f1123000 2024-09-10T20:41:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.435+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:132 6.2f 6:f4000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05b9400 con 0x5578f05abc00 2024-09-10T20:41:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.435+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 <== osd.3 v2:172.21.15.81:6808/906295494 22 ==== osd_op_reply(132 [pgnls-filter start_epoch 50 out=49b] v40'9 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc780 con 0x5578f05abc00 2024-09-10T20:41:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.435+0000 7f8c77200640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:133 6.1f 6:f8000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f05aa400 con 0x5578f05aac00 2024-09-10T20:41:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.6 v2:172.21.15.143:6818/294800477 15 ==== osd_op_reply(133 [pgnls-filter start_epoch 50 out=49b] v40'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aac00 2024-09-10T20:41:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c77c00640 1 -- 172.21.15.81:0/1740951836 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:134 6.3f 6:fc000000::::head [pgnls-filter start_epoch 50 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x5578f1123c00 con 0x5578f05aa000 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c7cc00640 1 -- 172.21.15.81:0/1740951836 <== osd.4 v2:172.21.15.143:6826/4019230190 23 ==== osd_op_reply(134 [pgnls-filter start_epoch 50 out=49b] v40'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5578f02dc000 con 0x5578f05aa000 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x5578f1122800 msgr2=0x5578f0354680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x5578f1122800 0x5578f0354680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x5578f05aa800 msgr2=0x5578f05b0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x5578f05aa800 0x5578f05b0580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x5578f05b9c00 msgr2=0x5578f05b0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x5578f05b9c00 0x5578f05b0b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x5578f05abc00 msgr2=0x5578f05b1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x5578f05abc00 0x5578f05b1080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x5578f05aa000 msgr2=0x5578f05b0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x5578f05aa000 0x5578f05b0000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 reap_dead start 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5578f1123000 msgr2=0x5578f0354100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5578f1123000 0x5578f0354100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 reap_dead start 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x5578f05aac00 msgr2=0x5578f05b1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x5578f05aac00 0x5578f05b1600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5578f1122000 msgr2=0x5578f0355180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.436+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5578f1122000 0x5578f0355180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c7d600640 1 -- 172.21.15.81:0/1740951836 reap_dead start 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x5578f0592000 msgr2=0x5578f0354c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x5578f0592000 0x5578f0354c00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5578f0f77740 tx=0x5578f05606c0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f10b9c00 msgr2=0x5578f0353b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f10b9c00 0x5578f0353b80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5578f0f76780 tx=0x5578f10c8ea0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 shutdown_connections 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x5578f0592000 0x5578f0354c00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1740951836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f10b9c00 0x5578f0353b80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 >> 172.21.15.81:0/1740951836 conn(0x5578f0fb2000 msgr2=0x5578f02c5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 shutdown_connections 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 -- 172.21.15.81:0/1740951836 wait complete. 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 -- 172.21.15.81:0/1492822381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f0fb3400 msgr2=0x5578f0353080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.437+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f0fb3400 0x5578f0353080 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5578f0fb60c0 tx=0x5578f0f5c240 comp rx=0 tx=0).stop 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.438+0000 7f8c8000b740 1 -- 172.21.15.81:0/1492822381 shutdown_connections 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.438+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5578f0fb2400 0x5578f0352000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.438+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5578f0fb3400 0x5578f0353080 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.438+0000 7f8c8000b740 1 --2- 172.21.15.81:0/1492822381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5578f0fb3000 0x5578f0352b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.438+0000 7f8c8000b740 1 -- 172.21.15.81:0/1492822381 >> 172.21.15.81:0/1492822381 conn(0x5578f01d3000 msgr2=0x5578f02c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.438+0000 7f8c8000b740 1 -- 172.21.15.81:0/1492822381 shutdown_connections 2024-09-10T20:41:34.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.438+0000 7f8c8000b740 1 -- 172.21.15.81:0/1492822381 wait complete. 2024-09-10T20:41:34.446 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', '--force-corrupt', '--force-init', 'cephfs_data'] in time 0:00:00.166920, result: 2024-09-10T20:41:34.446 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links --filesystem recovery_fs 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.516+0000 7fe04de1c740 1 -- start start 2024-09-10T20:41:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.516+0000 7fe04de1c740 1 Processor -- start 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a86908c00 0x560a86a88000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a86909800 0x560a86a88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a86909c00 0x560a86a88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04de1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560a87704600 con 0x560a86909800 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04de1c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560a87704480 con 0x560a86908c00 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04de1c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560a87704300 con 0x560a86909c00 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a86909800 0x560a86a88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a86909800 0x560a86a88580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41542/0 (socket says 172.21.15.81:41542) 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 -- 172.21.15.81:0/923820350 learned_addr learned my addr 172.21.15.81:0/923820350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04b400640 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a86908c00 0x560a86a88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04be00640 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a86909c00 0x560a86a88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 -- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a86909c00 msgr2=0x560a86a88b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a86909c00 0x560a86a88b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 -- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a86908c00 msgr2=0x560a86a88000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a86908c00 0x560a86a88000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 -- 172.21.15.81:0/923820350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a86935680 con 0x560a86909800 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.517+0000 7fe04aa00640 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a86909800 0x560a86a88580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x560a877ec030 tx=0x560a876b9260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68fd20c5e12ec29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe048200640 1 -- 172.21.15.81:0/923820350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a8692eea0 con 0x560a86909800 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe048200640 1 -- 172.21.15.81:0/923820350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560a8695e8c0 con 0x560a86909800 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe048200640 1 -- 172.21.15.81:0/923820350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a8692e340 con 0x560a86909800 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe04de1c740 1 -- 172.21.15.81:0/923820350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a86935a40 con 0x560a86909800 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe04de1c740 1 -- 172.21.15.81:0/923820350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560a869352c0 con 0x560a86909800 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe04de1c740 4 waiting for MDS map... 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe048200640 1 -- 172.21.15.81:0/923820350 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x560a877ea400 con 0x560a86909800 2024-09-10T20:41:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe048200640 1 -- 172.21.15.81:0/923820350 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x560a86963180 con 0x560a86909800 2024-09-10T20:41:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe04de1c740 4 Got MDS map 25 2024-09-10T20:41:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe04de1c740 4 datascan.main: Using metadata pool output 2024-09-10T20:41:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.518+0000 7fe04de1c740 4 datascan.main: connecting to RADOS... 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.519+0000 7fe04de1c740 1 Processor -- start 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.519+0000 7fe04de1c740 1 -- start start 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701000 0x560a86a89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 0x560a86a89600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04de1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560a87704180 con 0x560a87701000 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04de1c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560a87704900 con 0x560a87701800 2024-09-10T20:41:34.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04de1c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560a8696b800 con 0x560a87701400 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701000 0x560a86a89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701000 0x560a86a89080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41552/0 (socket says 172.21.15.81:41552) 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 -- 172.21.15.81:0/3652585624 learned_addr learned my addr 172.21.15.81:0/3652585624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04b400640 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 0x560a86a89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 -- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 msgr2=0x560a86a89600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 0x560a86a89600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 -- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701800 msgr2=0x560a86a89b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.520+0000 7fe04be00640 1 -- 172.21.15.81:0/3652585624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a869354a0 con 0x560a87701000 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04be00640 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701000 0x560a86a89080 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x560a877ed110 tx=0x560a877e3140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c43d234602e0c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe045a00640 1 -- 172.21.15.81:0/3652585624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a8692eea0 con 0x560a87701000 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe045a00640 1 -- 172.21.15.81:0/3652585624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560a8695ee00 con 0x560a87701000 2024-09-10T20:41:34.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe045a00640 1 -- 172.21.15.81:0/3652585624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a8692e340 con 0x560a87701000 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 -- 172.21.15.81:0/3652585624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701000 msgr2=0x560a86a89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701000 0x560a86a89080 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x560a877ed110 tx=0x560a877e3140 comp rx=0 tx=0).stop 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 -- 172.21.15.81:0/3652585624 shutdown_connections 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 0x560a86a89600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3652585624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701000 0x560a86a89080 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 -- 172.21.15.81:0/3652585624 >> 172.21.15.81:0/3652585624 conn(0x560a87700c00 msgr2=0x560a869fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 -- 172.21.15.81:0/3652585624 shutdown_connections 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.521+0000 7fe04de1c740 1 -- 172.21.15.81:0/3652585624 wait complete. 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.522+0000 7fe04de1c740 1 Processor -- start 2024-09-10T20:41:34.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.522+0000 7fe04de1c740 1 -- start start 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701000 0x560a86a89080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 0x560a86a89600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04de1c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04de1c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x560a87704900 con 0x560a87701800 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04de1c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560a87705500 con 0x560a87701000 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04de1c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560a87704180 con 0x560a87701400 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41560/0 (socket says 172.21.15.81:41560) 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 learned_addr learned my addr 172.21.15.81:0/3009017935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 0x560a86a89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.523+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701000 0x560a86a89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 msgr2=0x560a86a89600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a87701400 0x560a86a89600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701000 msgr2=0x560a86a89080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a87701000 0x560a86a89080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a869350e0 con 0x560a87701800 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701800 0x560a86a89b80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x560a877ec9c0 tx=0x560a877e2d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe043c00640 1 -- 172.21.15.81:0/3009017935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a8692eea0 con 0x560a87701800 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe043c00640 1 -- 172.21.15.81:0/3009017935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560a8695efc0 con 0x560a87701800 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe043c00640 1 -- 172.21.15.81:0/3009017935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560a8692e340 con 0x560a87701800 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a869343c0 con 0x560a87701800 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a86934b40 con 0x560a87701800 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.524+0000 7fe04de1c740 4 datascan.init: resolving metadata pool 7 2024-09-10T20:41:34.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.526+0000 7fe043c00640 1 -- 172.21.15.81:0/3009017935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x560a86963500 con 0x560a87701800 2024-09-10T20:41:34.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe043c00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x560a8784fc00 0x560a86a8a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe043c00640 1 -- 172.21.15.81:0/3009017935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x560a87878800 con 0x560a87701800 2024-09-10T20:41:34.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe04de1c740 4 datascan.init: found metadata pool 'recovery_fs_metadata' 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe04de1c740 4 datascan.main: resolving metadata pool 7 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x560a86cd0000 0x560a86a8a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:1 7.0 7:00000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd0400 con 0x560a86cd0000 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x560a86cd0000 0x560a86a8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.527+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x560a8784fc00 0x560a86a8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.528+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x560a86cd0000 0x560a86a8a680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.528+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x560a8784fc00 0x560a86a8a100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560a877ed110 tx=0x560a877e3320 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.528+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 1 ==== osd_op_reply(1 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.528+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x560a86cd0400 0x560a86cde000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.528+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:2 7.10 7:08000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1400 con 0x560a86cd0400 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.528+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x560a86cd0400 0x560a86cde000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.529+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x560a86cd0400 0x560a86cde000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.530+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(2 [pgnls start_epoch 50 out=81b] v50'2 uv2 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.530+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x560a86cd1400 0x560a86cde580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.530+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:3 7.8 7:10000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784e400 con 0x560a86cd1400 2024-09-10T20:41:34.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.530+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x560a86cd1400 0x560a86cde580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.531+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x560a86cd1400 0x560a86cde580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.531+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== osd_op_reply(3 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.531+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x560a8784e400 0x560a86cdeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.531+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:4 7.18 7:18000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1800 con 0x560a8784e400 2024-09-10T20:41:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.531+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x560a8784e400 0x560a86cdeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.532+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x560a8784e400 0x560a86cdeb00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.532+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 1 ==== osd_op_reply(4 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.532+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:5 7.4 7:20000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1800 con 0x560a8784e400 2024-09-10T20:41:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.533+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 2 ==== osd_op_reply(5 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.533+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:6 7.14 7:28000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1800 con 0x560a86cd1400 2024-09-10T20:41:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.533+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== osd_op_reply(6 [pgnls start_epoch 50 out=77b] v50'1 uv1 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.533+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x560a86cd1800 0x560a86cdf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.533+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:7 7.c 7:30000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1c00 con 0x560a86cd1800 2024-09-10T20:41:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.533+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x560a86cd1800 0x560a86cdf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.534+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x560a86cd1800 0x560a86cdf080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.534+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 1 ==== osd_op_reply(7 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.534+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:8 7.1c 7:38000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1c00 con 0x560a86cd1800 2024-09-10T20:41:34.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.534+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 2 ==== osd_op_reply(8 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.534+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:9 7.2 7:40000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1c00 con 0x560a8784e400 2024-09-10T20:41:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.535+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 3 ==== osd_op_reply(9 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.535+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:10 7.12 7:48000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1c00 con 0x560a86cd0000 2024-09-10T20:41:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.535+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 2 ==== osd_op_reply(10 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.535+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:11 7.a 7:50000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1c00 con 0x560a8784e400 2024-09-10T20:41:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.536+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 4 ==== osd_op_reply(11 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.536+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x560a86cd1c00 0x560a86cdf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.536+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:12 7.1a 7:58000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1c00 2024-09-10T20:41:34.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.537+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x560a86cd1c00 0x560a86cdf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.537+0000 7fe04b400640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x560a86cd1c00 0x560a86cdf600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.537+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 1 ==== osd_op_reply(12 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.537+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:13 7.6 7:60000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1400 2024-09-10T20:41:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.538+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 3 ==== osd_op_reply(13 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.538+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:14 7.16 7:68000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd0000 2024-09-10T20:41:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.538+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 3 ==== osd_op_reply(14 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.538+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:15 7.e 7:70000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd0400 2024-09-10T20:41:34.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== osd_op_reply(15 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:16 7.1e 7:78000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd0400 2024-09-10T20:41:34.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 3 ==== osd_op_reply(16 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:17 7.1 7:80000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1800 2024-09-10T20:41:34.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 3 ==== osd_op_reply(17 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:18 7.11 7:88000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1800 2024-09-10T20:41:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 4 ==== osd_op_reply(18 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.539+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:19 7.9 7:90000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1400 2024-09-10T20:41:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.540+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 4 ==== osd_op_reply(19 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.540+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:20 7.19 7:98000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1c00 2024-09-10T20:41:34.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.540+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 2 ==== osd_op_reply(20 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.540+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:21 7.5 7:a0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1c00 2024-09-10T20:41:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.541+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 3 ==== osd_op_reply(21 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.541+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:22 7.15 7:a8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1c00 2024-09-10T20:41:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.541+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 4 ==== osd_op_reply(22 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.541+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:23 7.d 7:b0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd0000 2024-09-10T20:41:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.541+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 4 ==== osd_op_reply(23 [pgnls start_epoch 50 out=74b] v50'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.541+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:24 7.1d 7:b8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1400 2024-09-10T20:41:34.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.542+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 5 ==== osd_op_reply(24 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.542+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:25 7.3 7:c0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd1400 2024-09-10T20:41:34.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.542+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 6 ==== osd_op_reply(25 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.542+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:26 7.13 7:c8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a8784f000 con 0x560a86cd0400 2024-09-10T20:41:34.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.543+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 4 ==== osd_op_reply(26 [pgnls start_epoch 50 out=98b] v50'2 uv2 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.543+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x560a8784f000 0x560a86cdfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.543+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:27 7.b 7:d0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc000 con 0x560a8784f000 2024-09-10T20:41:34.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.543+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x560a8784f000 0x560a86cdfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.543+0000 7fe04aa00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x560a8784f000 0x560a86cdfb80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.544+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== osd_op_reply(27 [pgnls start_epoch 50 out=76b] v50'1 uv1 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x560a86a12780 con 0x560a8784f000 2024-09-10T20:41:34.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.544+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:28 7.1b 7:d8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc000 con 0x560a8784e400 2024-09-10T20:41:34.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.544+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 5 ==== osd_op_reply(28 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.544+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:29 7.7 7:e0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc000 con 0x560a86cd1c00 2024-09-10T20:41:34.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.545+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 5 ==== osd_op_reply(29 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.545+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:30 7.17 7:e8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc000 con 0x560a86cd0000 2024-09-10T20:41:34.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.545+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 5 ==== osd_op_reply(30 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.545+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:31 7.f 7:f0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc000 con 0x560a86cd0400 2024-09-10T20:41:34.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.545+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 5 ==== osd_op_reply(31 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.545+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x560a86cfc000 0x560a86ce0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.545+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:32 7.1f 7:f8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc400 con 0x560a86cfc000 2024-09-10T20:41:34.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.546+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x560a86cfc000 0x560a86ce0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.546+0000 7fe04be00640 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x560a86cfc000 0x560a86ce0100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.546+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== osd_op_reply(32 [pgnls start_epoch 50 out=101b] v50'3 uv3 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x560a86a12500 con 0x560a86cfc000 2024-09-10T20:41:34.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.546+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-09-10T20:41:34.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.546+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:33 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd0800 con 0x560a86cd0400 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 6 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv2 ondisk = 0) ==== 164+0+509 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 20 datascan.scan_links: injected ino detected 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.547+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:34 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd0c00 con 0x560a86cd0400 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 7 ==== osd_op_reply(34 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-09-10T20:41:34.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-10T20:41:34.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-09-10T20:41:34.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-10T20:41:34.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-09-10T20:41:34.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:35 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1000 con 0x560a86cfc000 2024-09-10T20:41:34.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.0 v2:172.21.15.81:6800/4080460515 2 ==== osd_op_reply(35 1.00000000 [omap-get-vals out=508b] v0'0 uv3 ondisk = 0) ==== 154+0+508 (crc 0 0 0) 0x560a86a12500 con 0x560a86cfc000 2024-09-10T20:41:34.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 20 datascan.scan_links: injected ino detected 2024-09-10T20:41:34.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:36 7.0 7:00000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0000 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 6 ==== osd_op_reply(36 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.548+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:37 7.10 7:08000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0400 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.549+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 8 ==== osd_op_reply(37 [pgnls start_epoch 50 out=81b] v50'2 uv2 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.549+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:38 7.8 7:10000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1400 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.549+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 7 ==== osd_op_reply(38 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.549+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:39 7.18 7:18000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a8784e400 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.550+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 6 ==== osd_op_reply(39 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.550+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:40 7.4 7:20000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a8784e400 2024-09-10T20:41:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.550+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 7 ==== osd_op_reply(40 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.550+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:41 7.14 7:28000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1400 2024-09-10T20:41:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.551+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 8 ==== osd_op_reply(41 [pgnls start_epoch 50 out=77b] v50'1 uv1 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.551+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:42 7.c 7:30000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1800 2024-09-10T20:41:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.551+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 5 ==== osd_op_reply(42 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.551+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:43 7.1c 7:38000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1800 2024-09-10T20:41:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.552+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 6 ==== osd_op_reply(43 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.552+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:44 7.2 7:40000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a8784e400 2024-09-10T20:41:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.552+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 8 ==== osd_op_reply(44 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.552+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:45 7.12 7:48000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0000 2024-09-10T20:41:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.552+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 7 ==== osd_op_reply(45 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.552+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:46 7.a 7:50000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a8784e400 2024-09-10T20:41:34.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.553+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 9 ==== osd_op_reply(46 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.553+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:47 7.1a 7:58000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1c00 2024-09-10T20:41:34.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.553+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 6 ==== osd_op_reply(47 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.553+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:48 7.6 7:60000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1400 2024-09-10T20:41:34.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.554+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 9 ==== osd_op_reply(48 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.554+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:49 7.16 7:68000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0000 2024-09-10T20:41:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.555+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 8 ==== osd_op_reply(49 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.555+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:50 7.e 7:70000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0400 2024-09-10T20:41:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.555+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 9 ==== osd_op_reply(50 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.555+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:51 7.1e 7:78000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0400 2024-09-10T20:41:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.555+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 10 ==== osd_op_reply(51 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.555+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:52 7.1 7:80000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1800 2024-09-10T20:41:34.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.556+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 7 ==== osd_op_reply(52 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.556+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- osd_op(unknown.0.0:53 7.11 7:88000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1800 2024-09-10T20:41:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.556+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.2 v2:172.21.15.81:6809/2010302829 8 ==== osd_op_reply(53 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd1800 2024-09-10T20:41:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.556+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:54 7.9 7:90000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1400 2024-09-10T20:41:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.556+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 10 ==== osd_op_reply(54 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.556+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:55 7.19 7:98000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1c00 2024-09-10T20:41:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.557+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 7 ==== osd_op_reply(55 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.557+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:56 7.5 7:a0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1c00 2024-09-10T20:41:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.557+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 8 ==== osd_op_reply(56 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.557+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:57 7.15 7:a8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1c00 2024-09-10T20:41:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.557+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 9 ==== osd_op_reply(57 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.557+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:58 7.d 7:b0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0000 2024-09-10T20:41:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.558+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 9 ==== osd_op_reply(58 [pgnls start_epoch 50 out=74b] v50'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.558+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:59 7.1d 7:b8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1400 2024-09-10T20:41:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.558+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 11 ==== osd_op_reply(59 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.558+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:60 7.3 7:c0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1400 2024-09-10T20:41:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.558+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.5 v2:172.21.15.143:6802/1659339177 12 ==== osd_op_reply(60 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1400 2024-09-10T20:41:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.558+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:61 7.13 7:c8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0400 2024-09-10T20:41:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.559+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 11 ==== osd_op_reply(61 [pgnls start_epoch 50 out=98b] v50'2 uv2 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.559+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:62 7.b 7:d0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a8784f000 2024-09-10T20:41:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.559+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.6 v2:172.21.15.143:6818/294800477 2 ==== osd_op_reply(62 [pgnls start_epoch 50 out=76b] v50'1 uv1 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x560a86a12780 con 0x560a8784f000 2024-09-10T20:41:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.559+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:63 7.1b 7:d8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a8784e400 2024-09-10T20:41:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.560+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 <== osd.4 v2:172.21.15.143:6826/4019230190 10 ==== osd_op_reply(63 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12780 con 0x560a8784e400 2024-09-10T20:41:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.560+0000 7fe04aa00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:64 7.7 7:e0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd1c00 2024-09-10T20:41:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.560+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.3 v2:172.21.15.81:6808/906295494 10 ==== osd_op_reply(64 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd1c00 2024-09-10T20:41:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.560+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:65 7.17 7:e8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0000 2024-09-10T20:41:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.560+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 10 ==== osd_op_reply(65 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.560+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:66 7.f 7:f0000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0400 2024-09-10T20:41:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.561+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 12 ==== osd_op_reply(66 [pgnls start_epoch 50 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.561+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:67 7.1f 7:f8000000::::head [pgnls start_epoch 50 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cfc000 2024-09-10T20:41:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.561+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.0 v2:172.21.15.81:6800/4080460515 3 ==== osd_op_reply(67 [pgnls start_epoch 50 out=101b] v50'3 uv3 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x560a86a12500 con 0x560a86cfc000 2024-09-10T20:41:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.561+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-09-10T20:41:34.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.561+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:68 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc400 con 0x560a86cd0400 2024-09-10T20:41:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 13 ==== osd_op_reply(68 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv2 ondisk = 0) ==== 164+0+509 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 20 datascan.scan_links: injected ino detected 2024-09-10T20:41:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:69 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfcc00 con 0x560a86cd0400 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 14 ==== osd_op_reply(69 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-10T20:41:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:70 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd0800 con 0x560a86cfc000 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.0 v2:172.21.15.81:6800/4080460515 4 ==== osd_op_reply(70 1.00000000 [omap-get-vals out=508b] v0'0 uv3 ondisk = 0) ==== 154+0+508 (crc 0 0 0) 0x560a86a12500 con 0x560a86cfc000 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 20 datascan.scan_links: injected ino detected 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: processing 2 injected_inos 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 10 datascan.scan_links: handling injected_ino 0x10000000000 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:subdir 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.562+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:71 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd0c00 con 0x560a86cfc000 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.563+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.0 v2:172.21.15.81:6800/4080460515 5 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv3 ondisk = 0) ==== 154+0+507 (crc 0 0 0) 0x560a86a12500 con 0x560a86cfc000 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.563+0000 7fe04de1c740 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2024-09-10T20:41:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.563+0000 7fe04de1c740 20 datascan.scan_links: first is now 2 2024-09-10T20:41:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.563+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:72 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd1000 con 0x560a86cfc000 2024-09-10T20:41:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.564+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.0 v2:172.21.15.81:6800/4080460515 6 ==== osd_op_reply(72 1.00000000 [omap-set-vals] v50'4 uv4 ondisk = 0) ==== 154+0+0 (crc 0 0 0) 0x560a86a12500 con 0x560a86cfc000 2024-09-10T20:41:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.564+0000 7fe04de1c740 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2024-09-10T20:41:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.564+0000 7fe04de1c740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-09-10T20:41:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.564+0000 7fe04de1c740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:sixmegs 2024-09-10T20:41:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.564+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:73 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc800 con 0x560a86cd0400 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.565+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 15 ==== osd_op_reply(73 10000000000.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv2 ondisk = 0) ==== 164+0+508 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.565+0000 7fe04de1c740 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.565+0000 7fe04de1c740 20 datascan.scan_links: first is now 2 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.565+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:74 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfc400 con 0x560a86cd0400 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.566+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 16 ==== osd_op_reply(74 10000000000.00000000 [omap-set-vals] v50'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x560a86a12500 con 0x560a86cd0400 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.566+0000 7fe04de1c740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.566+0000 7fe04de1c740 10 datascan.scan_links: updating inotable 2024-09-10T20:41:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.566+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:75 7.13 7:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfcc00 con 0x560a86cd0400 2024-09-10T20:41:34.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.567+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 17 ==== osd_op_reply(75 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x560a86a12280 con 0x560a86cd0400 2024-09-10T20:41:34.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.567+0000 7fe04de1c740 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2024-09-10T20:41:34.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.567+0000 7fe04de1c740 10 mds.0.inotable: skip_inos now [0x10000000002~0xfffffffffe] 2024-09-10T20:41:34.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.567+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:76 7.13 7:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x560a86cfd000 con 0x560a86cd0400 2024-09-10T20:41:34.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04be00640 1 -- 172.21.15.81:0/3009017935 <== osd.7 v2:172.21.15.143:6810/3238341229 18 ==== osd_op_reply(76 mds0_inotable [writefull 0~34] v50'3 uv3 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x560a86a12280 con 0x560a86cd0400 2024-09-10T20:41:34.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 10 datascan.scan_links: updating snaptable 2024-09-10T20:41:34.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- osd_op(unknown.0.0:77 7.d 7:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x560a86cd0800 con 0x560a86cd0000 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 <== osd.1 v2:172.21.15.81:6810/310566059 11 ==== osd_op_reply(77 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x560a86a12000 con 0x560a86cd0000 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x560a86cfc000 msgr2=0x560a86ce0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x560a86cfc000 0x560a86ce0100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x560a86cd0000 msgr2=0x560a86a8a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x560a86cd0000 0x560a86a8a680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x560a86cd1800 msgr2=0x560a86cdf080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x560a86cd1800 0x560a86cdf080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x560a86cd1c00 msgr2=0x560a86cdf600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x560a86cd1c00 0x560a86cdf600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x560a8784e400 msgr2=0x560a86cdeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x560a8784e400 0x560a86cdeb00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x560a86cd1400 msgr2=0x560a86cde580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x560a86cd1400 0x560a86cde580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x560a8784f000 msgr2=0x560a86cdfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x560a8784f000 0x560a86cdfb80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x560a86cd0400 msgr2=0x560a86cde000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x560a86cd0400 0x560a86cde000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 reap_dead start 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 reap_dead start 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 reap_dead start 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 reap_dead start 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04b400640 1 -- 172.21.15.81:0/3009017935 reap_dead start 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x560a8784fc00 msgr2=0x560a86a8a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.569+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x560a8784fc00 0x560a86a8a100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560a877ed110 tx=0x560a877e3320 comp rx=0 tx=0).stop 2024-09-10T20:41:34.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701800 msgr2=0x560a86a89b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701800 0x560a86a89b80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x560a877ec9c0 tx=0x560a877e2d20 comp rx=0 tx=0).stop 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 shutdown_connections 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x560a8784fc00 0x560a86a8a100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 --2- 172.21.15.81:0/3009017935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a87701800 0x560a86a89b80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 >> 172.21.15.81:0/3009017935 conn(0x560a87700c00 msgr2=0x560a869fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 shutdown_connections 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/3009017935 wait complete. 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/923820350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a86909800 msgr2=0x560a86a88580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a86909800 0x560a86a88580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x560a877ec030 tx=0x560a876b9260 comp rx=0 tx=0).stop 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/923820350 shutdown_connections 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560a86909c00 0x560a86a88b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560a86909800 0x560a86a88580 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 --2- 172.21.15.81:0/923820350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560a86908c00 0x560a86a88000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/923820350 >> 172.21.15.81:0/923820350 conn(0x560a86909000 msgr2=0x560a869fa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/923820350 shutdown_connections 2024-09-10T20:41:34.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.570+0000 7fe04de1c740 1 -- 172.21.15.81:0/923820350 wait complete. 2024-09-10T20:41:34.579 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links', '--filesystem', 'recovery_fs'] in time 0:00:00.132458, result: 2024-09-10T20:41:34.579 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 event recover_dentries list --alternate-pool recovery_fs_metadata 2024-09-10T20:41:34.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.651+0000 7fe7a8bfc280 1 -- start start 2024-09-10T20:41:34.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.651+0000 7fe7a8bfc280 1 Processor -- start 2024-09-10T20:41:34.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be7538c00 0x559be8310000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be7539800 0x559be8310580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be7539c00 0x559be8310b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559be8320600 con 0x559be7539c00 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559be8320480 con 0x559be7538c00 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559be8320300 con 0x559be7539800 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be7539c00 0x559be8310b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be7539c00 0x559be8310b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41580/0 (socket says 172.21.15.81:41580) 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 -- 172.21.15.81:0/4058339388 learned_addr learned my addr 172.21.15.81:0/4058339388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a6200640 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be7539800 0x559be8310580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be7538c00 0x559be8310000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 -- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be7539800 msgr2=0x559be8310580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be7539800 0x559be8310580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 -- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be7538c00 msgr2=0x559be8310000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be7538c00 0x559be8310000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a7600640 1 -- 172.21.15.81:0/4058339388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559be7570780 con 0x559be7539c00 2024-09-10T20:41:34.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a6200640 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be7539800 0x559be8310580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.652+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be7538c00 0x559be8310000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a7600640 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be7539c00 0x559be8310b00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x559be8355230 tx=0x559be76004e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4061be9ea0cd7df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a3a00640 1 -- 172.21.15.81:0/4058339388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559be755e340 con 0x559be7539c00 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a3a00640 1 -- 172.21.15.81:0/4058339388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559be7564e00 con 0x559be7539c00 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a3a00640 1 -- 172.21.15.81:0/4058339388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559be755eea0 con 0x559be7539c00 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/4058339388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559be75714a0 con 0x559be7539c00 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/4058339388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559be7570000 con 0x559be7539c00 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a8bfc280 4 waiting for MDS map... 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a3a00640 1 -- 172.21.15.81:0/4058339388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x559be8416200 con 0x559be7539c00 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a3a00640 1 -- 172.21.15.81:0/4058339388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x559be7593180 con 0x559be7539c00 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a8bfc280 4 Got MDS map 25 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a8bfc280 10 main: JournalTool::main 2024-09-10T20:41:34.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.653+0000 7fe7a8bfc280 4 main: JournalTool: connecting to RADOS... 2024-09-10T20:41:34.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.654+0000 7fe7a8bfc280 1 Processor -- start 2024-09-10T20:41:34.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.654+0000 7fe7a8bfc280 1 -- start start 2024-09-10T20:41:34.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415400 0x559be8311600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415800 0x559be8311b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559be8320180 con 0x559be8415400 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559be759b380 con 0x559be8415000 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559be759b800 con 0x559be8415800 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a6c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415400 0x559be8311600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a6c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415400 0x559be8311600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41592/0 (socket says 172.21.15.81:41592) 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.655+0000 7fe7a6c00640 1 -- 172.21.15.81:0/3247970529 learned_addr learned my addr 172.21.15.81:0/3247970529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6200640 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6200640 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415800 0x559be8311b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6c00640 1 -- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415800 msgr2=0x559be8311b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415800 0x559be8311b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6c00640 1 -- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 msgr2=0x559be8311080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6c00640 1 -- 172.21.15.81:0/3247970529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559be75703c0 con 0x559be8415400 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6200640 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415400 0x559be8311600 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x559be8412e40 tx=0x559be8428ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d01e174d911e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a1200640 1 -- 172.21.15.81:0/3247970529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559be755e340 con 0x559be8415400 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a1200640 1 -- 172.21.15.81:0/3247970529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559be7564540 con 0x559be8415400 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.656+0000 7fe7a1200640 1 -- 172.21.15.81:0/3247970529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559be755eea0 con 0x559be8415400 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/3247970529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415400 msgr2=0x559be8311600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415400 0x559be8311600 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x559be8412e40 tx=0x559be8428ea0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/3247970529 shutdown_connections 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415800 0x559be8311b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415400 0x559be8311600 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/3247970529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/3247970529 >> 172.21.15.81:0/3247970529 conn(0x559be8414c00 msgr2=0x559be7648800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/3247970529 shutdown_connections 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/3247970529 wait complete. 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.657+0000 7fe7a8bfc280 1 Processor -- start 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.658+0000 7fe7a8bfc280 1 -- start start 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.658+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.658+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415400 0x559be8311600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.658+0000 7fe7a8bfc280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415800 0x559be8311b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.658+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559be8321380 con 0x559be8415800 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.658+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x559be8320180 con 0x559be8415000 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.658+0000 7fe7a8bfc280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x559be8320c00 con 0x559be8415400 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415800 0x559be8311b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415800 0x559be8311b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41604/0 (socket says 172.21.15.81:41604) 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 -- 172.21.15.81:0/2051560629 learned_addr learned my addr 172.21.15.81:0/2051560629 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415400 0x559be8311600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 -- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415400 msgr2=0x559be8311600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be8415400 0x559be8311600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 -- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 msgr2=0x559be8311080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be8415000 0x559be8311080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 -- 172.21.15.81:0/2051560629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559be7570960 con 0x559be8415800 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe7a6200640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415800 0x559be8311b80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x559be8413ad0 tx=0x559be8428d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.659+0000 7fe79f400640 1 -- 172.21.15.81:0/2051560629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559be755e340 con 0x559be8415800 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.660+0000 7fe79f400640 1 -- 172.21.15.81:0/2051560629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559be7564380 con 0x559be8415800 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.660+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559be7571680 con 0x559be8415800 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.660+0000 7fe79f400640 1 -- 172.21.15.81:0/2051560629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559be755eea0 con 0x559be8415800 2024-09-10T20:41:34.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.660+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559be7571860 con 0x559be8415800 2024-09-10T20:41:34.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.660+0000 7fe7a8bfc280 4 main: JournalTool: resolving pool 7 2024-09-10T20:41:34.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.661+0000 7fe79f400640 1 -- 172.21.15.81:0/2051560629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x559be7593500 con 0x559be8415800 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe79f400640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x559be848f400 0x559be8312100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe79f400640 1 -- 172.21.15.81:0/2051560629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x559be848b000 con 0x559be8415800 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe7a8bfc280 4 main: JournalTool: creating IoCtx.. 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe7a8bfc280 4 main: Executing for rank 0 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe7a8bfc280 1 main_event: Using alternate pool recovery_fs_metadata 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x559be848f800 0x559be8312680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50) -- 0x559be848fc00 con 0x559be848f800 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.662+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x559be848f400 0x559be8312100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.663+0000 7fe7a6200640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x559be848f800 0x559be8312680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.663+0000 7fe7a6200640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x559be848f800 0x559be8312680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.663+0000 7fe7a6c00640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x559be848f400 0x559be8312100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x559be8412e40 tx=0x559be8429080 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.663+0000 7fe7a6200640 1 -- 172.21.15.81:0/2051560629 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(1 400.00000000 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559be763e000 con 0x559be848f800 2024-09-10T20:41:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.664+0000 7fe7a8bfc280 -1 Pointer 400.00000000 is absent 2024-09-10T20:41:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.664+0000 7fe7a8bfc280 4 main_event: consumed 0 inodes 2024-09-10T20:41:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.664+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x559be78f0000 0x559be8312c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.664+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:2 7.3 7:c0ce80d4:::4.00000000:head [omap-rm-keys in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x559be78f0400 con 0x559be78f0000 2024-09-10T20:41:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.664+0000 7fe7a7600640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x559be78f0000 0x559be8312c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.665+0000 7fe7a7600640 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x559be78f0000 0x559be8312c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.666+0000 7fe7a7600640 1 -- 172.21.15.81:0/2051560629 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== osd_op_reply(2 4.00000000 [omap-rm-keys] v50'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 154+0+0 (crc 0 0 0) 0x559be763e500 con 0x559be78f0000 2024-09-10T20:41:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.666+0000 7fe7a8bfc280 4 0 events 2024-09-10T20:41:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x559be78f0000 msgr2=0x559be8312c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x559be78f0000 0x559be8312c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x559be848f800 msgr2=0x559be8312680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x559be848f800 0x559be8312680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x559be848f400 msgr2=0x559be8312100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x559be848f400 0x559be8312100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x559be8412e40 tx=0x559be8429080 comp rx=0 tx=0).stop 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415800 msgr2=0x559be8311b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/2051560629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be8415800 0x559be8311b80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x559be8413ad0 tx=0x559be8428d80 comp rx=0 tx=0).stop 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a6c00640 1 -- 172.21.15.81:0/2051560629 reap_dead start 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 shutdown_connections 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a6c00640 1 -- 172.21.15.81:0/2051560629 reap_dead start 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 >> 172.21.15.81:0/2051560629 conn(0x559be8414c00 msgr2=0x559be7648800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 shutdown_connections 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/2051560629 wait complete. 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/4058339388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be7539c00 msgr2=0x559be8310b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be7539c00 0x559be8310b00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x559be8355230 tx=0x559be76004e0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/4058339388 shutdown_connections 2024-09-10T20:41:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559be7539c00 0x559be8310b00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x559be7539800 0x559be8310580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 --2- 172.21.15.81:0/4058339388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x559be7538c00 0x559be8310000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/4058339388 >> 172.21.15.81:0/4058339388 conn(0x559be7539000 msgr2=0x559be7649000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/4058339388 shutdown_connections 2024-09-10T20:41:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.667+0000 7fe7a8bfc280 1 -- 172.21.15.81:0/4058339388 wait complete. 2024-09-10T20:41:34.677 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'event', 'recover_dentries', 'list', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.097536, result: 2024-09-10T20:41:34.677 DEBUG:teuthology.orchestra.run.smithi081:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 journal reset --force --yes-i-really-really-mean-it 2024-09-10T20:41:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.748+0000 7f29d8dfe280 1 -- start start 2024-09-10T20:41:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.748+0000 7f29d8dfe280 1 Processor -- start 2024-09-10T20:41:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561285cccc00 0x561286aa0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561285ccd800 0x561286aa0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561285ccdc00 0x561286aa0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561286ac4180 con 0x561285ccdc00 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561285d2f800 con 0x561285ccd800 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561285d2f380 con 0x561285cccc00 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561285ccdc00 0x561286aa0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561285ccdc00 0x561286aa0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41630/0 (socket says 172.21.15.81:41630) 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 -- 172.21.15.81:0/2789511678 learned_addr learned my addr 172.21.15.81:0/2789511678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d6400640 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561285ccd800 0x561286aa0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561285cccc00 0x561286aa0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 -- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561285cccc00 msgr2=0x561286aa0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561285cccc00 0x561286aa0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 -- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561285ccd800 msgr2=0x561286aa0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561285ccd800 0x561286aa0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d7800640 1 -- 172.21.15.81:0/2789511678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561285d04780 con 0x561285ccdc00 2024-09-10T20:41:34.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561285cccc00 0x561286aa0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.749+0000 7f29d6400640 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561285ccd800 0x561286aa0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d7800640 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561285ccdc00 0x561286aa0b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x561286afb350 tx=0x561285d831a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f21e7bd39897d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d3c00640 1 -- 172.21.15.81:0/2789511678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561285cf2340 con 0x561285ccdc00 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d3c00640 1 -- 172.21.15.81:0/2789511678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561285cf8540 con 0x561285ccdc00 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d3c00640 1 -- 172.21.15.81:0/2789511678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561285cf2ea0 con 0x561285ccdc00 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2789511678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561285d054a0 con 0x561285ccdc00 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2789511678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561285d04000 con 0x561285ccdc00 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d8dfe280 4 waiting for MDS map... 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d3c00640 1 -- 172.21.15.81:0/2789511678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x561286baa200 con 0x561285ccdc00 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d3c00640 1 -- 172.21.15.81:0/2789511678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x561285d27180 con 0x561285ccdc00 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d8dfe280 4 Got MDS map 25 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d8dfe280 10 main: JournalTool::main 2024-09-10T20:41:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.750+0000 7f29d8dfe280 4 main: JournalTool: connecting to RADOS... 2024-09-10T20:41:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.751+0000 7f29d8dfe280 1 Processor -- start 2024-09-10T20:41:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.751+0000 7f29d8dfe280 1 -- start start 2024-09-10T20:41:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561285d2f980 con 0x561286ba7400 2024-09-10T20:41:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561286ac5500 con 0x561286ba7800 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561286ac5380 con 0x561286ba7000 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41640/0 (socket says 172.21.15.81:41640) 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 -- 172.21.15.81:0/3764113227 learned_addr learned my addr 172.21.15.81:0/3764113227 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6400640 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 -- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7000 msgr2=0x561286aa1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6400640 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 -- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7800 msgr2=0x561286aa1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6e00640 1 -- 172.21.15.81:0/3764113227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561285d043c0 con 0x561286ba7400 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.752+0000 7f29d6400640 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d6e00640 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7400 0x561286aa1600 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x561286ae11d0 tx=0x561286baec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4fd221fb9b7ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d1400640 1 -- 172.21.15.81:0/3764113227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561285cf2340 con 0x561286ba7400 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d1400640 1 -- 172.21.15.81:0/3764113227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561285cf8fc0 con 0x561286ba7400 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d1400640 1 -- 172.21.15.81:0/3764113227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561285cf2ea0 con 0x561286ba7400 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 -- 172.21.15.81:0/3764113227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7400 msgr2=0x561286aa1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7400 0x561286aa1600 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x561286ae11d0 tx=0x561286baec00 comp rx=0 tx=0).stop 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 -- 172.21.15.81:0/3764113227 shutdown_connections 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/3764113227 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 -- 172.21.15.81:0/3764113227 >> 172.21.15.81:0/3764113227 conn(0x561286ba6c00 msgr2=0x561286a71000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 -- 172.21.15.81:0/3764113227 shutdown_connections 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.753+0000 7f29d8dfe280 1 -- 172.21.15.81:0/3764113227 wait complete. 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.754+0000 7f29d8dfe280 1 Processor -- start 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.754+0000 7f29d8dfe280 1 -- start start 2024-09-10T20:41:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561286ac5680 con 0x561286ba7800 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561286ac4900 con 0x561286ba7000 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561285d2f380 con 0x561286ba7400 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d6400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d6400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41646/0 (socket says 172.21.15.81:41646) 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d6400640 1 -- 172.21.15.81:0/2908257009 learned_addr learned my addr 172.21.15.81:0/2908257009 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d6400640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.755+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d6400640 1 -- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7400 msgr2=0x561286aa1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d6400640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d6400640 1 -- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7000 msgr2=0x561286aa1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d6400640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d6400640 1 -- 172.21.15.81:0/2908257009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561285d04960 con 0x561286ba7800 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d6400640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7800 0x561286aa1b80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x561286ae1ef0 tx=0x561286baed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29cf600640 1 -- 172.21.15.81:0/2908257009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561285cf2340 con 0x561286ba7800 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29cf600640 1 -- 172.21.15.81:0/2908257009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561285cf8380 con 0x561286ba7800 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561285d05680 con 0x561286ba7800 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29cf600640 1 -- 172.21.15.81:0/2908257009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561285cf2ea0 con 0x561286ba7800 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561285d05860 con 0x561286ba7800 2024-09-10T20:41:34.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.756+0000 7f29d8dfe280 4 main: JournalTool: resolving pool 7 2024-09-10T20:41:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.758+0000 7f29cf600640 1 -- 172.21.15.81:0/2908257009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x561285d27500 con 0x561286ba7800 2024-09-10T20:41:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.758+0000 7f29cf600640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x561286c13400 0x561286aa2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.759+0000 7f29cf600640 1 -- 172.21.15.81:0/2908257009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x561286c03000 con 0x561286ba7800 2024-09-10T20:41:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.759+0000 7f29d8dfe280 4 main: JournalTool: creating IoCtx.. 2024-09-10T20:41:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.759+0000 7f29d8dfe280 4 main: Executing for rank 0 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.759+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x561286c13400 0x561286aa2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 -- start start 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 Processor -- start 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x561286c13400 0x561286aa2100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x561286ae11d0 tx=0x561286baef00 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286c13c00 0x561286aa2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612860c8000 0x561286aa2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5612860c8400 0x561286aa3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x561286ac5380 con 0x5612860c8000 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561286ac5500 con 0x5612860c8400 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.760+0000 7f29d8dfe280 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561286ac5980 con 0x561286c13c00 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612860c8000 0x561286aa2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612860c8000 0x561286aa2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41650/0 (socket says 172.21.15.81:41650) 2024-09-10T20:41:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 -- 172.21.15.81:0/2195096360 learned_addr learned my addr 172.21.15.81:0/2195096360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6400640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5612860c8400 0x561286aa3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286c13c00 0x561286aa2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286c13c00 msgr2=0x561286aa2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286c13c00 0x561286aa2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5612860c8400 msgr2=0x561286aa3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5612860c8400 0x561286aa3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561285d05a40 con 0x5612860c8000 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286c13c00 0x561286aa2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.761+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612860c8000 0x561286aa2c00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x5612860d0000 tx=0x561286baefc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154c7baf4b66e6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29cba00640 1 -- 172.21.15.81:0/2195096360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561285cf3040 con 0x5612860c8000 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29cba00640 1 -- 172.21.15.81:0/2195096360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561285cf8fc0 con 0x5612860c8000 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29cba00640 1 -- 172.21.15.81:0/2195096360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561286c416c0 con 0x5612860c8000 2024-09-10T20:41:34.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561285d043c0 con 0x5612860c8000 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=0}) -- 0x561285d05a40 con 0x5612860c8000 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29d8dfe280 4 waiting for MDS map... 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29cba00640 1 -- 172.21.15.81:0/2195096360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x5612860d6000 con 0x5612860c8000 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29cba00640 1 -- 172.21.15.81:0/2195096360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) ==== 4143+0+0 (secure 0 0 0) 0x561285d27880 con 0x5612860c8000 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29d8dfe280 4 Got MDS map 25 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5612860c8800 0x561286aa3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.762+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x5612860c8c00 con 0x5612860c8800 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.763+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5612860c8800 0x561286aa3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.763+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5612860c8800 0x561286aa3700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=51f52607a3542f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.765+0000 7f29d7800640 1 -- 172.21.15.81:0/2195096360 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v50'1 uv1 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561285dd2000 con 0x5612860c8800 2024-09-10T20:41:34.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.765+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5612860c9000 0x5612860f6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.765+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x5612860c9400 con 0x5612860c9000 2024-09-10T20:41:34.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.766+0000 7f29d6400640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5612860c9000 0x5612860f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.766+0000 7f29d6400640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5612860c9000 0x5612860f6000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=f5762e40edd86fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d6400640 1 -- 172.21.15.81:0/2195096360 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v50'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561285dd2500 con 0x5612860c9000 2024-09-10T20:41:34.772 INFO:teuthology.orchestra.run.smithi081.stdout:writing EResetJournal entry 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x561286102000 con 0x5612860c9000 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x561286102400 0x5612860f6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x561286102800 con 0x561286102400 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x561286102c00 0x5612860f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- osd_op(unknown.0.0:5 7.b 7:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x561286103000 con 0x561286102c00 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x561286103400 0x5612860f7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- osd_op(unknown.0.0:6 7.1f 7:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x561286103800 con 0x561286103400 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x561286103c00 0x5612860f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- osd_op(unknown.0.0:7 7.1a 7:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x56128610c000 con 0x561286103c00 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- osd_op(unknown.0.0:8 7.1e 7:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x56128610c400 con 0x5612860c8800 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d6400640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x561286103400 0x5612860f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x561286102c00 0x5612860f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.768+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x561286102400 0x5612860f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.769+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x561286103c00 0x5612860f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.769+0000 7f29d6400640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x561286103400 0x5612860f7080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=7622f4e2896c7265 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.769+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x561286103c00 0x5612860f7600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=ad1397b88e50038e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.769+0000 7f29d6e00640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x561286102c00 0x5612860f6b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=2bd7050eb3be91f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.769+0000 7f29d7800640 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x561286102400 0x5612860f6580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=4a14d24f11a48a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.771+0000 7f29d7800640 1 -- 172.21.15.81:0/2195096360 <== osd.3 v2:172.21.15.81:6808/906295494 1 ==== osd_op_reply(7 200.00000005 [delete] v50'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561285dd2000 con 0x561286103c00 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.771+0000 7f29d6400640 1 -- 172.21.15.81:0/2195096360 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== osd_op_reply(6 200.00000004 [delete] v50'5 uv4 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561285dd2500 con 0x561286103400 2024-09-10T20:41:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.771+0000 7f29d6400640 1 -- 172.21.15.81:0/2195096360 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== osd_op_reply(3 200.00000001 [delete] v50'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561285dd2500 con 0x5612860c9000 2024-09-10T20:41:34.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.774+0000 7f29d6e00640 1 -- 172.21.15.81:0/2195096360 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== osd_op_reply(5 200.00000003 [delete] v50'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561285dd2780 con 0x561286102c00 2024-09-10T20:41:34.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.774+0000 7f29d7800640 1 -- 172.21.15.81:0/2195096360 <== osd.4 v2:172.21.15.143:6826/4019230190 1 ==== osd_op_reply(4 200.00000002 [delete] v50'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561285dd2000 con 0x561286102400 2024-09-10T20:41:34.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.774+0000 7f29d7800640 1 -- 172.21.15.81:0/2195096360 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== osd_op_reply(8 200.00000006 [delete] v50'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x561285dd2000 con 0x5612860c8800 2024-09-10T20:41:34.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.774+0000 7f29c9c00640 1 -- 172.21.15.81:0/2195096360 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- osd_op(unknown.0.0:9 7.14 7:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50) -- 0x561286120000 con 0x5612860c9000 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.776+0000 7f29d6400640 1 -- 172.21.15.81:0/2195096360 <== osd.5 v2:172.21.15.143:6802/1659339177 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v50'4 uv4 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x561285dd2500 con 0x5612860c9000 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 4 Successfully wrote new journal pointer and header for rank 3:0 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x561286103400 msgr2=0x5612860f7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x561286103400 0x5612860f7080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x561286103c00 msgr2=0x5612860f7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x561286103c00 0x5612860f7600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x561286102400 msgr2=0x5612860f6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x561286102400 0x5612860f6580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5612860c9000 msgr2=0x5612860f6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x5612860c9000 0x5612860f6000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x561286102c00 msgr2=0x5612860f6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x561286102c00 0x5612860f6b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5612860c8800 msgr2=0x561286aa3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x5612860c8800 0x561286aa3700 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d6400640 1 -- 172.21.15.81:0/2195096360 reap_dead start 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612860c8000 msgr2=0x561286aa2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d6400640 1 -- 172.21.15.81:0/2195096360 reap_dead start 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2195096360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5612860c8000 0x561286aa2c00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x5612860d0000 tx=0x561286baefc0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d6400640 1 -- 172.21.15.81:0/2195096360 reap_dead start 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 shutdown_connections 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 >> 172.21.15.81:0/2195096360 conn(0x561286c13800 msgr2=0x561286a71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 shutdown_connections 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2195096360 wait complete. 2024-09-10T20:41:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x561286c13400 msgr2=0x561286aa2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x561286c13400 0x561286aa2100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x561286ae11d0 tx=0x561286baef00 comp rx=0 tx=0).stop 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7800 msgr2=0x561286aa1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7800 0x561286aa1b80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x561286ae1ef0 tx=0x561286baed80 comp rx=0 tx=0).stop 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 shutdown_connections 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x561286c13400 0x561286aa2100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561286ba7800 0x561286aa1b80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561286ba7400 0x561286aa1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.777+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2908257009 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561286ba7000 0x561286aa1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 >> 172.21.15.81:0/2908257009 conn(0x561286ba6c00 msgr2=0x561286a71000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 shutdown_connections 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2908257009 wait complete. 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2789511678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561285ccdc00 msgr2=0x561286aa0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561285ccdc00 0x561286aa0b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x561286afb350 tx=0x561285d831a0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2789511678 shutdown_connections 2024-09-10T20:41:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561285ccdc00 0x561286aa0b00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561285ccd800 0x561286aa0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 --2- 172.21.15.81:0/2789511678 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561285cccc00 0x561286aa0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2789511678 >> 172.21.15.81:0/2789511678 conn(0x561285ccd000 msgr2=0x561286a70800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2789511678 shutdown_connections 2024-09-10T20:41:34.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.778+0000 7f29d8dfe280 1 -- 172.21.15.81:0/2789511678 wait complete. 2024-09-10T20:41:34.787 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'journal', 'reset', '--force', '--yes-i-really-really-mean-it'] in time 0:00:00.110636, result: writing EResetJournal entry 2024-09-10T20:41:34.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs joinable true 2024-09-10T20:41:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 -- 172.21.15.81:0/760432076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a501453c0 msgr2=0x7f4a500cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 --2- 172.21.15.81:0/760432076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a501453c0 0x7f4a500cf2b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4a5015f5a0 tx=0x7f4a4002aac0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 -- 172.21.15.81:0/760432076 shutdown_connections 2024-09-10T20:41:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 --2- 172.21.15.81:0/760432076 >> v2:172.21.15.143:3300/0 conn(0x7f4a5015e400 0x7f4a5006ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 --2- 172.21.15.81:0/760432076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a501453c0 0x7f4a500cf2b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 -- 172.21.15.81:0/760432076 >> 172.21.15.81:0/760432076 conn(0x7f4a50069020 msgr2=0x7f4a5006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 -- 172.21.15.81:0/760432076 shutdown_connections 2024-09-10T20:41:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.944+0000 7f4a56600640 1 -- 172.21.15.81:0/760432076 wait complete. 2024-09-10T20:41:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.946+0000 7f4a56600640 1 Processor -- start 2024-09-10T20:41:34.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.946+0000 7f4a56600640 1 -- start start 2024-09-10T20:41:34.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a56600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5006e660 0x7f4a50073fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a56600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a501453c0 0x7f4a5013d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a56600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a5015e400 0x7f4a5015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a56600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5006f970 con 0x7f4a5006e660 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a56600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5006f7f0 con 0x7f4a5015e400 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a56600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5015fd80 con 0x7f4a501453c0 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5006e660 0x7f4a50073fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5006e660 0x7f4a50073fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48792/0 (socket says 172.21.15.81:48792) 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 -- 172.21.15.81:0/509736972 learned_addr learned my addr 172.21.15.81:0/509736972 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4fe00640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a5015e400 0x7f4a5015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 -- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a501453c0 msgr2=0x7f4a5013d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a501453c0 0x7f4a5013d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 -- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a5015e400 msgr2=0x7f4a5015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a5015e400 0x7f4a5015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4f400640 1 -- 172.21.15.81:0/509736972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a50073bd0 con 0x7f4a5006e660 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.947+0000 7f4a4fe00640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a5015e400 0x7f4a5015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.948+0000 7f4a4f400640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5006e660 0x7f4a50073fd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000f80 tx=0x7f4a40003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.948+0000 7f4a47400640 1 -- 172.21.15.81:0/509736972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40044070 con 0x7f4a5006e660 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.948+0000 7f4a47400640 1 -- 172.21.15.81:0/509736972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a40004250 con 0x7f4a5006e660 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.948+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a50072480 con 0x7f4a5006e660 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.948+0000 7f4a47400640 1 -- 172.21.15.81:0/509736972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40004680 con 0x7f4a5006e660 2024-09-10T20:41:34.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.948+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a50072a40 con 0x7f4a5006e660 2024-09-10T20:41:34.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.949+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a50075430 con 0x7f4a5006e660 2024-09-10T20:41:34.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.950+0000 7f4a47400640 1 -- 172.21.15.81:0/509736972 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4a40036400 con 0x7f4a5006e660 2024-09-10T20:41:34.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.951+0000 7f4a47400640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4a2c077fa0 0x7f4a2c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:34.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.951+0000 7f4a47400640 1 -- 172.21.15.81:0/509736972 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f4a400ba8b0 con 0x7f4a5006e660 2024-09-10T20:41:34.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.951+0000 7f4a4ea00640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4a2c077fa0 0x7f4a2c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:34.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.952+0000 7f4a4ea00640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4a2c077fa0 0x7f4a2c07a460 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a500ca000 tx=0x7f4a380078d0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:34.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:34.956+0000 7f4a47400640 1 -- 172.21.15.81:0/509736972 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4a50075430 con 0x7f4a5006e660 2024-09-10T20:41:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:35.178+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"} v 0) -- 0x7f4a50160230 con 0x7f4a5006e660 2024-09-10T20:41:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.055+0000 7f4a47400640 1 -- 172.21.15.81:0/509736972 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"}]=0 recovery_fs marked joinable; MDS may join as newly active. v26) ==== 172+0+0 (secure 0 0 0) 0x7f4a40032030 con 0x7f4a5006e660 2024-09-10T20:41:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:recovery_fs marked joinable; MDS may join as newly active. 2024-09-10T20:41:36.062 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T20:41:36.059+0000 7f54a7c00640 -1 log_channel(cluster) log [ERR] : Health check update: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T20:41:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4a2c077fa0 msgr2=0x7f4a2c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4a2c077fa0 0x7f4a2c07a460 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a500ca000 tx=0x7f4a380078d0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5006e660 msgr2=0x7f4a50073fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5006e660 0x7f4a50073fd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a40000f80 tx=0x7f4a40003f10 comp rx=0 tx=0).stop 2024-09-10T20:41:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 shutdown_connections 2024-09-10T20:41:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4a2c077fa0 0x7f4a2c07a460 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4a5015e400 0x7f4a5015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4a501453c0 0x7f4a5013d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 --2- 172.21.15.81:0/509736972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a5006e660 0x7f4a50073fd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 >> 172.21.15.81:0/509736972 conn(0x7f4a50069020 msgr2=0x7f4a500b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 shutdown_connections 2024-09-10T20:41:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.060+0000 7f4a56600640 1 -- 172.21.15.81:0/509736972 wait complete. 2024-09-10T20:41:36.072 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-10T20:41:36.066+0000 7f896a800640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-09-10T20:41:36.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.243+0000 7ff3f3000640 1 -- 172.21.15.81:0/3806665533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d00051c0 msgr2=0x7ff3d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.243+0000 7ff3f3000640 1 --2- 172.21.15.81:0/3806665533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d00051c0 0x7ff3d000b9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4001dc0 tx=0x7ff3d0005830 comp rx=0 tx=0).stop 2024-09-10T20:41:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.243+0000 7ff3f3000640 1 -- 172.21.15.81:0/3806665533 shutdown_connections 2024-09-10T20:41:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.243+0000 7ff3f3000640 1 --2- 172.21.15.81:0/3806665533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3d00051c0 0x7ff3d000b9c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.243+0000 7ff3f3000640 1 -- 172.21.15.81:0/3806665533 >> 172.21.15.81:0/3806665533 conn(0x7ff3ec068f90 msgr2=0x7ff3ec06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.243+0000 7ff3f3000640 1 -- 172.21.15.81:0/3806665533 shutdown_connections 2024-09-10T20:41:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.243+0000 7ff3f3000640 1 -- 172.21.15.81:0/3806665533 wait complete. 2024-09-10T20:41:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.245+0000 7ff3f3000640 1 Processor -- start 2024-09-10T20:41:36.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.245+0000 7ff3f3000640 1 -- start start 2024-09-10T20:41:36.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3f3000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3d00051c0 0x7ff3ec13cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:36.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3f3000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec15b660 0x7ff3ec0a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:36.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3f3000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3ec1428e0 0x7ff3ec142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3f3000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec0cf170 con 0x7ff3ec15b660 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3f3000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec0ceff0 con 0x7ff3ec1428e0 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3f3000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff3ec0cd5a0 con 0x7ff3d00051c0 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec15b660 0x7ff3ec0a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3eb400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec15b660 0x7ff3ec0a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48806/0 (socket says 172.21.15.81:48806) 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3eb400640 1 -- 172.21.15.81:0/1039229667 learned_addr learned my addr 172.21.15.81:0/1039229667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3f1000640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3ec1428e0 0x7ff3ec142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3ebe00640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3d00051c0 0x7ff3ec13cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3eb400640 1 -- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3d00051c0 msgr2=0x7ff3ec13cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3eb400640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3d00051c0 0x7ff3ec13cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3eb400640 1 -- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3ec1428e0 msgr2=0x7ff3ec142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.246+0000 7ff3eb400640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3ec1428e0 0x7ff3ec142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3eb400640 1 -- 172.21.15.81:0/1039229667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ec0a9f50 con 0x7ff3ec15b660 2024-09-10T20:41:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3ebe00640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3d00051c0 0x7ff3ec13cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:36.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3eb400640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec15b660 0x7ff3ec0a9620 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8006680 tx=0x7ff3d80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:36.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3e3e00640 1 -- 172.21.15.81:0/1039229667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8011700 con 0x7ff3ec15b660 2024-09-10T20:41:36.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3e3e00640 1 -- 172.21.15.81:0/1039229667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3d8016020 con 0x7ff3ec15b660 2024-09-10T20:41:36.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3e3e00640 1 -- 172.21.15.81:0/1039229667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8011b40 con 0x7ff3ec15b660 2024-09-10T20:41:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ec0aa230 con 0x7ff3ec15b660 2024-09-10T20:41:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.247+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ec0aac90 con 0x7ff3ec15b660 2024-09-10T20:41:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.248+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3ec0743c0 con 0x7ff3ec15b660 2024-09-10T20:41:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.249+0000 7ff3e3e00640 1 -- 172.21.15.81:0/1039229667 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff3d8011ce0 con 0x7ff3ec15b660 2024-09-10T20:41:36.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.251+0000 7ff3e3e00640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3cc077f70 0x7ff3cc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.251+0000 7ff3e3e00640 1 -- 172.21.15.81:0/1039229667 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7ff3d809acc0 con 0x7ff3ec15b660 2024-09-10T20:41:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.251+0000 7ff3ebe00640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3cc077f70 0x7ff3cc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:36.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.252+0000 7ff3ebe00640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3cc077f70 0x7ff3cc07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec154bf0 tx=0x7ff3dc005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.255+0000 7ff3e3e00640 1 -- 172.21.15.81:0/1039229667 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff3ec0743c0 con 0x7ff3ec15b660 2024-09-10T20:41:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.473+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3ec06eab0 con 0x7ff3ec15b660 2024-09-10T20:41:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.474+0000 7ff3e3e00640 1 -- 172.21.15.81:0/1039229667 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+6527 (secure 0 0 0) 0x7ff3d80a1080 con 0x7ff3ec15b660 2024-09-10T20:41:36.478 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:36.478 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-10T20:41:36:059812+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:36.059789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-10T20:41:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-10T20:41:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3cc077f70 msgr2=0x7ff3cc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3cc077f70 0x7ff3cc07a430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec154bf0 tx=0x7ff3dc005f90 comp rx=0 tx=0).stop 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec15b660 msgr2=0x7ff3ec0a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec15b660 0x7ff3ec0a9620 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8006680 tx=0x7ff3d80039c0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 shutdown_connections 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff3cc077f70 0x7ff3cc07a430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3ec1428e0 0x7ff3ec142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec15b660 0x7ff3ec0a9620 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 --2- 172.21.15.81:0/1039229667 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3d00051c0 0x7ff3ec13cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 >> 172.21.15.81:0/1039229667 conn(0x7ff3ec068f90 msgr2=0x7ff3ec0af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 shutdown_connections 2024-09-10T20:41:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:36.476+0000 7ff3f3000640 1 -- 172.21.15.81:0/1039229667 wait complete. 2024-09-10T20:41:36.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:41:23.771863+0000', 'modified': '2024-09-10T20:41:36.059789+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5184': {'gid': 5184, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.81:6835/2525007844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 2525007844}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2525007844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T20:41:36.899 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5184:up:replay 2024-09-10T20:41:37.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.064+0000 7fa346c00640 1 -- 172.21.15.81:0/4125083065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa34006f600 msgr2=0x7fa3400724f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.064+0000 7fa346c00640 1 --2- 172.21.15.81:0/4125083065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa34006f600 0x7fa3400724f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa338005fd0 tx=0x7fa33802aaa0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.064+0000 7fa346c00640 1 -- 172.21.15.81:0/4125083065 shutdown_connections 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.064+0000 7fa346c00640 1 --2- 172.21.15.81:0/4125083065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa34006f600 0x7fa3400724f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.064+0000 7fa346c00640 1 --2- 172.21.15.81:0/4125083065 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa3401510e0 0x7fa34015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.064+0000 7fa346c00640 1 -- 172.21.15.81:0/4125083065 >> 172.21.15.81:0/4125083065 conn(0x7fa340068f90 msgr2=0x7fa34006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.064+0000 7fa346c00640 1 -- 172.21.15.81:0/4125083065 shutdown_connections 2024-09-10T20:41:38.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.065+0000 7fa346c00640 1 -- 172.21.15.81:0/4125083065 wait complete. 2024-09-10T20:41:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.066+0000 7fa346c00640 1 Processor -- start 2024-09-10T20:41:38.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.066+0000 7fa346c00640 1 -- start start 2024-09-10T20:41:38.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa346c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa34006f600 0x7fa3401f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:38.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa346c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3400cd650 0x7fa340159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:38.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa346c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3401510e0 0x7fa3401596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:38.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa346c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa34006eb90 con 0x7fa3401510e0 2024-09-10T20:41:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa346c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa34006ea10 con 0x7fa3400cd650 2024-09-10T20:41:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa346c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa34006ed10 con 0x7fa34006f600 2024-09-10T20:41:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa344c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3401510e0 0x7fa3401596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa344c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3401510e0 0x7fa3401596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48810/0 (socket says 172.21.15.81:48810) 2024-09-10T20:41:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.067+0000 7fa344c00640 1 -- 172.21.15.81:0/3531032450 learned_addr learned my addr 172.21.15.81:0/3531032450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa33fe00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa34006f600 0x7fa3401f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:38.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa33f400640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3400cd650 0x7fa340159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa344c00640 1 -- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa34006f600 msgr2=0x7fa3401f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa344c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa34006f600 0x7fa3401f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa344c00640 1 -- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3400cd650 msgr2=0x7fa340159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa344c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3400cd650 0x7fa340159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa344c00640 1 -- 172.21.15.81:0/3531032450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3401f8b90 con 0x7fa3401510e0 2024-09-10T20:41:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.068+0000 7fa344c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3401510e0 0x7fa3401596a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa338009d90 tx=0x7fa338003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.070+0000 7fa337e00640 1 -- 172.21.15.81:0/3531032450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338046070 con 0x7fa3401510e0 2024-09-10T20:41:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.070+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34015f860 con 0x7fa3401510e0 2024-09-10T20:41:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.070+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa34015fb00 con 0x7fa3401510e0 2024-09-10T20:41:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.071+0000 7fa337e00640 1 -- 172.21.15.81:0/3531032450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3380098c0 con 0x7fa3401510e0 2024-09-10T20:41:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.071+0000 7fa337e00640 1 -- 172.21.15.81:0/3531032450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338004450 con 0x7fa3401510e0 2024-09-10T20:41:38.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.072+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa318005290 con 0x7fa3401510e0 2024-09-10T20:41:38.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.072+0000 7fa337e00640 1 -- 172.21.15.81:0/3531032450 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa3380045f0 con 0x7fa3401510e0 2024-09-10T20:41:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.073+0000 7fa337e00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa320077f70 0x7fa32007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.073+0000 7fa337e00640 1 -- 172.21.15.81:0/3531032450 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7fa3380bb430 con 0x7fa3401510e0 2024-09-10T20:41:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.074+0000 7fa33fe00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa320077f70 0x7fa32007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.075+0000 7fa33fe00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa320077f70 0x7fa32007a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa330005fd0 tx=0x7fa33000a250 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:38.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.077+0000 7fa337e00640 1 -- 172.21.15.81:0/3531032450 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa338032030 con 0x7fa3401510e0 2024-09-10T20:41:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.296+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa318005580 con 0x7fa3401510e0 2024-09-10T20:41:38.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.297+0000 7fa337e00640 1 -- 172.21.15.81:0/3531032450 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+6527 (secure 0 0 0) 0x7fa33808c030 con 0x7fa3401510e0 2024-09-10T20:41:38.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:38.301 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-10T20:41:38:064053+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:37.065381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-10T20:41:38.301 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-10T20:41:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa320077f70 msgr2=0x7fa32007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa320077f70 0x7fa32007a430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa330005fd0 tx=0x7fa33000a250 comp rx=0 tx=0).stop 2024-09-10T20:41:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3401510e0 msgr2=0x7fa3401596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:38.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3401510e0 0x7fa3401596a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa338009d90 tx=0x7fa338003f10 comp rx=0 tx=0).stop 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 shutdown_connections 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa320077f70 0x7fa32007a430 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3401510e0 0x7fa3401596a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3400cd650 0x7fa340159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 --2- 172.21.15.81:0/3531032450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa34006f600 0x7fa3401f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 >> 172.21.15.81:0/3531032450 conn(0x7fa340068f90 msgr2=0x7fa34015b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 shutdown_connections 2024-09-10T20:41:38.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:38.299+0000 7fa346c00640 1 -- 172.21.15.81:0/3531032450 wait complete. 2024-09-10T20:41:38.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:41:23.771863+0000', 'modified': '2024-09-10T20:41:37.065381+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5184': {'gid': 5184, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:rejoin', 'state_seq': 8, 'addr': '172.21.15.81:6835/2525007844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 2525007844}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2525007844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-10T20:41:38.721 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5184:up:rejoin 2024-09-10T20:41:39.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 -- 172.21.15.81:0/3809861245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815ee50 msgr2=0x7fb27815c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 --2- 172.21.15.81:0/3809861245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815ee50 0x7fb27815c900 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb2780cdcc0 tx=0x7fb26802a510 comp rx=0 tx=0).stop 2024-09-10T20:41:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 -- 172.21.15.81:0/3809861245 shutdown_connections 2024-09-10T20:41:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 --2- 172.21.15.81:0/3809861245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb27806e660 0x7fb27806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 --2- 172.21.15.81:0/3809861245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815ee50 0x7fb27815c900 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 -- 172.21.15.81:0/3809861245 >> 172.21.15.81:0/3809861245 conn(0x7fb278068f90 msgr2=0x7fb27806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 -- 172.21.15.81:0/3809861245 shutdown_connections 2024-09-10T20:41:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.887+0000 7fb27d400640 1 -- 172.21.15.81:0/3809861245 wait complete. 2024-09-10T20:41:39.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.889+0000 7fb27d400640 1 Processor -- start 2024-09-10T20:41:39.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.889+0000 7fb27d400640 1 -- start start 2024-09-10T20:41:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb27d400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb27806e660 0x7fb278142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb27d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb27815ee50 0x7fb2780cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb27d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815f630 0x7fb2780cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb27d400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780cccf0 con 0x7fb27815f630 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb27d400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780ccb70 con 0x7fb27806e660 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb27d400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb2781601d0 con 0x7fb27815ee50 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb277200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815f630 0x7fb2780cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb277200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815f630 0x7fb2780cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48818/0 (socket says 172.21.15.81:48818) 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb277200640 1 -- 172.21.15.81:0/3273139042 learned_addr learned my addr 172.21.15.81:0/3273139042 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb276800640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb27806e660 0x7fb278142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.890+0000 7fb26de00640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb27815ee50 0x7fb2780cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb277200640 1 -- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb27815ee50 msgr2=0x7fb2780cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb277200640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb27815ee50 0x7fb2780cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb277200640 1 -- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb27806e660 msgr2=0x7fb278142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb277200640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb27806e660 0x7fb278142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:39.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb277200640 1 -- 172.21.15.81:0/3273139042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2781f45f0 con 0x7fb27815f630 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb26de00640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb27815ee50 0x7fb2780cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb276800640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb27806e660 0x7fb278142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb277200640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815f630 0x7fb2780cbd20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb27000cae0 tx=0x7fb27000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb26f400640 1 -- 172.21.15.81:0/3273139042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270016020 con 0x7fb27815f630 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb26f400640 1 -- 172.21.15.81:0/3273139042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb27000acd0 con 0x7fb27815f630 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb26f400640 1 -- 172.21.15.81:0/3273139042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270012680 con 0x7fb27815f630 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2781f48d0 con 0x7fb27815f630 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.891+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2781f4e90 con 0x7fb27815f630 2024-09-10T20:41:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.892+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27806eaa0 con 0x7fb27815f630 2024-09-10T20:41:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.894+0000 7fb26f400640 1 -- 172.21.15.81:0/3273139042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb27001b400 con 0x7fb27815f630 2024-09-10T20:41:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.895+0000 7fb26f400640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb254077f70 0x7fb25407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.895+0000 7fb26f400640 1 -- 172.21.15.81:0/3273139042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7fb27009aab0 con 0x7fb27815f630 2024-09-10T20:41:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.895+0000 7fb276800640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb254077f70 0x7fb25407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.896+0000 7fb276800640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb254077f70 0x7fb25407a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb268034000 tx=0x7fb268004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:39.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:39.899+0000 7fb26f400640 1 -- 172.21.15.81:0/3273139042 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb270020020 con 0x7fb27815f630 2024-09-10T20:41:40.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.122+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2780cc5b0 con 0x7fb27815f630 2024-09-10T20:41:40.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.123+0000 7fb26f400640 1 -- 172.21.15.81:0/3273139042 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6534 (secure 0 0 0) 0x7fb270063160 con 0x7fb27815f630 2024-09-10T20:41:40.127 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:40.127 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-10T20:41:39:070176+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:40.127 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-10T20:41:40.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb254077f70 msgr2=0x7fb25407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb254077f70 0x7fb25407a430 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb268034000 tx=0x7fb268004730 comp rx=0 tx=0).stop 2024-09-10T20:41:40.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815f630 msgr2=0x7fb2780cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815f630 0x7fb2780cbd20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb27000cae0 tx=0x7fb27000a060 comp rx=0 tx=0).stop 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 shutdown_connections 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb254077f70 0x7fb25407a430 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb27815f630 0x7fb2780cbd20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb27815ee50 0x7fb2780cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 --2- 172.21.15.81:0/3273139042 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb27806e660 0x7fb278142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 >> 172.21.15.81:0/3273139042 conn(0x7fb278068f90 msgr2=0x7fb2780b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 shutdown_connections 2024-09-10T20:41:40.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.125+0000 7fb27d400640 1 -- 172.21.15.81:0/3273139042 wait complete. 2024-09-10T20:41:40.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T20:41:23.771863+0000', 'modified': '2024-09-10T20:41:39.070169+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5184}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5184': {'gid': 5184, 'name': 'c', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.81:6835/2525007844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 2525007844}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2525007844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5184, 'qdb_cluster': [5184]} 2024-09-10T20:41:40.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T20:41:40.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 -- 172.21.15.81:0/1350333656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c144320 msgr2=0x7ff84c0b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 --2- 172.21.15.81:0/1350333656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c144320 0x7ff84c0b3a90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff84c06d240 tx=0x7ff83c02a5f0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 -- 172.21.15.81:0/1350333656 shutdown_connections 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 --2- 172.21.15.81:0/1350333656 >> v2:172.21.15.143:3300/0 conn(0x7ff84c15eda0 0x7ff84c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 --2- 172.21.15.81:0/1350333656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c144320 0x7ff84c0b3a90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 -- 172.21.15.81:0/1350333656 >> 172.21.15.81:0/1350333656 conn(0x7ff84c068f90 msgr2=0x7ff84c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 -- 172.21.15.81:0/1350333656 shutdown_connections 2024-09-10T20:41:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.704+0000 7ff852000640 1 -- 172.21.15.81:0/1350333656 wait complete. 2024-09-10T20:41:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.705+0000 7ff852000640 1 Processor -- start 2024-09-10T20:41:40.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.706+0000 7ff852000640 1 -- start start 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.706+0000 7ff852000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff84c0ceaa0 0x7ff84c14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.706+0000 7ff852000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff84c144320 0x7ff84c0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.706+0000 7ff852000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c15eda0 0x7ff84c1f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.706+0000 7ff852000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c072600 con 0x7ff84c15eda0 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.706+0000 7ff852000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c072480 con 0x7ff84c144320 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.706+0000 7ff852000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c072780 con 0x7ff84c0ceaa0 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c15eda0 0x7ff84c1f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c15eda0 0x7ff84c1f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48834/0 (socket says 172.21.15.81:48834) 2024-09-10T20:41:40.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 -- 172.21.15.81:0/3653871535 learned_addr learned my addr 172.21.15.81:0/3653871535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84b400640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff84c0ceaa0 0x7ff84c14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84aa00640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff84c144320 0x7ff84c0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 -- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff84c0ceaa0 msgr2=0x7ff84c14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff84c0ceaa0 0x7ff84c14adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 -- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff84c144320 msgr2=0x7ff84c0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff84c144320 0x7ff84c0c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.707+0000 7ff84be00640 1 -- 172.21.15.81:0/3653871535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c13df10 con 0x7ff84c15eda0 2024-09-10T20:41:40.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.708+0000 7ff84be00640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c15eda0 0x7ff84c1f2bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff84400ea80 tx=0x7ff84400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.708+0000 7ff843400640 1 -- 172.21.15.81:0/3653871535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844004b20 con 0x7ff84c15eda0 2024-09-10T20:41:40.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.708+0000 7ff843400640 1 -- 172.21.15.81:0/3653871535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff844004ce0 con 0x7ff84c15eda0 2024-09-10T20:41:40.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.708+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c13e180 con 0x7ff84c15eda0 2024-09-10T20:41:40.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.708+0000 7ff843400640 1 -- 172.21.15.81:0/3653871535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844005280 con 0x7ff84c15eda0 2024-09-10T20:41:40.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.708+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c13e740 con 0x7ff84c15eda0 2024-09-10T20:41:40.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.710+0000 7ff843400640 1 -- 172.21.15.81:0/3653871535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff844005420 con 0x7ff84c15eda0 2024-09-10T20:41:40.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.711+0000 7ff843400640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff82c077f70 0x7ff82c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.711+0000 7ff843400640 1 -- 172.21.15.81:0/3653871535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7ff84409acb0 con 0x7ff84c15eda0 2024-09-10T20:41:40.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.711+0000 7ff854e02740 1 Processor -- start 2024-09-10T20:41:40.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.712+0000 7ff84b400640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff82c077f70 0x7ff82c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.712+0000 7ff854e02740 1 -- start start 2024-09-10T20:41:40.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.712+0000 7ff84b400640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff82c077f70 0x7ff82c07a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff83c033000 tx=0x7ff83c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b538b0 0x5607f5b53c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff854e02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0ea20 0x5607f5b52390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b528d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff854e02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5607f5a91430 con 0x5607f5b0ea20 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5607f5a815d0 con 0x5607f5b0efa0 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5607f5a70a00 con 0x5607f5b538b0 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0ea20 0x5607f5b52390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0ea20 0x5607f5b52390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48840/0 (socket says 172.21.15.81:48840) 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 -- 172.21.15.81:0/1622013773 learned_addr learned my addr 172.21.15.81:0/1622013773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84b400640 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b538b0 0x5607f5b53c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84be00640 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 -- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b538b0 msgr2=0x5607f5b53c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b538b0 0x5607f5b53c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 -- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 msgr2=0x5607f5b528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.713+0000 7ff84aa00640 1 -- 172.21.15.81:0/1622013773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5a39520 con 0x5607f5b0ea20 2024-09-10T20:41:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.714+0000 7ff84aa00640 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0ea20 0x5607f5b52390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff8380018b0 tx=0x7ff838007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823ec605457c1d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.714+0000 7ff837400640 1 -- 172.21.15.81:0/1622013773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380052e0 con 0x5607f5b0ea20 2024-09-10T20:41:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.714+0000 7ff837400640 1 -- 172.21.15.81:0/1622013773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff838018070 con 0x5607f5b0ea20 2024-09-10T20:41:40.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.714+0000 7ff837400640 1 -- 172.21.15.81:0/1622013773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83800fad0 con 0x5607f5b0ea20 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.714+0000 7ff854e02740 1 -- 172.21.15.81:0/1622013773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0ea20 msgr2=0x5607f5b52390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.714+0000 7ff854e02740 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0ea20 0x5607f5b52390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff8380018b0 tx=0x7ff838007df0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 -- 172.21.15.81:0/1622013773 shutdown_connections 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0ea20 0x5607f5b52390 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 --2- 172.21.15.81:0/1622013773 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b538b0 0x5607f5b53c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 -- 172.21.15.81:0/1622013773 >> 172.21.15.81:0/1622013773 conn(0x5607f5b09ff0 msgr2=0x5607f5b0da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 -- 172.21.15.81:0/1622013773 shutdown_connections 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 -- 172.21.15.81:0/1622013773 wait complete. 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.715+0000 7ff854e02740 1 -- start start 2024-09-10T20:41:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.716+0000 7ff854e02740 1 Processor -- start 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.716+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b0efa0 0x5607f5b60e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.716+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff854e02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b33ac0 0x5607f5b52010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff854e02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5607f5a17330 con 0x5607f5b33ac0 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5607f5a74810 con 0x5607f5b538b0 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5607f57e1620 con 0x5607f5b0efa0 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff854e02740 10 client.0 _ll_register_callbacks cb 0x5607f5a1c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b33ac0 0x5607f5b52010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b33ac0 0x5607f5b52010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48844/0 (socket says 172.21.15.81:48844) 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 -- 172.21.15.81:0/468938824 learned_addr learned my addr 172.21.15.81:0/468938824 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84aa00640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84b400640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b0efa0 0x5607f5b60e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 -- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b0efa0 msgr2=0x5607f5b60e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b0efa0 0x5607f5b60e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 -- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 msgr2=0x5607f5b613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 -- 172.21.15.81:0/468938824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f57d2850 con 0x5607f5b33ac0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84aa00640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff84be00640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b33ac0 0x5607f5b52010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff8440049d0 tx=0x7ff844063330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2df98af7fc8f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.717+0000 7ff82be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff82be00640 1 -- 172.21.15.81:0/468938824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84407c020 con 0x5607f5b33ac0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff82be00640 1 -- 172.21.15.81:0/468938824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7ff844061f70 con 0x5607f5b33ac0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838018070 con 0x5607f5b33ac0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff82be00640 1 -- 172.21.15.81:0/468938824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff844098050 con 0x5607f5b33ac0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 10 client.5475 fetch_fsmap learned FSMap version 30 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5607f58496b0 con 0x5607f5b33ac0 2024-09-10T20:41:40.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff82be00640 1 -- 172.21.15.81:0/468938824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff838018070 con 0x5607f5b33ac0 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff82be00640 1 -- 172.21.15.81:0/468938824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 4147+0+0 (secure 0 0 0) 0x7ff84407db90 con 0x5607f5b33ac0 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 10 client.5475 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 10 client.5475 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 20 client.5475 populate_metadata read hostname 'smithi081' 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b52720 0x5607f5b37b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 4 client.5475 mds_command: new command op to 5184 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.718+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 --> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607f5a83520 con 0x5607f5b52720 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.719+0000 7ff84b400640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b52720 0x5607f5b37b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.719+0000 7ff84b400640 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b52720 0x5607f5b37b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b99a4ed9a0d1ec server_cookie=e19b1aeb959f80e in_seq=0 out_seq=0 2024-09-10T20:41:40.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.719+0000 7ff82be00640 10 client.5475 ms_handle_connect on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff82be00640 1 -- 172.21.15.81:0/468938824 <== mds.0 v2:172.21.15.81:6833/2525007844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607f5a83520 con 0x5607f5b52720 2024-09-10T20:41:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff82be00640 10 client.5475 handle_command_reply: tid=0 2024-09-10T20:41:40.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 client.5475 shutdown 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b33ac0 msgr2=0x5607f5b52010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b33ac0 0x5607f5b52010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff8440049d0 tx=0x7ff844063330 comp rx=0 tx=0).stop 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 shutdown_connections 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b52720 0x5607f5b37b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b33ac0 0x5607f5b52010 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 --2- 172.21.15.81:0/468938824 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b0efa0 0x5607f5b60e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 >> 172.21.15.81:0/468938824 conn(0x5607f5b0ea20 msgr2=0x5607f5b08bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.720+0000 7ff82be00640 0 client.5475 ms_handle_reset on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.721+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 shutdown_connections 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.721+0000 7ff854e02740 1 -- 172.21.15.81:0/468938824 wait complete. 2024-09-10T20:41:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.721+0000 7ff854e02740 20 client.5475 trim_cache size 0 max 16384 2024-09-10T20:41:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.739+0000 7ff854e02740 1 Processor -- start 2024-09-10T20:41:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.739+0000 7ff854e02740 1 -- start start 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b7aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5b60e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff854e02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff854e02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c1f64a0 con 0x5607f5b538b0 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c15ce20 con 0x5607f5b0efa0 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c1f5df0 con 0x5607f5b33ac0 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff84be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff84be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48850/0 (socket says 172.21.15.81:48850) 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.740+0000 7ff84be00640 1 -- 172.21.15.81:0/1427320826 learned_addr learned my addr 172.21.15.81:0/1427320826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84b400640 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b7aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84aa00640 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5b60e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84be00640 1 -- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 msgr2=0x5607f5b60e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84be00640 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5b60e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84be00640 1 -- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 msgr2=0x5607f5b7aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84be00640 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b7aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84be00640 1 -- 172.21.15.81:0/1427320826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607f5b0e210 con 0x5607f5b538b0 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84b400640 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b7aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff84be00640 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c760 tx=0x7ff844004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7eb5a1b1926a6a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff836a00640 1 -- 172.21.15.81:0/1427320826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84407c040 con 0x5607f5b538b0 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff836a00640 1 -- 172.21.15.81:0/1427320826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff844067740 con 0x5607f5b538b0 2024-09-10T20:41:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.741+0000 7ff836a00640 1 -- 172.21.15.81:0/1427320826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84406c160 con 0x5607f5b538b0 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 -- 172.21.15.81:0/1427320826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b538b0 msgr2=0x5607f5b613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c760 tx=0x7ff844004ed0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 -- 172.21.15.81:0/1427320826 shutdown_connections 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b538b0 0x5607f5b613d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5b60e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 --2- 172.21.15.81:0/1427320826 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b0efa0 0x5607f5b7aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 -- 172.21.15.81:0/1427320826 >> 172.21.15.81:0/1427320826 conn(0x5607f5b0ea20 msgr2=0x5607f5b33150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 -- 172.21.15.81:0/1427320826 shutdown_connections 2024-09-10T20:41:40.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.742+0000 7ff854e02740 1 -- 172.21.15.81:0/1427320826 wait complete. 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.743+0000 7ff854e02740 1 -- start start 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.743+0000 7ff854e02740 1 Processor -- start 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff854e02740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0efa0 0x5607f5bd82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5bce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff854e02740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff854e02740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5607f5b525a0 con 0x5607f5b0efa0 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5607f5b34120 con 0x5607f5b538b0 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff854e02740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5607f5b52bc0 con 0x5607f5b33ac0 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff854e02740 10 client.0 _ll_register_callbacks cb 0x7ff84405ebb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0efa0 0x5607f5bd82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0efa0 0x5607f5bd82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48852/0 (socket says 172.21.15.81:48852) 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 -- 172.21.15.81:0/2205329237 learned_addr learned my addr 172.21.15.81:0/2205329237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84aa00640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5bce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84be00640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 -- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 msgr2=0x5607f5bce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5bce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 -- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 msgr2=0x5607f5b607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84b400640 1 -- 172.21.15.81:0/2205329237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607f5b60350 con 0x5607f5b0efa0 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84be00640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.744+0000 7ff84aa00640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5bce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff84b400640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0efa0 0x5607f5bd82f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f755129c87214693 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff82be00640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff82be00640 1 -- 172.21.15.81:0/2205329237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c035040 con 0x5607f5b0efa0 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff82be00640 1 -- 172.21.15.81:0/2205329237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7ff83c04b440 con 0x5607f5b0efa0 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff844067740 con 0x5607f5b0efa0 2024-09-10T20:41:40.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff82be00640 1 -- 172.21.15.81:0/2205329237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff83c061050 con 0x5607f5b0efa0 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff854e02740 10 client.5481 fetch_fsmap learned FSMap version 30 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5607f5b07c80 con 0x5607f5b0efa0 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff82be00640 1 -- 172.21.15.81:0/2205329237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff844067740 con 0x5607f5b0efa0 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff82be00640 1 -- 172.21.15.81:0/2205329237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 4147+0+0 (secure 0 0 0) 0x7ff83c064020 con 0x5607f5b0efa0 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff854e02740 10 client.5481 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff854e02740 10 client.5481 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.745+0000 7ff854e02740 20 client.5481 populate_metadata read hostname 'smithi081' 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.746+0000 7ff854e02740 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b07630 0x5607f5b0bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.746+0000 7ff854e02740 4 client.5481 mds_command: new command op to 5184 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.746+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 --> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] -- command(tid 0: {"prefix": "status"}) -- 0x5607f5a7efd0 con 0x5607f5b07630 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.746+0000 7ff84aa00640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b07630 0x5607f5b0bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.746+0000 7ff82be00640 10 client.5481 ms_handle_connect on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:40.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.746+0000 7ff84aa00640 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b07630 0x5607f5b0bd10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e1ae73cd81d6bf1 server_cookie=65e9b25d8bd5184f in_seq=0 out_seq=0 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff82be00640 1 -- 172.21.15.81:0/2205329237 <== mds.0 v2:172.21.15.81:6833/2525007844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+336 (crc 0 0 0) 0x5607f5a7efd0 con 0x5607f5b07630 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff82be00640 10 client.5481 handle_command_reply: tid=0 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 client.5481 shutdown 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0efa0 msgr2=0x5607f5bd82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0efa0 0x5607f5bd82f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c009260 comp rx=0 tx=0).stop 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 shutdown_connections 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5607f5b538b0 0x5607f5b607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5607f5b33ac0 0x5607f5bce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x5607f5b07630 0x5607f5b0bd10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 --2- 172.21.15.81:0/2205329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5607f5b0efa0 0x5607f5bd82f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 >> 172.21.15.81:0/2205329237 conn(0x5607f5b0ea20 msgr2=0x5607f5b7a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff82be00640 0 client.5481 ms_handle_reset on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 shutdown_connections 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 1 -- 172.21.15.81:0/2205329237 wait complete. 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.747+0000 7ff854e02740 20 client.5481 trim_cache size 0 max 16384 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "0ea88071-0b16-46b5-b258-7e2fd8f41721", 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5184, 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-10T20:41:40.756 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-10T20:41:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "recovery_fs", 2024-09-10T20:41:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.6851943489999996, 2024-09-10T20:41:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 30, 2024-09-10T20:41:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 50, 2024-09-10T20:41:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 50, 2024-09-10T20:41:40.757 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 25.760517249999999 2024-09-10T20:41:40.757 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff82c077f70 msgr2=0x7ff82c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff82c077f70 0x7ff82c07a430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff83c033000 tx=0x7ff83c004730 comp rx=0 tx=0).stop 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c15eda0 msgr2=0x7ff84c1f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c15eda0 0x7ff84c1f2bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff84400ea80 tx=0x7ff84400ef40 comp rx=0 tx=0).stop 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 shutdown_connections 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff82c077f70 0x7ff82c07a430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84c15eda0 0x7ff84c1f2bf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff84c144320 0x7ff84c0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 --2- 172.21.15.81:0/3653871535 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff84c0ceaa0 0x7ff84c14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 >> 172.21.15.81:0/3653871535 conn(0x7ff84c068f90 msgr2=0x7ff84c0738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 shutdown_connections 2024-09-10T20:41:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.748+0000 7ff852000640 1 -- 172.21.15.81:0/3653871535 wait complete. 2024-09-10T20:41:40.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds debug_mds 20 2024-09-10T20:41:40.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.923+0000 7fc260800640 1 -- 172.21.15.81:0/185137164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc240004d40 msgr2=0x7fc2400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.923+0000 7fc260800640 1 --2- 172.21.15.81:0/185137164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc240004d40 0x7fc2400051c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc254009ed0 tx=0x7fc240005830 comp rx=0 tx=0).stop 2024-09-10T20:41:40.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.923+0000 7fc25e800640 1 -- 172.21.15.81:0/185137164 reap_dead start 2024-09-10T20:41:40.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.923+0000 7fc260800640 1 -- 172.21.15.81:0/185137164 shutdown_connections 2024-09-10T20:41:40.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.923+0000 7fc260800640 1 -- 172.21.15.81:0/185137164 >> 172.21.15.81:0/185137164 conn(0x7fc258069020 msgr2=0x7fc25806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:40.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.923+0000 7fc260800640 1 -- 172.21.15.81:0/185137164 shutdown_connections 2024-09-10T20:41:40.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.923+0000 7fc260800640 1 -- 172.21.15.81:0/185137164 wait complete. 2024-09-10T20:41:40.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.925+0000 7fc260800640 1 Processor -- start 2024-09-10T20:41:40.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.925+0000 7fc260800640 1 -- start start 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc260800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc240004d40 0x7fc258137f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc260800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2581f6db0 0x7fc258136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc260800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc258136c60 0x7fc258151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc260800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc258163a50 con 0x7fc2581f6db0 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc260800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc2581638d0 con 0x7fc258136c60 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc260800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc258163bd0 con 0x7fc240004d40 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2581f6db0 0x7fc258136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2581f6db0 0x7fc258136610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48870/0 (socket says 172.21.15.81:48870) 2024-09-10T20:41:40.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 -- 172.21.15.81:0/4173170749 learned_addr learned my addr 172.21.15.81:0/4173170749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25e800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc258136c60 0x7fc258151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 -- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc240004d40 msgr2=0x7fc258137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25de00640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc240004d40 0x7fc258137f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc240004d40 0x7fc258137f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 -- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc258136c60 msgr2=0x7fc258151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc258136c60 0x7fc258151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25d400640 1 -- 172.21.15.81:0/4173170749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2581f7290 con 0x7fc2581f6db0 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25e800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc258136c60 0x7fc258151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.926+0000 7fc25de00640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc240004d40 0x7fc258137f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.927+0000 7fc25d400640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2581f6db0 0x7fc258136610 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc248003ec0 tx=0x7fc248001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.927+0000 7fc252000640 1 -- 172.21.15.81:0/4173170749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248015070 con 0x7fc2581f6db0 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.927+0000 7fc252000640 1 -- 172.21.15.81:0/4173170749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc248011920 con 0x7fc2581f6db0 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.927+0000 7fc252000640 1 -- 172.21.15.81:0/4173170749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248011d70 con 0x7fc2581f6db0 2024-09-10T20:41:40.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.927+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc258154670 con 0x7fc2581f6db0 2024-09-10T20:41:40.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.927+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc258154c30 con 0x7fc2581f6db0 2024-09-10T20:41:40.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.928+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc258156800 con 0x7fc2581f6db0 2024-09-10T20:41:40.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.929+0000 7fc252000640 1 -- 172.21.15.81:0/4173170749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fc2480103c0 con 0x7fc2581f6db0 2024-09-10T20:41:40.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.930+0000 7fc252000640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc23c077fa0 0x7fc23c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:40.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.930+0000 7fc252000640 1 -- 172.21.15.81:0/4173170749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7fc24809b1b0 con 0x7fc2581f6db0 2024-09-10T20:41:40.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.930+0000 7fc25de00640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc23c077fa0 0x7fc23c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.931+0000 7fc25de00640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc23c077fa0 0x7fc23c07a460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001880 tx=0x7fc24c000f10 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:40.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:40.934+0000 7fc252000640 1 -- 172.21.15.81:0/4173170749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fc258156800 con 0x7fc2581f6db0 2024-09-10T20:41:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.121+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fc2580cbf10 con 0x7fc2581f6db0 2024-09-10T20:41:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.121+0000 7fc252000640 1 -- 172.21.15.81:0/4173170749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v28)=0 v28) ==== 108+0+0 (secure 0 0 0) 0x7fc248063870 con 0x7fc2581f6db0 2024-09-10T20:41:41.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc23c077fa0 msgr2=0x7fc23c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc23c077fa0 0x7fc23c07a460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001880 tx=0x7fc24c000f10 comp rx=0 tx=0).stop 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2581f6db0 msgr2=0x7fc258136610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2581f6db0 0x7fc258136610 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc248003ec0 tx=0x7fc248001800 comp rx=0 tx=0).stop 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 shutdown_connections 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fc23c077fa0 0x7fc23c07a460 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc258136c60 0x7fc258151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2581f6db0 0x7fc258136610 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 --2- 172.21.15.81:0/4173170749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc240004d40 0x7fc258137f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.123+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 >> 172.21.15.81:0/4173170749 conn(0x7fc258069020 msgr2=0x7fc25806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.124+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 shutdown_connections 2024-09-10T20:41:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.124+0000 7fc260800640 1 -- 172.21.15.81:0/4173170749 wait complete. 2024-09-10T20:41:41.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / force,recursive,repair 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 -- 172.21.15.81:0/3488378448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d40cf430 msgr2=0x7f05d406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 --2- 172.21.15.81:0/3488378448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d40cf430 0x7f05d406ea40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05d415c660 tx=0x7f05c002a560 comp rx=0 tx=0).stop 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 -- 172.21.15.81:0/3488378448 shutdown_connections 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 --2- 172.21.15.81:0/3488378448 >> v2:172.21.15.143:3300/0 conn(0x7f05d4144a60 0x7f05d4144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 --2- 172.21.15.81:0/3488378448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d40cf430 0x7f05d406ea40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 --2- 172.21.15.81:0/3488378448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05d406e660 0x7f05d415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 -- 172.21.15.81:0/3488378448 >> 172.21.15.81:0/3488378448 conn(0x7f05d4069020 msgr2=0x7f05d406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 -- 172.21.15.81:0/3488378448 shutdown_connections 2024-09-10T20:41:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.300+0000 7f05db200640 1 -- 172.21.15.81:0/3488378448 wait complete. 2024-09-10T20:41:41.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.302+0000 7f05db200640 1 Processor -- start 2024-09-10T20:41:41.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.302+0000 7f05db200640 1 -- start start 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05db200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05d406e660 0x7f05d4072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05db200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05d40cf430 0x7f05d41f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05db200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d4144a60 0x7f05d415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05db200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05d41455b0 con 0x7f05d4144a60 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05db200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4145430 con 0x7f05d40cf430 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05db200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f05d4145730 con 0x7f05d406e660 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d4144a60 0x7f05d415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d4144a60 0x7f05d415aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48896/0 (socket says 172.21.15.81:48896) 2024-09-10T20:41:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 -- 172.21.15.81:0/3720535518 learned_addr learned my addr 172.21.15.81:0/3720535518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d3400640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05d40cf430 0x7f05d41f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05d406e660 0x7f05d4072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 -- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05d406e660 msgr2=0x7f05d4072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05d406e660 0x7f05d4072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 -- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05d40cf430 msgr2=0x7f05d41f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05d40cf430 0x7f05d41f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d9200640 1 -- 172.21.15.81:0/3720535518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4072600 con 0x7f05d4144a60 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.304+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05d406e660 0x7f05d4072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.303+0000 7f05d3400640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05d40cf430 0x7f05d41f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.304+0000 7f05d9200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d4144a60 0x7f05d415aaf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c9a0 tx=0x7f05cc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.304+0000 7f05cbe00640 1 -- 172.21.15.81:0/3720535518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc007b50 con 0x7f05d4144a60 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.304+0000 7f05cbe00640 1 -- 172.21.15.81:0/3720535518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05cc007e00 con 0x7f05d4144a60 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.304+0000 7f05cbe00640 1 -- 172.21.15.81:0/3720535518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc00f6b0 con 0x7f05d4144a60 2024-09-10T20:41:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.304+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d41f54f0 con 0x7f05d4144a60 2024-09-10T20:41:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.304+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d40728c0 con 0x7f05d4144a60 2024-09-10T20:41:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.306+0000 7f05cbe00640 1 -- 172.21.15.81:0/3720535518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f05cc00f850 con 0x7f05d4144a60 2024-09-10T20:41:41.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.308+0000 7f05cbe00640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f05b4077f70 0x7f05b407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.308+0000 7f05cbe00640 1 -- 172.21.15.81:0/3720535518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f05cc09a990 con 0x7f05d4144a60 2024-09-10T20:41:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.308+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f05b4077f70 0x7f05b407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.308+0000 7f05de1d3740 1 Processor -- start 2024-09-10T20:41:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.309+0000 7f05de1d3740 1 -- start start 2024-09-10T20:41:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.309+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f05b4077f70 0x7f05b407a430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05d413f720 tx=0x7f05c400a450 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.309+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39a7cb0 0x556dd39a8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd3962e20 0x556dd39a6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39633a0 0x556dd39a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05de1d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556dd38d47d0 con 0x556dd39a7cb0 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x556dd38c3c00 con 0x556dd39633a0 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x556dd38c7a10 con 0x556dd3962e20 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39a7cb0 0x556dd39a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39a7cb0 0x556dd39a8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48912/0 (socket says 172.21.15.81:48912) 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 -- 172.21.15.81:0/3462560046 learned_addr learned my addr 172.21.15.81:0/3462560046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d9200640 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39633a0 0x556dd39a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3400640 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd3962e20 0x556dd39a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 -- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd3962e20 msgr2=0x556dd39a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd3962e20 0x556dd39a6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 -- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39633a0 msgr2=0x556dd39a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39633a0 0x556dd39a6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 -- 172.21.15.81:0/3462560046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd3851b50 con 0x556dd39a7cb0 2024-09-10T20:41:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.310+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39a7cb0 0x556dd39a8090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005c50 tx=0x7f05c4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9207710807b5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05c8c00640 1 -- 172.21.15.81:0/3462560046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4021070 con 0x556dd39a7cb0 2024-09-10T20:41:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05c8c00640 1 -- 172.21.15.81:0/3462560046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c400f980 con 0x556dd39a7cb0 2024-09-10T20:41:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05c8c00640 1 -- 172.21.15.81:0/3462560046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c400fdb0 con 0x556dd39a7cb0 2024-09-10T20:41:41.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 -- 172.21.15.81:0/3462560046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39a7cb0 msgr2=0x556dd39a8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39a7cb0 0x556dd39a8090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005c50 tx=0x7f05c4011000 comp rx=0 tx=0).stop 2024-09-10T20:41:41.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 -- 172.21.15.81:0/3462560046 shutdown_connections 2024-09-10T20:41:41.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39633a0 0x556dd39a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd3962e20 0x556dd39a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3462560046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39a7cb0 0x556dd39a8090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 -- 172.21.15.81:0/3462560046 >> 172.21.15.81:0/3462560046 conn(0x556dd395e3f0 msgr2=0x556dd3961e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 -- 172.21.15.81:0/3462560046 shutdown_connections 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.311+0000 7f05de1d3740 1 -- 172.21.15.81:0/3462560046 wait complete. 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.312+0000 7f05de1d3740 1 -- start start 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.312+0000 7f05de1d3740 1 Processor -- start 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.313+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd398a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.313+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.313+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd3961a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.313+0000 7f05de1d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556dd3634880 con 0x556dd39633a0 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.313+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x556dd38694b0 con 0x556dd39a7030 2024-09-10T20:41:41.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.313+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x556dd395ce10 con 0x556dd39a7cb0 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.313+0000 7f05de1d3740 10 client.0 _ll_register_callbacks cb 0x556dd386f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd398a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd398a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48920/0 (socket says 172.21.15.81:48920) 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 -- 172.21.15.81:0/3530134852 learned_addr learned my addr 172.21.15.81:0/3530134852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d9200640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd3961a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3400640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 -- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 msgr2=0x556dd39a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 -- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 msgr2=0x556dd3961a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd3961a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 -- 172.21.15.81:0/3530134852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dd369e940 con 0x556dd39633a0 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d9200640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd3961a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3400640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05d3e00640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd398a180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f05c4010e20 tx=0x7f05c401f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba868967c336bc95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.314+0000 7f05bd600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05bd600640 1 -- 172.21.15.81:0/3530134852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4034060 con 0x556dd39633a0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c400f980 con 0x556dd39633a0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05bd600640 1 -- 172.21.15.81:0/3530134852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f05c400f690 con 0x556dd39633a0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05bd600640 1 -- 172.21.15.81:0/3530134852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f05c403a050 con 0x556dd39633a0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 10 client.5499 fetch_fsmap learned FSMap version 30 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x556dd36ff0d0 con 0x556dd39633a0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05bd600640 1 -- 172.21.15.81:0/3530134852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c400f980 con 0x556dd39633a0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05bd600640 1 -- 172.21.15.81:0/3530134852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 4147+0+0 (secure 0 0 0) 0x7f05c403d020 con 0x556dd39633a0 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 10 client.5499 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 10 client.5499 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T20:41:41.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 20 client.5499 populate_metadata read hostname 'smithi081' 2024-09-10T20:41:41.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd39a7430 0x556dd398ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 4 client.5499 mds_command: new command op to 5184 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T20:41:41.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.315+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 --> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dd38d6720 con 0x556dd39a7430 2024-09-10T20:41:41.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.316+0000 7f05d3400640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd39a7430 0x556dd398ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.316+0000 7f05d3400640 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd39a7430 0x556dd398ba70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8347b80ba5eb6807 server_cookie=769236e1185ac1e8 in_seq=0 out_seq=0 2024-09-10T20:41:41.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.316+0000 7f05bd600640 10 client.5499 ms_handle_connect on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:41.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05bd600640 1 -- 172.21.15.81:0/3530134852 <== mds.0 v2:172.21.15.81:6833/2525007844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556dd38d6720 con 0x556dd39a7430 2024-09-10T20:41:41.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05bd600640 10 client.5499 handle_command_reply: tid=0 2024-09-10T20:41:41.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 client.5499 shutdown 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 msgr2=0x556dd398a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd398a180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f05c4010e20 tx=0x7f05c401f6a0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 shutdown_connections 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd3961a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd39a7430 0x556dd398ba70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 --2- 172.21.15.81:0/3530134852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd398a180 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05bd600640 0 client.5499 ms_handle_reset on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 >> 172.21.15.81:0/3530134852 conn(0x556dd3962e20 msgr2=0x556dd395cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 shutdown_connections 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.317+0000 7f05de1d3740 1 -- 172.21.15.81:0/3530134852 wait complete. 2024-09-10T20:41:41.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.318+0000 7f05de1d3740 20 client.5499 trim_cache size 0 max 16384 2024-09-10T20:41:41.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.336+0000 7f05de1d3740 1 Processor -- start 2024-09-10T20:41:41.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.336+0000 7f05de1d3740 1 -- start start 2024-09-10T20:41:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd39b9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd39833b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05de1d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4203230 con 0x556dd39633a0 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4201920 con 0x556dd39a7030 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f05d413cb50 con 0x556dd39a7cb0 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd39b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd39b9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48924/0 (socket says 172.21.15.81:48924) 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 -- 172.21.15.81:0/2084261671 learned_addr learned my addr 172.21.15.81:0/2084261671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 -- 172.21.15.81:0/2084261671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 msgr2=0x556dd39b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 --2- 172.21.15.81:0/2084261671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 -- 172.21.15.81:0/2084261671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 msgr2=0x556dd39833b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 --2- 172.21.15.81:0/2084261671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd39833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 -- 172.21.15.81:0/2084261671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd36037e0 con 0x556dd39633a0 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.337+0000 7f05d3e00640 1 --2- 172.21.15.81:0/2084261671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd39b9010 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f05c4010590 tx=0x7f05c400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b80bf8d153d87bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05bfe00640 1 -- 172.21.15.81:0/2084261671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4014040 con 0x556dd39633a0 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05bfe00640 1 -- 172.21.15.81:0/2084261671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c401f710 con 0x556dd39633a0 2024-09-10T20:41:41.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05bfe00640 1 -- 172.21.15.81:0/2084261671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4021040 con 0x556dd39633a0 2024-09-10T20:41:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 -- 172.21.15.81:0/2084261671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 msgr2=0x556dd39b9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2084261671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd39b9010 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f05c4010590 tx=0x7f05c400ec80 comp rx=0 tx=0).stop 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 -- 172.21.15.81:0/2084261671 shutdown_connections 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2084261671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7cb0 0x556dd39b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2084261671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7030 0x556dd39833b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2084261671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd39b9010 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 -- 172.21.15.81:0/2084261671 >> 172.21.15.81:0/2084261671 conn(0x556dd3962e20 msgr2=0x556dd3986910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.338+0000 7f05de1d3740 1 -- 172.21.15.81:0/2084261671 shutdown_connections 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.339+0000 7f05de1d3740 1 -- 172.21.15.81:0/2084261671 wait complete. 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.339+0000 7f05de1d3740 1 -- start start 2024-09-10T20:41:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.339+0000 7f05de1d3740 1 Processor -- start 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd3a1d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7030 0x556dd399f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05de1d3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7cb0 0x556dd399fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05de1d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05d42013c0 con 0x556dd39633a0 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x556dd39b8a90 con 0x556dd39a7cb0 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05de1d3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x556dd39b95c0 con 0x556dd39a7030 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05de1d3740 10 client.0 _ll_register_callbacks cb 0x7f05c400fe60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.340+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd3a1d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd3a1d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48940/0 (socket says 172.21.15.81:48940) 2024-09-10T20:41:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 -- 172.21.15.81:0/2502840847 learned_addr learned my addr 172.21.15.81:0/2502840847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d9200640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7cb0 0x556dd399fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3400640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7030 0x556dd399f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 -- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7030 msgr2=0x556dd399f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7030 0x556dd399f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 -- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7cb0 msgr2=0x556dd399fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7cb0 0x556dd399fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 -- 172.21.15.81:0/2502840847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dd38906b0 con 0x556dd39633a0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3400640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7030 0x556dd399f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05d3e00640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd3a1d550 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f05c4010fd0 tx=0x7f05c401fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801359f46ca22b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05bd600640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05bd600640 1 -- 172.21.15.81:0/2502840847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4021030 con 0x556dd39633a0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05bd600640 1 -- 172.21.15.81:0/2502840847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f05c4035250 con 0x556dd39633a0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.341+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c401f710 con 0x556dd39633a0 2024-09-10T20:41:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05bd600640 1 -- 172.21.15.81:0/2502840847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f05c4034030 con 0x556dd39633a0 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 10 client.5505 fetch_fsmap learned FSMap version 30 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x556dd39b87d0 con 0x556dd39633a0 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05bd600640 1 -- 172.21.15.81:0/2502840847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05c401f710 con 0x556dd39633a0 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05bd600640 1 -- 172.21.15.81:0/2502840847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 4147+0+0 (secure 0 0 0) 0x7f05c403d030 con 0x556dd39633a0 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 10 client.5505 fetch_fsmap finished waiting for FSMap version 30 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 10 client.5505 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 20 client.5505 populate_metadata read hostname 'smithi081' 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd3961350 0x556dd3a2a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 4 client.5505 mds_command: new command op to 5184 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}] 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 --> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}) -- 0x556dd39a26b0 con 0x556dd3961350 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.342+0000 7f05d3400640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd3961350 0x556dd3a2a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.343+0000 7f05d3400640 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd3961350 0x556dd3a2a3d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebce4809b8817342 server_cookie=e509af23a96f87d5 in_seq=0 out_seq=0 2024-09-10T20:41:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.343+0000 7f05bd600640 10 client.5505 ms_handle_connect on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.343+0000 7f05bd600640 1 -- 172.21.15.81:0/2502840847 <== mds.0 v2:172.21.15.81:6833/2525007844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556dd39a26b0 con 0x556dd3961350 2024-09-10T20:41:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.343+0000 7f05bd600640 10 client.5505 handle_command_reply: tid=0 2024-09-10T20:41:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.343+0000 7f05de1d3740 1 client.5505 shutdown 2024-09-10T20:41:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 msgr2=0x556dd3a1d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd3a1d550 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f05c4010fd0 tx=0x7f05c401fb50 comp rx=0 tx=0).stop 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 shutdown_connections 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x556dd39a7cb0 0x556dd399fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x556dd39a7030 0x556dd399f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:6833/2525007844,v1:172.21.15.81:6835/2525007844] conn(0x556dd3961350 0x556dd3a2a3d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 --2- 172.21.15.81:0/2502840847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556dd39633a0 0x556dd3a1d550 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 >> 172.21.15.81:0/2502840847 conn(0x556dd3962e20 msgr2=0x556dd39ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05bd600640 0 client.5505 ms_handle_reset on v2:172.21.15.81:6833/2525007844 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 shutdown_connections 2024-09-10T20:41:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 1 -- 172.21.15.81:0/2502840847 wait complete. 2024-09-10T20:41:41.351 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f896a800640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2024-09-10T20:41:41.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.344+0000 7f05de1d3740 20 client.5505 trim_cache size 0 max 16384 2024-09-10T20:41:41.352 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-10T20:41:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "63136f5d-b3d2-4133-8ad6-dc3ef9a85db9", 2024-09-10T20:41:41.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-10T20:41:41.352 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f05b4077f70 msgr2=0x7f05b407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f05b4077f70 0x7f05b407a430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05d413f720 tx=0x7f05c400a450 comp rx=0 tx=0).stop 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d4144a60 msgr2=0x7f05d415aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d4144a60 0x7f05d415aaf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c9a0 tx=0x7f05cc00ce60 comp rx=0 tx=0).stop 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 shutdown_connections 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f05b4077f70 0x7f05b407a430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d4144a60 0x7f05d415aaf0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f05d40cf430 0x7f05d41f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 --2- 172.21.15.81:0/3720535518 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f05d406e660 0x7f05d4072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 >> 172.21.15.81:0/3720535518 conn(0x7f05d4069020 msgr2=0x7f05d4153b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.354 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f896a800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x564370d79180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-10T20:41:41.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 shutdown_connections 2024-09-10T20:41:41.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.345+0000 7f05db200640 1 -- 172.21.15.81:0/3720535518 wait complete. 2024-09-10T20:41:41.355 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-10T20:41:41.346+0000 7f896a800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() | request=0 lock=0 dirtyparent=1 authpin=1 scrubqueue=0 0x564371022580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(6)0x10000000001:[<0x10000000000/sixmegs v8>,<0x1/subdir v10>]//[]","memoryvalue":"(6)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-10T20:41:41.358 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-10T20:41:41.354+0000 7f896a800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 pv6 ap=5 snaprealm=0x564370d746c0 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (inest mix->lock(2) w=1 flushing) (ifile mix->sync w=1 flushing) | dirtyscattered=2 lock=2 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x564370d76b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-10T20:41:41.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.517+0000 7f9acfa00640 1 -- 172.21.15.81:0/14315183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac8147470 msgr2=0x7f9ac8074020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.517+0000 7f9acfa00640 1 --2- 172.21.15.81:0/14315183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac8147470 0x7f9ac8074020 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9ac815bdb0 tx=0x7f9ab802a560 comp rx=0 tx=0).stop 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.518+0000 7f9acfa00640 1 -- 172.21.15.81:0/14315183 shutdown_connections 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.518+0000 7f9acfa00640 1 --2- 172.21.15.81:0/14315183 >> v2:172.21.15.143:3300/0 conn(0x7f9ac80ad8a0 0x7f9ac80adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.518+0000 7f9acfa00640 1 --2- 172.21.15.81:0/14315183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac8147470 0x7f9ac8074020 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.518+0000 7f9acfa00640 1 -- 172.21.15.81:0/14315183 >> 172.21.15.81:0/14315183 conn(0x7f9ac8068f90 msgr2=0x7f9ac806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.518+0000 7f9acfa00640 1 -- 172.21.15.81:0/14315183 shutdown_connections 2024-09-10T20:41:41.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.518+0000 7f9acfa00640 1 -- 172.21.15.81:0/14315183 wait complete. 2024-09-10T20:41:41.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.519+0000 7f9acfa00640 1 Processor -- start 2024-09-10T20:41:41.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.519+0000 7f9acfa00640 1 -- start start 2024-09-10T20:41:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.520+0000 7f9acfa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ac8072480 0x7f9ac81f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.520+0000 7f9acfa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac80ad8a0 0x7f9ac8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.520+0000 7f9acfa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8147470 0x7f9ac8137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.520+0000 7f9acfa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac80b4140 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.520+0000 7f9acfa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac80b3fc0 con 0x7f9ac8147470 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.520+0000 7f9acfa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac80b42c0 con 0x7f9ac8072480 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac80ad8a0 0x7f9ac8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac80ad8a0 0x7f9ac8159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48952/0 (socket says 172.21.15.81:48952) 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 -- 172.21.15.81:0/1374661567 learned_addr learned my addr 172.21.15.81:0/1374661567 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9acd000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ac8072480 0x7f9ac81f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9acda00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8147470 0x7f9ac8137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 -- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ac8072480 msgr2=0x7f9ac81f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ac8072480 0x7f9ac81f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 -- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8147470 msgr2=0x7f9ac8137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8147470 0x7f9ac8137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 -- 172.21.15.81:0/1374661567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac81e6ff0 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac7e00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac80ad8a0 0x7f9ac8159dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400e9f0 tx=0x7f9ab400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.521+0000 7f9ac4c00640 1 -- 172.21.15.81:0/1374661567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400cd80 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.522+0000 7f9ac4c00640 1 -- 172.21.15.81:0/1374661567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab4005020 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.522+0000 7f9ac4c00640 1 -- 172.21.15.81:0/1374661567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4005450 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.522+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac815a450 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.522+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac815aa10 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.523+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac806f4f0 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.524+0000 7f9ac4c00640 1 -- 172.21.15.81:0/1374661567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9ab40047a0 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.525+0000 7f9ac4c00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9aa8077f70 0x7f9aa807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.525+0000 7f9ac4c00640 1 -- 172.21.15.81:0/1374661567 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f9ab409ac20 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.525+0000 7f9acd000640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9aa8077f70 0x7f9aa807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.526+0000 7f9acd000640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9aa8077f70 0x7f9aa807a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8033000 tx=0x7f9ab8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.529+0000 7f9ac4c00640 1 -- 172.21.15.81:0/1374661567 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9ac806f4f0 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.745+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ac80b4770 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.746+0000 7f9ac4c00640 1 -- 172.21.15.81:0/1374661567 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6534 (secure 0 0 0) 0x7f9ab4062cb0 con 0x7f9ac80ad8a0 2024-09-10T20:41:41.750 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:41.750 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-10T20:41:39:070176+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:41.750 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9aa8077f70 msgr2=0x7f9aa807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9aa8077f70 0x7f9aa807a430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8033000 tx=0x7f9ab8004730 comp rx=0 tx=0).stop 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac80ad8a0 msgr2=0x7f9ac8159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac80ad8a0 0x7f9ac8159dc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400e9f0 tx=0x7f9ab400edf0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 shutdown_connections 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9aa8077f70 0x7f9aa807a430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ac8147470 0x7f9ac8137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ac80ad8a0 0x7f9ac8159dc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 --2- 172.21.15.81:0/1374661567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ac8072480 0x7f9ac81f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 >> 172.21.15.81:0/1374661567 conn(0x7f9ac8068f90 msgr2=0x7f9ac80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.748+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 shutdown_connections 2024-09-10T20:41:41.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.749+0000 7f9acfa00640 1 -- 172.21.15.81:0/1374661567 wait complete. 2024-09-10T20:41:41.769 INFO:tasks.cephfs.test_recovery_pool:{ "btime": "2024-09-10T20:41:39:070176+0000", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 30, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-10T20:40:57.190090+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [ 0 ], "flags": 19, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": false, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": {}, "last_failure": 0, "last_failure_osd_epoch": 41, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2024-09-10T20:41:14.470297+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": {} } }, { "id": 3, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-10T20:41:23.771863+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 30, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "recovery_fs", "in": [ 0 ], "info": { "gid_5184": { "addr": "172.21.15.81:6835/2525007844", "addrs": { "addrvec": [ { "addr": "172.21.15.81:6833", "nonce": 2525007844, "type": "v2" }, { "addr": "172.21.15.81:6835", "nonce": 2525007844, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540719139924082687, "flags": 0, "gid": 5184, "incarnation": 27, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 9 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 7, "modified": "2024-09-10T20:41:39.070169+0000", "qdb_cluster": [ 5184 ], "qdb_leader": 5184, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5184 } } } ], "standbys": [ { "addr": "172.21.15.143:6835/3589159240", "addrs": { "addrvec": [ { "addr": "172.21.15.143:6834", "nonce": 3589159240, "type": "v2" }, { "addr": "172.21.15.143:6835", "nonce": 3589159240, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540719139924082687, "flags": 0, "gid": 4880, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.143:6837/3528844898", "addrs": { "addrvec": [ { "addr": "172.21.15.143:6836", "nonce": 3528844898, "type": "v2" }, { "addr": "172.21.15.143:6837", "nonce": 3528844898, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 22, "export_targets": [], "features": 4540719139924082687, "flags": 0, "gid": 4895, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.81:6834/2925895536", "addrs": { "addrvec": [ { "addr": "172.21.15.81:6832", "nonce": 2925895536, "type": "v2" }, { "addr": "172.21.15.81:6834", "nonce": 2925895536, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 21, "export_targets": [], "features": 4540719139924082687, "flags": 0, "gid": 5181, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-10T20:41:41.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T20:41:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 -- 172.21.15.81:0/2829499413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 msgr2=0x7f391415c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 --2- 172.21.15.81:0/2829499413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 0x7f391415c900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39140cdcc0 tx=0x7f390402aa90 comp rx=0 tx=0).stop 2024-09-10T20:41:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 -- 172.21.15.81:0/2829499413 shutdown_connections 2024-09-10T20:41:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 --2- 172.21.15.81:0/2829499413 >> v2:172.21.15.143:3300/0 conn(0x7f391406e660 0x7f391406eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 --2- 172.21.15.81:0/2829499413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 0x7f391415c900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 -- 172.21.15.81:0/2829499413 >> 172.21.15.81:0/2829499413 conn(0x7f3914068f90 msgr2=0x7f391406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 -- 172.21.15.81:0/2829499413 shutdown_connections 2024-09-10T20:41:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.923+0000 7f391ac00640 1 -- 172.21.15.81:0/2829499413 wait complete. 2024-09-10T20:41:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.925+0000 7f391ac00640 1 Processor -- start 2024-09-10T20:41:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.925+0000 7f391ac00640 1 -- start start 2024-09-10T20:41:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f391ac00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f391406e660 0x7f39141413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f391ac00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 0x7f3914140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f391ac00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f391415f630 0x7f39140c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f391ac00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39140cccf0 con 0x7f391406e660 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f391ac00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f39140ccb70 con 0x7f391415f630 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f391ac00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f39141601d0 con 0x7f391415ee50 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f3913e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f391406e660 0x7f39141413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f3913e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f391406e660 0x7f39141413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48966/0 (socket says 172.21.15.81:48966) 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f3913e00640 1 -- 172.21.15.81:0/2360753999 learned_addr learned my addr 172.21.15.81:0/2360753999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f3913400640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 0x7f3914140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.926+0000 7f3918c00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f391415f630 0x7f39140c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f3913e00640 1 -- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 msgr2=0x7f3914140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f3913e00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 0x7f3914140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f3913e00640 1 -- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f391415f630 msgr2=0x7f39140c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f3913e00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f391415f630 0x7f39140c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:41.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f3913e00640 1 -- 172.21.15.81:0/2360753999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3914072600 con 0x7f391406e660 2024-09-10T20:41:41.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f3918c00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f391415f630 0x7f39140c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:41.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f3913e00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f391406e660 0x7f39141413c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3904009bf0 tx=0x7f3904003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f390be00640 1 -- 172.21.15.81:0/2360753999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904046070 con 0x7f391406e660 2024-09-10T20:41:41.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f390be00640 1 -- 172.21.15.81:0/2360753999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3904003e00 con 0x7f391406e660 2024-09-10T20:41:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f390be00640 1 -- 172.21.15.81:0/2360753999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39040044b0 con 0x7f391406e660 2024-09-10T20:41:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39140728c0 con 0x7f391406e660 2024-09-10T20:41:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.927+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39140c7d30 con 0x7f391406e660 2024-09-10T20:41:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.928+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391406eaa0 con 0x7f391406e660 2024-09-10T20:41:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.929+0000 7f390be00640 1 -- 172.21.15.81:0/2360753999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3904004650 con 0x7f391406e660 2024-09-10T20:41:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.930+0000 7f390be00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f38f4077f70 0x7f38f407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.930+0000 7f390be00640 1 -- 172.21.15.81:0/2360753999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f39040bb1e0 con 0x7f391406e660 2024-09-10T20:41:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.931+0000 7f3913400640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f38f4077f70 0x7f38f407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.931+0000 7f3913400640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f38f4077f70 0x7f38f407a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39000095f0 tx=0x7f3900005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:41.934+0000 7f390be00640 1 -- 172.21.15.81:0/2360753999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3904032030 con 0x7f391406e660 2024-09-10T20:41:41.957 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-10T20:41:41.954+0000 7f896f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:41:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.154+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3914151c40 con 0x7f391406e660 2024-09-10T20:41:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.154+0000 7f390be00640 1 -- 172.21.15.81:0/2360753999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+156 (secure 0 0 0) 0x7f39040831b0 con 0x7f391406e660 2024-09-10T20:41:42.158 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T20:41:42.159 INFO:teuthology.orchestra.run.smithi081.stdout:name: recovery_fs, metadata pool: recovery_fs_metadata, data pools: [cephfs_data ] 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f38f4077f70 msgr2=0x7f38f407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f38f4077f70 0x7f38f407a430 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f39000095f0 tx=0x7f3900005f90 comp rx=0 tx=0).stop 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f391406e660 msgr2=0x7f39141413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f391406e660 0x7f39141413c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3904009bf0 tx=0x7f3904003c10 comp rx=0 tx=0).stop 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 shutdown_connections 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f38f4077f70 0x7f38f407a430 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f391415f630 0x7f39140c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f391415ee50 0x7f3914140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 --2- 172.21.15.81:0/2360753999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f391406e660 0x7f39141413c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 >> 172.21.15.81:0/2360753999 conn(0x7f3914068f90 msgr2=0x7f3914075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:42.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 shutdown_connections 2024-09-10T20:41:42.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42.157+0000 7f391ac00640 1 -- 172.21.15.81:0/2360753999 wait complete. 2024-09-10T20:41:42.176 INFO:tasks.cephfs.mount:Mounting Ceph FS recovery_fs; just confirmed its presence on cluster 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:self.cephfs_name = recovery_fs 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T20:41:42.177 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:41:42.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:42.178 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-10T20:41:42.213 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42619sec preferred_lft 42619sec 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 4a:cf:ee:e2:b9:49 brd ff:ff:ff:ff:ff:ff 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T20:41:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::b40c:4fff:fe85:a68f/64 scope link 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ae:bc:12:01:8a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::acbc:12ff:fe01:8a8b/64 scope link 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 4a:cf:ee:e2:b9:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::48cf:eeff:fee2:b949/64 scope link 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-10T20:41:42.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:42.215 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T20:41:42.307 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-10T20:41:42.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:42.310 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-10T20:41:42.346 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-10T20:41:42.346 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T20:41:42.346 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T20:41:42.346 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T20:41:42.346 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T20:41:42.346 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T20:41:42.347 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-10T20:41:42.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T20:41:42.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T20:41:42.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T20:41:42.347 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-10T20:41:42.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T20:41:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:41:42.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:42.542 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-10T20:41:42.577 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T20:41:42.578 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T20:41:42.578 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:41:42.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:42.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-10T20:41:42.673 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-10T20:41:42.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:41:42.674 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:42.709 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T20:41:42.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T20:41:42.709 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:42.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:41:42.882 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:41:42.918 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:41:42.918 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:41:42.919 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:41:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:41:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:41:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:41:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:42.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:42.922 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:41:42.998 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T20:41:42.998 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=recovery_fs) 2024-09-10T20:41:43.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-10T20:41:43.102 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T20:41:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-10T20:41:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-10T20:41:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-10T20:41:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-10T20:41:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-10T20:41:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-10T20:41:43.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:43.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:43.142 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:43.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:43.143 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-10T20:41:43.190 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-10T20:41:43.187+0000 7f3062afb480 -1 init, newargv = 0x5613d77bc560 newargc=15 2024-09-10T20:41:43.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[51186]: starting ceph client 2024-09-10T20:41:43.199 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[51186]: starting fuse 2024-09-10T20:41:43.221 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-10T20:41:43.221 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-10T20:41:43.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-10T20:41:43.221 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-10T20:41:43.221 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-10T20:41:43.221 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-10T20:41:43.221 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T20:41:43.222 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T20:41:43.223 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-10T20:41:43.223 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-10T20:41:43.223 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-10T20:41:43.223 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T20:41:43.223 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:43.223 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-10T20:41:43.223 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-10T20:41:43.383 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.51186.asok 2024-09-10T20:41:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:41:43.397 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51186.asok 2024-09-10T20:41:43.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:43.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51186.asok status 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-10T20:41:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "51186", 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5523, 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5523 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:41:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 348736069 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 348736069 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.5523 192.168.0.1:0/348736069", 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/348736069", 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 30, 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 50, 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-10T20:41:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-10T20:41:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "recovery_fs" 2024-09-10T20:41:43.581 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:43.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:43.590 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-10T20:41:43.590 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:43.626 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-10T20:41:43.626 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:43.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:43.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:43.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:43.724 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir) 2024-09-10T20:41:43.765 INFO:teuthology.orchestra.run.smithi081.stdout:sixmegs 2024-09-10T20:41:43.766 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-10T20:41:43.766 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-10T20:41:43.766 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-10T20:41:43.766 DEBUG:teuthology.orchestra.run.smithi081:> import json 2024-09-10T20:41:43.766 DEBUG:teuthology.orchestra.run.smithi081:> import sys 2024-09-10T20:41:43.766 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:43.766 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> sys.exit(e.errno) 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> print(json.dumps( 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> indent=2)) 2024-09-10T20:41:43.767 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-10T20:41:43.909 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:41:43.909 INFO:teuthology.orchestra.run.smithi081.stdout: "st_mode": 33088, 2024-09-10T20:41:43.909 INFO:teuthology.orchestra.run.smithi081.stdout: "st_ino": 1099511627777, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_dev": 41, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_nlink": 1, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_uid": 0, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_gid": 0, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_size": 6291456, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_atime": 1726000874.0, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_mtime": 1726000874.0, 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout: "st_ctime": 1726000874.0 2024-09-10T20:41:43.910 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:41:43.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T20:41:43.921 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T20:41:43.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:41:44.050 DEBUG:teuthology.orchestra.run.smithi143:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T20:41:44.142 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T20:41:44.143 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:41:44.143 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:44.143 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:44.179 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:44.179 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:44.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T20:41:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.451+0000 7ff4e2200640 1 -- 172.21.15.81:0/2314273861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 msgr2=0x7ff4dc0b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.451+0000 7ff4e2200640 1 --2- 172.21.15.81:0/2314273861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc0b3cb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4005fd0 tx=0x7ff4d402a940 comp rx=0 tx=0).stop 2024-09-10T20:41:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.451+0000 7ff4e2200640 1 -- 172.21.15.81:0/2314273861 shutdown_connections 2024-09-10T20:41:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.451+0000 7ff4e2200640 1 --2- 172.21.15.81:0/2314273861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc0b3cb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.451+0000 7ff4e2200640 1 -- 172.21.15.81:0/2314273861 >> 172.21.15.81:0/2314273861 conn(0x7ff4dc068f90 msgr2=0x7ff4dc06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.451+0000 7ff4e2200640 1 -- 172.21.15.81:0/2314273861 shutdown_connections 2024-09-10T20:41:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.451+0000 7ff4e2200640 1 -- 172.21.15.81:0/2314273861 wait complete. 2024-09-10T20:41:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.452+0000 7ff4e2200640 1 Processor -- start 2024-09-10T20:41:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.453+0000 7ff4e2200640 1 -- start start 2024-09-10T20:41:44.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.453+0000 7ff4e2200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4dc06ed70 0x7ff4dc0c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.453+0000 7ff4e2200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.453+0000 7ff4e2200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4dc1453e0 0x7ff4dc0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.453+0000 7ff4e2200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc0b41f0 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.453+0000 7ff4e2200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc06f9a0 con 0x7ff4dc06ed70 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.453+0000 7ff4e2200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff4dc0b4370 con 0x7ff4dc1453e0 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc141530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48984/0 (socket says 172.21.15.81:48984) 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 -- 172.21.15.81:0/213054625 learned_addr learned my addr 172.21.15.81:0/213054625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4db400640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4dc06ed70 0x7ff4dc0c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4dbe00640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4dc1453e0 0x7ff4dc0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 -- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4dc1453e0 msgr2=0x7ff4dc0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4dc1453e0 0x7ff4dc0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 -- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4dc06ed70 msgr2=0x7ff4dc0c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4dc06ed70 0x7ff4dc0c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 -- 172.21.15.81:0/213054625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc0a9a10 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4db400640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4dc06ed70 0x7ff4dc0c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.454+0000 7ff4daa00640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc141530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c450 tx=0x7ff4c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.455+0000 7ff4d3400640 1 -- 172.21.15.81:0/213054625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80052d0 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.455+0000 7ff4d3400640 1 -- 172.21.15.81:0/213054625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4c8005470 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.455+0000 7ff4d3400640 1 -- 172.21.15.81:0/213054625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8012870 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.455+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc0a9cf0 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.455+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc0aa2b0 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.456+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4dc0ce330 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.457+0000 7ff4d3400640 1 -- 172.21.15.81:0/213054625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ff4c80035f0 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.458+0000 7ff4d3400640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff4bc077f70 0x7ff4bc07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:44.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.458+0000 7ff4d3400640 1 -- 172.21.15.81:0/213054625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7ff4c8099d90 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.458+0000 7ff4db400640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff4bc077f70 0x7ff4bc07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:44.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.459+0000 7ff4db400640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff4bc077f70 0x7ff4bc07a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc007a50 tx=0x7ff4cc009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:44.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.462+0000 7ff4d3400640 1 -- 172.21.15.81:0/213054625 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ff4dc0ce330 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.655+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff4dc0b4820 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.655+0000 7ff4d3400640 1 -- 172.21.15.81:0/213054625 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v50) ==== 80+0+124 (secure 0 0 0) 0x7ff4c80623b0 con 0x7ff4dc0cd5a0 2024-09-10T20:41:44.660 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.143:6837/3550323967 2024-09-11T20:41:14.470093+0000 2024-09-10T20:41:44.660 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.143:6835/3550323967 2024-09-11T20:41:14.470093+0000 2024-09-10T20:41:44.660 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.657+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff4bc077f70 msgr2=0x7ff4bc07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff4bc077f70 0x7ff4bc07a430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc007a50 tx=0x7ff4cc009040 comp rx=0 tx=0).stop 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 msgr2=0x7ff4dc141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc141530 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c450 tx=0x7ff4c800c910 comp rx=0 tx=0).stop 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 shutdown_connections 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ff4bc077f70 0x7ff4bc07a430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4dc1453e0 0x7ff4dc0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:44.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4dc0cd5a0 0x7ff4dc141530 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 --2- 172.21.15.81:0/213054625 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4dc06ed70 0x7ff4dc0c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 >> 172.21.15.81:0/213054625 conn(0x7ff4dc068f90 msgr2=0x7ff4dc15c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 shutdown_connections 2024-09-10T20:41:44.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:44.658+0000 7ff4e2200640 1 -- 172.21.15.81:0/213054625 wait complete. 2024-09-10T20:41:44.678 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-10T20:41:44.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:44.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-10T20:41:44.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[51186]: fuse finished with error 0 and tester_r 0 2024-09-10T20:41:44.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:41:44.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:44.734 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T20:41:44.774 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:41:44.774 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:41:44.774 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:44.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:41:44.816 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:41:44.816 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:44.816 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:44.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T20:41:44.852 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T20:41:44.852 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:41:44.852 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:44.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:41:44.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.049+0000 7f72f6a00640 1 -- 172.21.15.81:0/3389849947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 msgr2=0x7f72d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.049+0000 7f72f6a00640 1 --2- 172.21.15.81:0/3389849947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 0x7f72d4004800 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009b50 tx=0x7f72d4005830 comp rx=0 tx=0).stop 2024-09-10T20:41:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.049+0000 7f72f4a00640 1 -- 172.21.15.81:0/3389849947 reap_dead start 2024-09-10T20:41:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.049+0000 7f72f6a00640 1 -- 172.21.15.81:0/3389849947 shutdown_connections 2024-09-10T20:41:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.049+0000 7f72f6a00640 1 -- 172.21.15.81:0/3389849947 >> 172.21.15.81:0/3389849947 conn(0x7f72f0068f90 msgr2=0x7f72f006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.049+0000 7f72f6a00640 1 -- 172.21.15.81:0/3389849947 shutdown_connections 2024-09-10T20:41:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.049+0000 7f72f6a00640 1 -- 172.21.15.81:0/3389849947 wait complete. 2024-09-10T20:41:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.051+0000 7f72f6a00640 1 Processor -- start 2024-09-10T20:41:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.051+0000 7f72f6a00640 1 -- start start 2024-09-10T20:41:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72f6a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 0x7f72f015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72f6a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72f0140b40 0x7f72f015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72f6a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72f0140fc0 0x7f72f015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72f6a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72f00cf170 con 0x7f72d4003fd0 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72f6a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f72f00ceff0 con 0x7f72f0140b40 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72f6a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f72f0160230 con 0x7f72f0140fc0 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72efe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 0x7f72f015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72efe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 0x7f72f015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35836/0 (socket says 172.21.15.81:35836) 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.052+0000 7f72efe00640 1 -- 172.21.15.81:0/240027265 learned_addr learned my addr 172.21.15.81:0/240027265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72e7e00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72f0140b40 0x7f72f015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72f4a00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72f0140fc0 0x7f72f015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72efe00640 1 -- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72f0140fc0 msgr2=0x7f72f015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72efe00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72f0140fc0 0x7f72f015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72efe00640 1 -- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72f0140b40 msgr2=0x7f72f015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72efe00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72f0140b40 0x7f72f015dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72efe00640 1 -- 172.21.15.81:0/240027265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f015c2b0 con 0x7f72d4003fd0 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72efe00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 0x7f72f015b600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f72e0011a50 tx=0x7f72e0011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.053+0000 7f72ecc00640 1 -- 172.21.15.81:0/240027265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e001f070 con 0x7f72d4003fd0 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.054+0000 7f72ecc00640 1 -- 172.21.15.81:0/240027265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e000fd90 con 0x7f72d4003fd0 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.054+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f01f8f00 con 0x7f72d4003fd0 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.054+0000 7f72ecc00640 1 -- 172.21.15.81:0/240027265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0012690 con 0x7f72d4003fd0 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.054+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f015c850 con 0x7f72d4003fd0 2024-09-10T20:41:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.055+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f0073760 con 0x7f72d4003fd0 2024-09-10T20:41:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.056+0000 7f72ecc00640 1 -- 172.21.15.81:0/240027265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f72e0012830 con 0x7f72d4003fd0 2024-09-10T20:41:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.057+0000 7f72ecc00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f72cc077fa0 0x7f72cc07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.057+0000 7f72ecc00640 1 -- 172.21.15.81:0/240027265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f72e009adb0 con 0x7f72d4003fd0 2024-09-10T20:41:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.057+0000 7f72e7e00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f72cc077fa0 0x7f72cc07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.058+0000 7f72e7e00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f72cc077fa0 0x7f72cc07a460 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72d8035000 tx=0x7f72d80046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.061+0000 7f72ecc00640 1 -- 172.21.15.81:0/240027265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f72e009f070 con 0x7f72d4003fd0 2024-09-10T20:41:45.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.285+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72f0073480 con 0x7f72d4003fd0 2024-09-10T20:41:45.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.285+0000 7f72ecc00640 1 -- 172.21.15.81:0/240027265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6534 (secure 0 0 0) 0x7f72e0062d80 con 0x7f72d4003fd0 2024-09-10T20:41:45.289 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:45.289 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-10T20:41:39:070176+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:45.290 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f72cc077fa0 msgr2=0x7f72cc07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f72cc077fa0 0x7f72cc07a460 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72d8035000 tx=0x7f72d80046c0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 msgr2=0x7f72f015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 0x7f72f015b600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f72e0011a50 tx=0x7f72e0011f10 comp rx=0 tx=0).stop 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 shutdown_connections 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f72cc077fa0 0x7f72cc07a460 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72f0140fc0 0x7f72f015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72f0140b40 0x7f72f015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 --2- 172.21.15.81:0/240027265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72d4003fd0 0x7f72f015b600 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 >> 172.21.15.81:0/240027265 conn(0x7f72f0068f90 msgr2=0x7f72f0073c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 shutdown_connections 2024-09-10T20:41:45.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.288+0000 7f72f6a00640 1 -- 172.21.15.81:0/240027265 wait complete. 2024-09-10T20:41:45.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.460+0000 7f898fe00640 1 -- 172.21.15.81:0/659812089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 msgr2=0x7f8988074020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.460+0000 7f898fe00640 1 --2- 172.21.15.81:0/659812089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f8988074020 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f897c005fd0 tx=0x7f897c02a540 comp rx=0 tx=0).stop 2024-09-10T20:41:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.460+0000 7f898fe00640 1 -- 172.21.15.81:0/659812089 shutdown_connections 2024-09-10T20:41:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.460+0000 7f898fe00640 1 --2- 172.21.15.81:0/659812089 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8988072b90 0x7f89880adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.460+0000 7f898fe00640 1 --2- 172.21.15.81:0/659812089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f8988074020 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.460+0000 7f898fe00640 1 -- 172.21.15.81:0/659812089 >> 172.21.15.81:0/659812089 conn(0x7f8988068f90 msgr2=0x7f898806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.460+0000 7f898fe00640 1 -- 172.21.15.81:0/659812089 shutdown_connections 2024-09-10T20:41:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.461+0000 7f898fe00640 1 -- 172.21.15.81:0/659812089 wait complete. 2024-09-10T20:41:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.462+0000 7f898fe00640 1 Processor -- start 2024-09-10T20:41:45.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.462+0000 7f898fe00640 1 -- start start 2024-09-10T20:41:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898fe00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8988072b90 0x7f8988136c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89880ad8a0 0x7f89881f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898fe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f89881603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898fe00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89880b4140 con 0x7f8988147470 2024-09-10T20:41:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f89880b3fc0 con 0x7f89880ad8a0 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898fe00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f89880b42c0 con 0x7f8988072b90 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f89881603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f89881603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35866/0 (socket says 172.21.15.81:35866) 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898de00640 1 -- 172.21.15.81:0/3882190205 learned_addr learned my addr 172.21.15.81:0/3882190205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.463+0000 7f898d400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8988072b90 0x7f8988136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898ca00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89880ad8a0 0x7f89881f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898de00640 1 -- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8988072b90 msgr2=0x7f8988136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898de00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8988072b90 0x7f8988136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898de00640 1 -- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89880ad8a0 msgr2=0x7f89881f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898de00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89880ad8a0 0x7f89881f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898de00640 1 -- 172.21.15.81:0/3882190205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8988137140 con 0x7f8988147470 2024-09-10T20:41:45.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898de00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f89881603b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8980009fd0 tx=0x7f898000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f8985600640 1 -- 172.21.15.81:0/3882190205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980017070 con 0x7f8988147470 2024-09-10T20:41:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f8985600640 1 -- 172.21.15.81:0/3882190205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8980003970 con 0x7f8988147470 2024-09-10T20:41:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8988155660 con 0x7f8988147470 2024-09-10T20:41:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.464+0000 7f8985600640 1 -- 172.21.15.81:0/3882190205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980003dc0 con 0x7f8988147470 2024-09-10T20:41:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.465+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8988143350 con 0x7f8988147470 2024-09-10T20:41:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.466+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89880b4770 con 0x7f8988147470 2024-09-10T20:41:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.467+0000 7f8985600640 1 -- 172.21.15.81:0/3882190205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8980004000 con 0x7f8988147470 2024-09-10T20:41:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.467+0000 7f8985600640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8968077f70 0x7f896807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.468+0000 7f8985600640 1 -- 172.21.15.81:0/3882190205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f898009a5d0 con 0x7f8988147470 2024-09-10T20:41:45.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.468+0000 7f898d400640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8968077f70 0x7f896807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.469+0000 7f898d400640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8968077f70 0x7f896807a430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f897c033000 tx=0x7f897c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:45.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.472+0000 7f8985600640 1 -- 172.21.15.81:0/3882190205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8988137140 con 0x7f8988147470 2024-09-10T20:41:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.692+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89880b21f0 con 0x7f8988147470 2024-09-10T20:41:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.692+0000 7f8985600640 1 -- 172.21.15.81:0/3882190205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6534 (secure 0 0 0) 0x7f8980062630 con 0x7f8988147470 2024-09-10T20:41:45.697 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:45.697 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-10T20:41:39:070176+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-10T20:41:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8968077f70 msgr2=0x7f896807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8968077f70 0x7f896807a430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f897c033000 tx=0x7f897c004730 comp rx=0 tx=0).stop 2024-09-10T20:41:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 msgr2=0x7f89881603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f89881603b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8980009fd0 tx=0x7f898000b260 comp rx=0 tx=0).stop 2024-09-10T20:41:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 shutdown_connections 2024-09-10T20:41:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8968077f70 0x7f896807a430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988147470 0x7f89881603b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89880ad8a0 0x7f89881f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 --2- 172.21.15.81:0/3882190205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8988072b90 0x7f8988136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 >> 172.21.15.81:0/3882190205 conn(0x7f8988068f90 msgr2=0x7f8988072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 shutdown_connections 2024-09-10T20:41:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.695+0000 7f898fe00640 1 -- 172.21.15.81:0/3882190205 wait complete. 2024-09-10T20:41:45.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.872+0000 7fef3ba00640 1 -- 172.21.15.81:0/1432943215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 msgr2=0x7fef34144e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.872+0000 7fef3ba00640 1 --2- 172.21.15.81:0/1432943215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef34144e90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fef28009830 tx=0x7fef2802a5c0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.872+0000 7fef3ba00640 1 -- 172.21.15.81:0/1432943215 shutdown_connections 2024-09-10T20:41:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.872+0000 7fef3ba00640 1 --2- 172.21.15.81:0/1432943215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef34144e90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.872+0000 7fef3ba00640 1 -- 172.21.15.81:0/1432943215 >> 172.21.15.81:0/1432943215 conn(0x7fef34068f90 msgr2=0x7fef3406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.872+0000 7fef3ba00640 1 -- 172.21.15.81:0/1432943215 shutdown_connections 2024-09-10T20:41:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.872+0000 7fef3ba00640 1 -- 172.21.15.81:0/1432943215 wait complete. 2024-09-10T20:41:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.874+0000 7fef3ba00640 1 Processor -- start 2024-09-10T20:41:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.874+0000 7fef3ba00640 1 -- start start 2024-09-10T20:41:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef3ba00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef341f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef3ba00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef3406f710 0x7fef3415c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef3ba00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef340cf070 0x7fef3415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef3ba00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef3406ecb0 con 0x7fef3406e8d0 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef3ba00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fef340b5010 con 0x7fef340cf070 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef3ba00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fef3406ee30 con 0x7fef3406f710 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef341f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef341f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35884/0 (socket says 172.21.15.81:35884) 2024-09-10T20:41:45.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 -- 172.21.15.81:0/2364827359 learned_addr learned my addr 172.21.15.81:0/2364827359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:45.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 -- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef3406f710 msgr2=0x7fef3415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39a00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef340cf070 0x7fef3415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef3406f710 0x7fef3415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 -- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef340cf070 msgr2=0x7fef3415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef340cf070 0x7fef3415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39000640 1 -- 172.21.15.81:0/2364827359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3415a7c0 con 0x7fef3406e8d0 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.875+0000 7fef39a00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef340cf070 0x7fef3415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.876+0000 7fef39000640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef341f4610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef28032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.876+0000 7fef30c00640 1 -- 172.21.15.81:0/2364827359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28040070 con 0x7fef3406e8d0 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.876+0000 7fef30c00640 1 -- 172.21.15.81:0/2364827359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef28003af0 con 0x7fef3406e8d0 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.876+0000 7fef30c00640 1 -- 172.21.15.81:0/2364827359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28045460 con 0x7fef3406e8d0 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.876+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef34159c40 con 0x7fef3406e8d0 2024-09-10T20:41:45.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.876+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3415a200 con 0x7fef3406e8d0 2024-09-10T20:41:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.877+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef34144e90 con 0x7fef3406e8d0 2024-09-10T20:41:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.878+0000 7fef30c00640 1 -- 172.21.15.81:0/2364827359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fef28045600 con 0x7fef3406e8d0 2024-09-10T20:41:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.879+0000 7fef30c00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fef14077f70 0x7fef1407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.879+0000 7fef30c00640 1 -- 172.21.15.81:0/2364827359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7fef280bbb60 con 0x7fef3406e8d0 2024-09-10T20:41:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.879+0000 7fef33e00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fef14077f70 0x7fef1407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.880+0000 7fef33e00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fef14077f70 0x7fef1407a430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f60 tx=0x7fef200079b0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:45.883+0000 7fef30c00640 1 -- 172.21.15.81:0/2364827359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fef28084220 con 0x7fef3406e8d0 2024-09-10T20:41:46.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.069+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef340737d0 con 0x7fef3406e8d0 2024-09-10T20:41:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.070+0000 7fef30c00640 1 -- 172.21.15.81:0/2364827359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+19199 (secure 0 0 0) 0x7fef28083b20 con 0x7fef3406e8d0 2024-09-10T20:41:46.074 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:46.074 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:33.027684+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-10T20:41:21.973646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.17","mappings":[{"from":1,"to":2}]},{"pgid":"6.1e","mappings":[{"from":3,"to":7}]},{"pgid":"6.28","mappings":[{"from":4,"to":7}]},{"pgid":"6.2b","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fef14077f70 msgr2=0x7fef1407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fef14077f70 0x7fef1407a430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef20000f60 tx=0x7fef200079b0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 msgr2=0x7fef341f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef341f4610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef28032d50 comp rx=0 tx=0).stop 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 shutdown_connections 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fef14077f70 0x7fef1407a430 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef340cf070 0x7fef3415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef3406f710 0x7fef3415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 --2- 172.21.15.81:0/2364827359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef3406e8d0 0x7fef341f4610 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 >> 172.21.15.81:0/2364827359 conn(0x7fef34068f90 msgr2=0x7fef340b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 shutdown_connections 2024-09-10T20:41:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.073+0000 7fef3ba00640 1 -- 172.21.15.81:0/2364827359 wait complete. 2024-09-10T20:41:46.094 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T20:41:46.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 -- 172.21.15.81:0/2359132576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b815ea60 msgr2=0x7f02b8073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 --2- 172.21.15.81:0/2359132576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b815ea60 0x7f02b8073dd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f02b8069460 tx=0x7f02b002aa30 comp rx=0 tx=0).stop 2024-09-10T20:41:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 -- 172.21.15.81:0/2359132576 shutdown_connections 2024-09-10T20:41:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 --2- 172.21.15.81:0/2359132576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b815ea60 0x7f02b8073dd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 --2- 172.21.15.81:0/2359132576 >> v2:172.21.15.143:3300/0 conn(0x7f02b81622f0 0x7f02b806f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 -- 172.21.15.81:0/2359132576 >> 172.21.15.81:0/2359132576 conn(0x7f02b8068f90 msgr2=0x7f02b806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 -- 172.21.15.81:0/2359132576 shutdown_connections 2024-09-10T20:41:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.247+0000 7f02c0200640 1 -- 172.21.15.81:0/2359132576 wait complete. 2024-09-10T20:41:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.249+0000 7f02c0200640 1 Processor -- start 2024-09-10T20:41:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.249+0000 7f02c0200640 1 -- start start 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02c0200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02b8073960 0x7f02b8149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02c0200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02b815ea60 0x7f02b815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02c0200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b81622f0 0x7f02b8149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02c0200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80b4070 con 0x7f02b81622f0 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02c0200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f02b80b3ef0 con 0x7f02b815ea60 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02c0200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f02b80b41f0 con 0x7f02b8073960 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b81622f0 0x7f02b8149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b81622f0 0x7f02b8149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35914/0 (socket says 172.21.15.81:35914) 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 -- 172.21.15.81:0/1980973663 learned_addr learned my addr 172.21.15.81:0/1980973663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02bce00640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02b815ea60 0x7f02b815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02bd800640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02b8073960 0x7f02b8149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 -- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02b8073960 msgr2=0x7f02b8149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02b8073960 0x7f02b8149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 -- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02b815ea60 msgr2=0x7f02b815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02b815ea60 0x7f02b815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.250+0000 7f02be200640 1 -- 172.21.15.81:0/1980973663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b815da70 con 0x7f02b81622f0 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.251+0000 7f02be200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b81622f0 0x7f02b8149330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f02b0005fd0 tx=0x7f02b0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.251+0000 7f02b5600640 1 -- 172.21.15.81:0/1980973663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0046070 con 0x7f02b81622f0 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.251+0000 7f02b5600640 1 -- 172.21.15.81:0/1980973663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02b002f690 con 0x7f02b81622f0 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.251+0000 7f02b5600640 1 -- 172.21.15.81:0/1980973663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0033050 con 0x7f02b81622f0 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.251+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b81594a0 con 0x7f02b81622f0 2024-09-10T20:41:46.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.251+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b8159a60 con 0x7f02b81622f0 2024-09-10T20:41:46.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.252+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b80b4780 con 0x7f02b81622f0 2024-09-10T20:41:46.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.253+0000 7f02b5600640 1 -- 172.21.15.81:0/1980973663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f02b0004490 con 0x7f02b81622f0 2024-09-10T20:41:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.254+0000 7f02b5600640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0298077fa0 0x7f029807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.254+0000 7f02b5600640 1 -- 172.21.15.81:0/1980973663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f02b00bb390 con 0x7f02b81622f0 2024-09-10T20:41:46.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.254+0000 7f02bd800640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0298077fa0 0x7f029807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.255+0000 7f02bd800640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0298077fa0 0x7f029807a460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009ac0 tx=0x7f02ac005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:46.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.258+0000 7f02b5600640 1 -- 172.21.15.81:0/1980973663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f02b0083a40 con 0x7f02b81622f0 2024-09-10T20:41:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.475+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02b8161ad0 con 0x7f02b81622f0 2024-09-10T20:41:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.475+0000 7f02b5600640 1 -- 172.21.15.81:0/1980973663 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6534 (secure 0 0 0) 0x7f02b0083340 con 0x7f02b81622f0 2024-09-10T20:41:46.479 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:46.480 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-10T20:41:39:070176+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:46.480 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0298077fa0 msgr2=0x7f029807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0298077fa0 0x7f029807a460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009ac0 tx=0x7f02ac005f90 comp rx=0 tx=0).stop 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b81622f0 msgr2=0x7f02b8149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b81622f0 0x7f02b8149330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f02b0005fd0 tx=0x7f02b0003f10 comp rx=0 tx=0).stop 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 shutdown_connections 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0298077fa0 0x7f029807a460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02b81622f0 0x7f02b8149330 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02b815ea60 0x7f02b815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 --2- 172.21.15.81:0/1980973663 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02b8073960 0x7f02b8149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 >> 172.21.15.81:0/1980973663 conn(0x7f02b8068f90 msgr2=0x7f02b815e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 shutdown_connections 2024-09-10T20:41:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.478+0000 7f02c0200640 1 -- 172.21.15.81:0/1980973663 wait complete. 2024-09-10T20:41:46.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.651+0000 7f0d92e00640 1 -- 172.21.15.81:0/515069446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06ead0 msgr2=0x7f0d8c15dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.651+0000 7f0d92e00640 1 --2- 172.21.15.81:0/515069446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06ead0 0x7f0d8c15dbf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009ca0 tx=0x7f0d8402aac0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.651+0000 7f0d92e00640 1 -- 172.21.15.81:0/515069446 shutdown_connections 2024-09-10T20:41:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.651+0000 7f0d92e00640 1 --2- 172.21.15.81:0/515069446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06ead0 0x7f0d8c15dbf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.651+0000 7f0d92e00640 1 -- 172.21.15.81:0/515069446 >> 172.21.15.81:0/515069446 conn(0x7f0d8c068f90 msgr2=0x7f0d8c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.651+0000 7f0d92e00640 1 -- 172.21.15.81:0/515069446 shutdown_connections 2024-09-10T20:41:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.651+0000 7f0d92e00640 1 -- 172.21.15.81:0/515069446 wait complete. 2024-09-10T20:41:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.652+0000 7f0d92e00640 1 Processor -- start 2024-09-10T20:41:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.652+0000 7f0d92e00640 1 -- start start 2024-09-10T20:41:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.653+0000 7f0d92e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06e660 0x7f0d8c13cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.653+0000 7f0d92e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d8c06ead0 0x7f0d8c1f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.653+0000 7f0d92e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d8c15ee50 0x7f0d8c151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.653+0000 7f0d92e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c15f3f0 con 0x7f0d8c06e660 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.653+0000 7f0d92e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c0ccd80 con 0x7f0d8c06ead0 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.653+0000 7f0d92e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c15e130 con 0x7f0d8c15ee50 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06e660 0x7f0d8c13cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06e660 0x7f0d8c13cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35936/0 (socket says 172.21.15.81:35936) 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 -- 172.21.15.81:0/2976388127 learned_addr learned my addr 172.21.15.81:0/2976388127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d90e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d8c15ee50 0x7f0d8c151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8b400640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d8c06ead0 0x7f0d8c1f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 -- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d8c15ee50 msgr2=0x7f0d8c151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d8c15ee50 0x7f0d8c151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 -- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d8c06ead0 msgr2=0x7f0d8c1f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d8c06ead0 0x7f0d8c1f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 -- 172.21.15.81:0/2976388127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c13d4d0 con 0x7f0d8c06e660 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d90e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d8c15ee50 0x7f0d8c151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8b400640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d8c06ead0 0x7f0d8c1f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d8be00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06e660 0x7f0d8c13cb80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c3a0 tx=0x7f0d7c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.654+0000 7f0d83e00640 1 -- 172.21.15.81:0/2976388127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c017070 con 0x7f0d8c06e660 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.655+0000 7f0d83e00640 1 -- 172.21.15.81:0/2976388127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d7c0053c0 con 0x7f0d8c06e660 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.655+0000 7f0d83e00640 1 -- 172.21.15.81:0/2976388127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c003850 con 0x7f0d8c06e660 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.655+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c13d7b0 con 0x7f0d8c06e660 2024-09-10T20:41:46.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.655+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c13dd70 con 0x7f0d8c06e660 2024-09-10T20:41:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.656+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8c15e670 con 0x7f0d8c06e660 2024-09-10T20:41:46.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.657+0000 7f0d83e00640 1 -- 172.21.15.81:0/2976388127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0d7c0039f0 con 0x7f0d8c06e660 2024-09-10T20:41:46.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.658+0000 7f0d83e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0d6c077f70 0x7f0d6c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:46.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.658+0000 7f0d83e00640 1 -- 172.21.15.81:0/2976388127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f0d7c099880 con 0x7f0d8c06e660 2024-09-10T20:41:46.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.658+0000 7f0d8b400640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0d6c077f70 0x7f0d6c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:46.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.659+0000 7f0d8b400640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0d6c077f70 0x7f0d6c07a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c142880 tx=0x7f0d78009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:46.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.662+0000 7f0d83e00640 1 -- 172.21.15.81:0/2976388127 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0d7c061ea0 con 0x7f0d8c06e660 2024-09-10T20:41:46.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.879+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d8c0b4910 con 0x7f0d8c06e660 2024-09-10T20:41:46.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.880+0000 7f0d83e00640 1 -- 172.21.15.81:0/2976388127 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+6534 (secure 0 0 0) 0x7f0d7c0617a0 con 0x7f0d8c06e660 2024-09-10T20:41:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:46.884 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-10T20:41:39:070176+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:40:57.190090+0000","modified":"2024-09-10T20:41:14.470297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2},{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:46.884 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-10T20:41:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0d6c077f70 msgr2=0x7f0d6c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0d6c077f70 0x7f0d6c07a430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c142880 tx=0x7f0d78009040 comp rx=0 tx=0).stop 2024-09-10T20:41:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06e660 msgr2=0x7f0d8c13cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06e660 0x7f0d8c13cb80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c3a0 tx=0x7f0d7c00c860 comp rx=0 tx=0).stop 2024-09-10T20:41:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 shutdown_connections 2024-09-10T20:41:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0d6c077f70 0x7f0d6c07a430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d8c15ee50 0x7f0d8c151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d8c06ead0 0x7f0d8c1f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 --2- 172.21.15.81:0/2976388127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d8c06e660 0x7f0d8c13cb80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 >> 172.21.15.81:0/2976388127 conn(0x7f0d8c068f90 msgr2=0x7f0d8c0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 shutdown_connections 2024-09-10T20:41:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:46.882+0000 7f0d92e00640 1 -- 172.21.15.81:0/2976388127 wait complete. 2024-09-10T20:41:46.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.057+0000 7f16c0c00640 1 -- 172.21.15.81:0/1297106384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0003a30 msgr2=0x7f16a0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.057+0000 7f16c0c00640 1 --2- 172.21.15.81:0/1297106384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0003a30 0x7f16a0003e10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f16ac006f90 tx=0x7f16a0005830 comp rx=0 tx=0).stop 2024-09-10T20:41:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.057+0000 7f16ba800640 1 -- 172.21.15.81:0/1297106384 reap_dead start 2024-09-10T20:41:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.057+0000 7f16c0c00640 1 -- 172.21.15.81:0/1297106384 shutdown_connections 2024-09-10T20:41:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.057+0000 7f16c0c00640 1 -- 172.21.15.81:0/1297106384 >> 172.21.15.81:0/1297106384 conn(0x7f16bc0d1b10 msgr2=0x7f16bc0d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.057+0000 7f16c0c00640 1 -- 172.21.15.81:0/1297106384 shutdown_connections 2024-09-10T20:41:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.057+0000 7f16c0c00640 1 -- 172.21.15.81:0/1297106384 wait complete. 2024-09-10T20:41:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.058+0000 7f16c0c00640 1 Processor -- start 2024-09-10T20:41:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.059+0000 7f16c0c00640 1 -- start start 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.059+0000 7f16c0c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16a0003a30 0x7f16bc0b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.059+0000 7f16c0c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16bc0b59b0 0x7f16bc0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.059+0000 7f16c0c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16bc1e4f70 0x7f16bc1e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.059+0000 7f16c0c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0d27b0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.059+0000 7f16c0c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0d2630 con 0x7f16bc0b59b0 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.059+0000 7f16c0c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc0d2930 con 0x7f16a0003a30 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16bc1e4f70 0x7f16bc1e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16bc1e4f70 0x7f16bc1e53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35954/0 (socket says 172.21.15.81:35954) 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 -- 172.21.15.81:0/1915331968 learned_addr learned my addr 172.21.15.81:0/1915331968 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16b9e00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16a0003a30 0x7f16bc0b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16b9400640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16bc0b59b0 0x7f16bc0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 -- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16a0003a30 msgr2=0x7f16bc0b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16a0003a30 0x7f16bc0b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 -- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16bc0b59b0 msgr2=0x7f16bc0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16bc0b59b0 0x7f16bc0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 -- 172.21.15.81:0/1915331968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc0b72c0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.060+0000 7f16ba800640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16bc1e4f70 0x7f16bc1e53f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16b4000f80 tx=0x7f16b4001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.061+0000 7f16b2000640 1 -- 172.21.15.81:0/1915331968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4011870 con 0x7f16bc1e4f70 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.061+0000 7f16b2000640 1 -- 172.21.15.81:0/1915331968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16b4017070 con 0x7f16bc1e4f70 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.061+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc0b6fe0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.061+0000 7f16b2000640 1 -- 172.21.15.81:0/1915331968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4011dc0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.061+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc15cfa0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.062+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16bc0b2c90 con 0x7f16bc1e4f70 2024-09-10T20:41:47.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.063+0000 7f16b2000640 1 -- 172.21.15.81:0/1915331968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f16b401c460 con 0x7f16bc1e4f70 2024-09-10T20:41:47.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.064+0000 7f16b2000640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f169c077fa0 0x7f169c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.064+0000 7f16b2000640 1 -- 172.21.15.81:0/1915331968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f16b409a8b0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.065+0000 7f16b9e00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f169c077fa0 0x7f169c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.066+0000 7f16b9e00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f169c077fa0 0x7f169c07a460 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16ac033000 tx=0x7f16ac0019a0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:47.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.069+0000 7f16b2000640 1 -- 172.21.15.81:0/1915331968 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f16b4062ed0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.253+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16bc06d1d0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.255+0000 7f16b2000640 1 -- 172.21.15.81:0/1915331968 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+19199 (secure 0 0 0) 0x7f16b40627d0 con 0x7f16bc1e4f70 2024-09-10T20:41:47.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:47.259 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:33.027684+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T20:40:54.952806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-10T20:41:21.973646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.17","mappings":[{"from":1,"to":2}]},{"pgid":"6.1e","mappings":[{"from":3,"to":7}]},{"pgid":"6.28","mappings":[{"from":4,"to":7}]},{"pgid":"6.2b","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f169c077fa0 msgr2=0x7f169c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f169c077fa0 0x7f169c07a460 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16ac033000 tx=0x7f16ac0019a0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16bc1e4f70 msgr2=0x7f16bc1e53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16bc1e4f70 0x7f16bc1e53f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f16b4000f80 tx=0x7f16b4001a90 comp rx=0 tx=0).stop 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 shutdown_connections 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f169c077fa0 0x7f169c07a460 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16bc1e4f70 0x7f16bc1e53f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16bc0b59b0 0x7f16bc0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 --2- 172.21.15.81:0/1915331968 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16a0003a30 0x7f16bc0b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 >> 172.21.15.81:0/1915331968 conn(0x7f16bc0d1b10 msgr2=0x7f16bc0d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 shutdown_connections 2024-09-10T20:41:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.257+0000 7f16c0c00640 1 -- 172.21.15.81:0/1915331968 wait complete. 2024-09-10T20:41:47.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 -- 172.21.15.81:0/460250745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 msgr2=0x7f41a80b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 --2- 172.21.15.81:0/460250745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 0x7f41a80b39d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41a0005fd0 tx=0x7f41a002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 -- 172.21.15.81:0/460250745 shutdown_connections 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 --2- 172.21.15.81:0/460250745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 0x7f41a80b39d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 --2- 172.21.15.81:0/460250745 >> v2:172.21.15.143:3300/0 conn(0x7f41a806ed70 0x7f41a80cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 -- 172.21.15.81:0/460250745 >> 172.21.15.81:0/460250745 conn(0x7f41a8068f90 msgr2=0x7f41a806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 -- 172.21.15.81:0/460250745 shutdown_connections 2024-09-10T20:41:47.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.434+0000 7f41b0400640 1 -- 172.21.15.81:0/460250745 wait complete. 2024-09-10T20:41:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.435+0000 7f41b0400640 1 Processor -- start 2024-09-10T20:41:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.435+0000 7f41b0400640 1 -- start start 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.436+0000 7f41b0400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41a806ed70 0x7f41a813dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.436+0000 7f41b0400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 0x7f41a80ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.436+0000 7f41b0400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a81453e0 0x7f41a813f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.436+0000 7f41b0400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80b3f10 con 0x7f41a81453e0 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.436+0000 7f41b0400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80cf200 con 0x7f41a806ed70 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.436+0000 7f41b0400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f41a80b4090 con 0x7f41a80b35a0 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a81453e0 0x7f41a813f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a81453e0 0x7f41a813f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35958/0 (socket says 172.21.15.81:35958) 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 -- 172.21.15.81:0/2157294800 learned_addr learned my addr 172.21.15.81:0/2157294800 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ad000640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 0x7f41a80ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ada00640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41a806ed70 0x7f41a813dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 -- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 msgr2=0x7f41a80ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 0x7f41a80ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 -- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41a806ed70 msgr2=0x7f41a813dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41a806ed70 0x7f41a813dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 -- 172.21.15.81:0/2157294800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a8140090 con 0x7f41a81453e0 2024-09-10T20:41:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.437+0000 7f41ae400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a81453e0 0x7f41a813f910 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f41a0006010 tx=0x7f41a0005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.438+0000 7f41a5600640 1 -- 172.21.15.81:0/2157294800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a003f070 con 0x7f41a81453e0 2024-09-10T20:41:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.438+0000 7f41a5600640 1 -- 172.21.15.81:0/2157294800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41a0003c90 con 0x7f41a81453e0 2024-09-10T20:41:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.438+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a8140370 con 0x7f41a81453e0 2024-09-10T20:41:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.438+0000 7f41a5600640 1 -- 172.21.15.81:0/2157294800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0035030 con 0x7f41a81453e0 2024-09-10T20:41:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.438+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a8140930 con 0x7f41a81453e0 2024-09-10T20:41:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.439+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a80cd5a0 con 0x7f41a81453e0 2024-09-10T20:41:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.440+0000 7f41a5600640 1 -- 172.21.15.81:0/2157294800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f41a0004a00 con 0x7f41a81453e0 2024-09-10T20:41:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.441+0000 7f41a5600640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4188077f70 0x7f418807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:47.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.441+0000 7f41a5600640 1 -- 172.21.15.81:0/2157294800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f41a00bb0a0 con 0x7f41a81453e0 2024-09-10T20:41:47.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.442+0000 7f41ada00640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4188077f70 0x7f418807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:47.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.442+0000 7f41ada00640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4188077f70 0x7f418807a430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41a8141320 tx=0x7f419c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:47.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.445+0000 7f41a5600640 1 -- 172.21.15.81:0/2157294800 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f41a0083070 con 0x7f41a81453e0 2024-09-10T20:41:47.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:41:47.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:41:47.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:47.661+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f41a80cca50 con 0x7f41a81453e0 2024-09-10T20:41:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.105+0000 7f41a5600640 1 -- 172.21.15.81:0/2157294800 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f41a0087aa0 con 0x7f41a81453e0 2024-09-10T20:41:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T20:41:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4188077f70 msgr2=0x7f418807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4188077f70 0x7f418807a430 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41a8141320 tx=0x7f419c009040 comp rx=0 tx=0).stop 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a81453e0 msgr2=0x7f41a813f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a81453e0 0x7f41a813f910 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f41a0006010 tx=0x7f41a0005770 comp rx=0 tx=0).stop 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 shutdown_connections 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4188077f70 0x7f418807a430 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41a81453e0 0x7f41a813f910 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f41a80b35a0 0x7f41a80ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 --2- 172.21.15.81:0/2157294800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41a806ed70 0x7f41a813dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 >> 172.21.15.81:0/2157294800 conn(0x7f41a8068f90 msgr2=0x7f41a815ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.107+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 shutdown_connections 2024-09-10T20:41:48.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.108+0000 7f41b0400640 1 -- 172.21.15.81:0/2157294800 wait complete. 2024-09-10T20:41:48.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.284+0000 7f0c42600640 1 -- 172.21.15.81:0/812972503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 msgr2=0x7f0c3c0afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.284+0000 7f0c42600640 1 --2- 172.21.15.81:0/812972503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c0afa20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c06d640 tx=0x7f0c3402a9a0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.285+0000 7f0c42600640 1 -- 172.21.15.81:0/812972503 shutdown_connections 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.285+0000 7f0c42600640 1 --2- 172.21.15.81:0/812972503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c0afa20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.285+0000 7f0c42600640 1 --2- 172.21.15.81:0/812972503 >> v2:172.21.15.143:3300/0 conn(0x7f0c3c15f060 0x7f0c3c0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.285+0000 7f0c42600640 1 -- 172.21.15.81:0/812972503 >> 172.21.15.81:0/812972503 conn(0x7f0c3c0d1a10 msgr2=0x7f0c3c0d1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.285+0000 7f0c42600640 1 -- 172.21.15.81:0/812972503 shutdown_connections 2024-09-10T20:41:48.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.285+0000 7f0c42600640 1 -- 172.21.15.81:0/812972503 wait complete. 2024-09-10T20:41:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.286+0000 7f0c42600640 1 Processor -- start 2024-09-10T20:41:48.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.286+0000 7f0c42600640 1 -- start start 2024-09-10T20:41:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.287+0000 7f0c42600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c1f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.287+0000 7f0c42600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c3c0cf980 0x7f0c3c14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:48.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.287+0000 7f0c42600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c3c15f060 0x7f0c3c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.287+0000 7f0c42600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c15f5c0 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.287+0000 7f0c42600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c15f440 con 0x7f0c3c0cf980 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.287+0000 7f0c42600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3c0aff60 con 0x7f0c3c15f060 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c1f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c1f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35982/0 (socket says 172.21.15.81:35982) 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 -- 172.21.15.81:0/3240476376 learned_addr learned my addr 172.21.15.81:0/3240476376 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c3be00640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c3c0cf980 0x7f0c3c14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41c00640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c3c15f060 0x7f0c3c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 -- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c3c15f060 msgr2=0x7f0c3c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c3c15f060 0x7f0c3c0b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 -- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c3c0cf980 msgr2=0x7f0c3c14d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c3c0cf980 0x7f0c3c14d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 -- 172.21.15.81:0/3240476376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c14dac0 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c3be00640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c3c0cf980 0x7f0c3c14d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.288+0000 7f0c41200640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c1f81e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c9a0 tx=0x7f0c3000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.289+0000 7f0c38c00640 1 -- 172.21.15.81:0/3240476376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30007bb0 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.289+0000 7f0c38c00640 1 -- 172.21.15.81:0/3240476376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c30007e40 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.289+0000 7f0c38c00640 1 -- 172.21.15.81:0/3240476376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000f690 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.289+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3c0b5390 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.289+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3c1f7700 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.290+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3c0afa20 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.291+0000 7f0c38c00640 1 -- 172.21.15.81:0/3240476376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f0c30020030 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.292+0000 7f0c38c00640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0c1c077f70 0x7f0c1c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.292+0000 7f0c38c00640 1 -- 172.21.15.81:0/3240476376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7f0c3009a7c0 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.293+0000 7f0c3be00640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0c1c077f70 0x7f0c1c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.294+0000 7f0c3be00640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0c1c077f70 0x7f0c1c07a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c28001750 tx=0x7f0c28009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:48.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.297+0000 7f0c38c00640 1 -- 172.21.15.81:0/3240476376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f0c30014030 con 0x7f0c3c0af5d0 2024-09-10T20:41:48.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:48.517+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0c3c1566b0 con 0x7f0c3c0af5d0 2024-09-10T20:41:49.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.107+0000 7f0c38c00640 1 -- 172.21.15.81:0/3240476376 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f0c30062de0 con 0x7f0c3c0af5d0 2024-09-10T20:41:49.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0c1c077f70 msgr2=0x7f0c1c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0c1c077f70 0x7f0c1c07a430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c28001750 tx=0x7f0c28009040 comp rx=0 tx=0).stop 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 msgr2=0x7f0c3c1f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c1f81e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c9a0 tx=0x7f0c3000ce60 comp rx=0 tx=0).stop 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 shutdown_connections 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0c1c077f70 0x7f0c1c07a430 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0c3c15f060 0x7f0c3c0b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c3c0cf980 0x7f0c3c14d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 --2- 172.21.15.81:0/3240476376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0af5d0 0x7f0c3c1f81e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.109+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 >> 172.21.15.81:0/3240476376 conn(0x7f0c3c0d1a10 msgr2=0x7f0c3c0d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:49.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.110+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 shutdown_connections 2024-09-10T20:41:49.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.110+0000 7f0c42600640 1 -- 172.21.15.81:0/3240476376 wait complete. 2024-09-10T20:41:49.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 -- 172.21.15.81:0/4228910063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 msgr2=0x7fbee40cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 --2- 172.21.15.81:0/4228910063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 0x7fbee40cac60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005fd0 tx=0x7fbed002a4b0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 -- 172.21.15.81:0/4228910063 shutdown_connections 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 --2- 172.21.15.81:0/4228910063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbee40b51b0 0x7fbee40cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 --2- 172.21.15.81:0/4228910063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 0x7fbee40cac60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 -- 172.21.15.81:0/4228910063 >> 172.21.15.81:0/4228910063 conn(0x7fbee40cc480 msgr2=0x7fbee40cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 -- 172.21.15.81:0/4228910063 shutdown_connections 2024-09-10T20:41:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.288+0000 7fbeeae00640 1 -- 172.21.15.81:0/4228910063 wait complete. 2024-09-10T20:41:49.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.290+0000 7fbeeae00640 1 Processor -- start 2024-09-10T20:41:49.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.290+0000 7fbeeae00640 1 -- start start 2024-09-10T20:41:49.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeeae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 0x7fbee40a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:49.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeeae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbee40b51b0 0x7fbee40c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:49.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeeae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee415f020 0x7fbee41f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:49.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeeae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbee40cb6e0 con 0x7fbee415f020 2024-09-10T20:41:49.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeeae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbee40cd2d0 con 0x7fbee40af140 2024-09-10T20:41:49.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeeae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbee40cb860 con 0x7fbee40b51b0 2024-09-10T20:41:49.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeea400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee415f020 0x7fbee41f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:49.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeea400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee415f020 0x7fbee41f1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35998/0 (socket says 172.21.15.81:35998) 2024-09-10T20:41:49.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.291+0000 7fbeea400640 1 -- 172.21.15.81:0/1330729903 learned_addr learned my addr 172.21.15.81:0/1330729903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:49.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbee9000640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbee40b51b0 0x7fbee40c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:49.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbee9a00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 0x7fbee40a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:49.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbeea400640 1 -- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbee40b51b0 msgr2=0x7fbee40c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbeea400640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbee40b51b0 0x7fbee40c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbeea400640 1 -- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 msgr2=0x7fbee40a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbeea400640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 0x7fbee40a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbeea400640 1 -- 172.21.15.81:0/1330729903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee40acb70 con 0x7fbee415f020 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbeea400640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee415f020 0x7fbee41f1f80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00eb10 tx=0x7fbedc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.292+0000 7fbee1600640 1 -- 172.21.15.81:0/1330729903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc004b20 con 0x7fbee415f020 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.293+0000 7fbee1600640 1 -- 172.21.15.81:0/1330729903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbedc004ce0 con 0x7fbee415f020 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.293+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee41f2a00 con 0x7fbee415f020 2024-09-10T20:41:49.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.293+0000 7fbee1600640 1 -- 172.21.15.81:0/1330729903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc005280 con 0x7fbee415f020 2024-09-10T20:41:49.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.293+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee40ad0d0 con 0x7fbee415f020 2024-09-10T20:41:49.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.294+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee40cbd50 con 0x7fbee415f020 2024-09-10T20:41:49.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.295+0000 7fbee1600640 1 -- 172.21.15.81:0/1330729903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbedc005420 con 0x7fbee415f020 2024-09-10T20:41:49.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.296+0000 7fbee1600640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbec4077f70 0x7fbec407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:49.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.296+0000 7fbee1600640 1 -- 172.21.15.81:0/1330729903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6785+0+0 (secure 0 0 0) 0x7fbedc09ae90 con 0x7fbee415f020 2024-09-10T20:41:49.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.296+0000 7fbee9a00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbec4077f70 0x7fbec407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:49.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.297+0000 7fbee9a00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbec4077f70 0x7fbec407a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbed8007fd0 tx=0x7fbed8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:49.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.300+0000 7fbee1600640 1 -- 172.21.15.81:0/1330729903 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbee41f2a00 con 0x7fbee415f020 2024-09-10T20:41:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:49.481+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbee40b00d0 con 0x7fbee415f020 2024-09-10T20:41:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.117+0000 7fbee1600640 1 -- 172.21.15.81:0/1330729903 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) ==== 181+0+0 (secure 0 0 0) 0x7fbedc09c0d0 con 0x7fbee415f020 2024-09-10T20:41:50.121 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.119+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbec4077f70 msgr2=0x7fbec407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.119+0000 7fbeeae00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbec4077f70 0x7fbec407a430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbed8007fd0 tx=0x7fbed8009040 comp rx=0 tx=0).stop 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.119+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee415f020 msgr2=0x7fbee41f1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.119+0000 7fbeeae00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee415f020 0x7fbee41f1f80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00eb10 tx=0x7fbedc00c2d0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 shutdown_connections 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbec4077f70 0x7fbec407a430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee415f020 0x7fbee41f1f80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbee40b51b0 0x7fbee40c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 --2- 172.21.15.81:0/1330729903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbee40af140 0x7fbee40a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 >> 172.21.15.81:0/1330729903 conn(0x7fbee40cc480 msgr2=0x7fbee40c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 shutdown_connections 2024-09-10T20:41:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.120+0000 7fbeeae00640 1 -- 172.21.15.81:0/1330729903 wait complete. 2024-09-10T20:41:50.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T20:41:50.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 -- 172.21.15.81:0/4170775127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d0073490 msgr2=0x7fe0d00cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 --2- 172.21.15.81:0/4170775127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d0073490 0x7fe0d00cbf10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc005fd0 tx=0x7fe0bc02a5d0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 -- 172.21.15.81:0/4170775127 shutdown_connections 2024-09-10T20:41:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 --2- 172.21.15.81:0/4170775127 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0d00b2ac0 0x7fe0d00cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 --2- 172.21.15.81:0/4170775127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d0073490 0x7fe0d00cbf10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 -- 172.21.15.81:0/4170775127 >> 172.21.15.81:0/4170775127 conn(0x7fe0d0069020 msgr2=0x7fe0d006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 -- 172.21.15.81:0/4170775127 shutdown_connections 2024-09-10T20:41:50.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.301+0000 7fe0d7400640 1 -- 172.21.15.81:0/4170775127 wait complete. 2024-09-10T20:41:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.303+0000 7fe0d7400640 1 Processor -- start 2024-09-10T20:41:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.303+0000 7fe0d7400640 1 -- start start 2024-09-10T20:41:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d7400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d0073490 0x7fe0d015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d7400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0d00b2ac0 0x7fe0d00ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d7400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0d00cbb30 0x7fe0d00ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d7400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d0164ca0 con 0x7fe0d0073490 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d7400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d0164b20 con 0x7fe0d00cbb30 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d7400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d0164e20 con 0x7fe0d00b2ac0 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d0073490 0x7fe0d015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d4a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d0073490 0x7fe0d015d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36012/0 (socket says 172.21.15.81:36012) 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.304+0000 7fe0d4a00640 1 -- 172.21.15.81:0/704819356 learned_addr learned my addr 172.21.15.81:0/704819356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0cfe00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0d00b2ac0 0x7fe0d00ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d5400640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0d00cbb30 0x7fe0d00ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d4a00640 1 -- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0d00b2ac0 msgr2=0x7fe0d00ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d4a00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0d00b2ac0 0x7fe0d00ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d4a00640 1 -- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0d00cbb30 msgr2=0x7fe0d00ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d4a00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0d00cbb30 0x7fe0d00ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d4a00640 1 -- 172.21.15.81:0/704819356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d013ce50 con 0x7fe0d0073490 2024-09-10T20:41:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0cfe00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe0d00b2ac0 0x7fe0d00ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d5400640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe0d00cbb30 0x7fe0d00ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d4a00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d0073490 0x7fe0d015d840 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c3c0 tx=0x7fe0c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0ccc00640 1 -- 172.21.15.81:0/704819356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0017070 con 0x7fe0d0073490 2024-09-10T20:41:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0ccc00640 1 -- 172.21.15.81:0/704819356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0c00035f0 con 0x7fe0d0073490 2024-09-10T20:41:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0ccc00640 1 -- 172.21.15.81:0/704819356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0003a80 con 0x7fe0d0073490 2024-09-10T20:41:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d7400640 1 -- 172.21.15.81:0/704819356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d013d130 con 0x7fe0d0073490 2024-09-10T20:41:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.305+0000 7fe0d7400640 1 -- 172.21.15.81:0/704819356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d013d6f0 con 0x7fe0d0073490 2024-09-10T20:41:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.306+0000 7fe0d7400640 1 -- 172.21.15.81:0/704819356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d00cedc0 con 0x7fe0d0073490 2024-09-10T20:41:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.307+0000 7fe0ccc00640 1 -- 172.21.15.81:0/704819356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe0c0003c20 con 0x7fe0d0073490 2024-09-10T20:41:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.308+0000 7fe0ccc00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0b0077f70 0x7fe0b007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.308+0000 7fe0ccc00640 1 -- 172.21.15.81:0/704819356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6347+0+0 (secure 0 0 0) 0x7fe0c00995d0 con 0x7fe0d0073490 2024-09-10T20:41:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.309+0000 7fe0cfe00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0b0077f70 0x7fe0b007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.310+0000 7fe0cfe00640 1 --2- 172.21.15.81:0/704819356 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe0b0077f70 0x7fe0b007a430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc033000 tx=0x7fe0bc004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.312+0000 7fe0ccc00640 1 -- 172.21.15.81:0/704819356 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe0c0061e40 con 0x7fe0d0073490 2024-09-10T20:41:50.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.497+0000 7fe0d7400640 1 -- 172.21.15.81:0/704819356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0d0141140 con 0x7fe0d0073490 2024-09-10T20:41:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.498+0000 7fe0ccc00640 1 -- 172.21.15.81:0/704819356 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=-16 pool 'cephfs_data' is in use by CephFS v51) ==== 181+0+0 (secure 0 0 0) 0x7fe0c0061740 con 0x7fe0d0073490 2024-09-10T20:41:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:Error EBUSY: pool 'cephfs_data' is in use by CephFS 2024-09-10T20:41:50.511 DEBUG:teuthology.orchestra.run:got remote process result: 16 2024-09-10T20:41:50.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:50.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.666+0000 7f4d97800640 1 -- 172.21.15.81:0/1125630559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 msgr2=0x7f4d74003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.666+0000 7f4d97800640 1 --2- 172.21.15.81:0/1125630559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d74003e70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4d900b5190 tx=0x7f4d74005830 comp rx=0 tx=0).stop 2024-09-10T20:41:50.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.666+0000 7f4d95800640 1 -- 172.21.15.81:0/1125630559 reap_dead start 2024-09-10T20:41:50.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.666+0000 7f4d97800640 1 -- 172.21.15.81:0/1125630559 shutdown_connections 2024-09-10T20:41:50.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.666+0000 7f4d97800640 1 -- 172.21.15.81:0/1125630559 >> 172.21.15.81:0/1125630559 conn(0x7f4d90068f90 msgr2=0x7f4d9006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:50.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.666+0000 7f4d97800640 1 -- 172.21.15.81:0/1125630559 shutdown_connections 2024-09-10T20:41:50.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.666+0000 7f4d97800640 1 -- 172.21.15.81:0/1125630559 wait complete. 2024-09-10T20:41:50.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.668+0000 7f4d97800640 1 Processor -- start 2024-09-10T20:41:50.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.668+0000 7f4d97800640 1 -- start start 2024-09-10T20:41:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d97800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d90143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d97800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d901ea480 0x7f4d901ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d97800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d90130c50 0x7f4d90131100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d97800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d90072c40 con 0x7f4d74003a50 2024-09-10T20:41:50.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d97800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4d90072ac0 con 0x7f4d90130c50 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d97800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4d900af3a0 con 0x7f4d901ea480 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d94e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d90143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d94e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d90143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36036/0 (socket says 172.21.15.81:36036) 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.669+0000 7f4d94e00640 1 -- 172.21.15.81:0/2016389205 learned_addr learned my addr 172.21.15.81:0/2016389205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d95800640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d90130c50 0x7f4d90131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d8fe00640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d901ea480 0x7f4d901ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d94e00640 1 -- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d901ea480 msgr2=0x7f4d901ea900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d94e00640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d901ea480 0x7f4d901ea900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d94e00640 1 -- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d90130c50 msgr2=0x7f4d90131100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d94e00640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d90130c50 0x7f4d90131100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d94e00640 1 -- 172.21.15.81:0/2016389205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d901e93e0 con 0x7f4d74003a50 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d94e00640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d90143d50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000c00 tx=0x7f4d80001d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:50.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d8cc00640 1 -- 172.21.15.81:0/2016389205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80031040 con 0x7f4d74003a50 2024-09-10T20:41:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d8cc00640 1 -- 172.21.15.81:0/2016389205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d800065e0 con 0x7f4d74003a50 2024-09-10T20:41:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d8cc00640 1 -- 172.21.15.81:0/2016389205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80003a60 con 0x7f4d74003a50 2024-09-10T20:41:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.670+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d901e96c0 con 0x7f4d74003a50 2024-09-10T20:41:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.671+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d901e9c80 con 0x7f4d74003a50 2024-09-10T20:41:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.671+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d900adcf0 con 0x7f4d74003a50 2024-09-10T20:41:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.672+0000 7f4d8cc00640 1 -- 172.21.15.81:0/2016389205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f4d80003c00 con 0x7f4d74003a50 2024-09-10T20:41:50.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.673+0000 7f4d8cc00640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d70077fa0 0x7f4d7007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:50.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.673+0000 7f4d8cc00640 1 -- 172.21.15.81:0/2016389205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6347+0+0 (secure 0 0 0) 0x7f4d800ba0f0 con 0x7f4d74003a50 2024-09-10T20:41:50.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.674+0000 7f4d8fe00640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d70077fa0 0x7f4d7007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:50.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.674+0000 7f4d8fe00640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d70077fa0 0x7f4d7007a460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d90157d50 tx=0x7f4d7c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:50.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.677+0000 7f4d8cc00640 1 -- 172.21.15.81:0/2016389205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f4d80082ae0 con 0x7f4d74003a50 2024-09-10T20:41:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.895+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d9006d6a0 con 0x7f4d74003a50 2024-09-10T20:41:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.896+0000 7f4d8cc00640 1 -- 172.21.15.81:0/2016389205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5235 (secure 0 0 0) 0x7f4d800823e0 con 0x7f4d74003a50 2024-09-10T20:41:50.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:50.900 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-10T20:41:49:105840+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:50.900 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d70077fa0 msgr2=0x7f4d7007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d70077fa0 0x7f4d7007a460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d90157d50 tx=0x7f4d7c005f90 comp rx=0 tx=0).stop 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 msgr2=0x7f4d90143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d90143d50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000c00 tx=0x7f4d80001d60 comp rx=0 tx=0).stop 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 shutdown_connections 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f4d70077fa0 0x7f4d7007a460 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4d90130c50 0x7f4d90131100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4d901ea480 0x7f4d901ea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 --2- 172.21.15.81:0/2016389205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d90143d50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 >> 172.21.15.81:0/2016389205 conn(0x7f4d90068f90 msgr2=0x7f4d900b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 shutdown_connections 2024-09-10T20:41:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:50.898+0000 7f4d97800640 1 -- 172.21.15.81:0/2016389205 wait complete. 2024-09-10T20:41:50.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.074+0000 7f23e6600640 1 -- 172.21.15.81:0/4041246363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00cf240 msgr2=0x7f23e00d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.074+0000 7f23e6600640 1 --2- 172.21.15.81:0/4041246363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00cf240 0x7f23e00d1d40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f23e006a2a0 tx=0x7f23cc02a560 comp rx=0 tx=0).stop 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.074+0000 7f23e6600640 1 -- 172.21.15.81:0/4041246363 shutdown_connections 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.075+0000 7f23e6600640 1 --2- 172.21.15.81:0/4041246363 >> v2:172.21.15.143:3300/0 conn(0x7f23e00d2280 0x7f23e00d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.075+0000 7f23e6600640 1 --2- 172.21.15.81:0/4041246363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00cf240 0x7f23e00d1d40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.075+0000 7f23e6600640 1 --2- 172.21.15.81:0/4041246363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e015df60 0x7f23e00d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.075+0000 7f23e6600640 1 -- 172.21.15.81:0/4041246363 >> 172.21.15.81:0/4041246363 conn(0x7f23e00d3cc0 msgr2=0x7f23e00d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.075+0000 7f23e6600640 1 -- 172.21.15.81:0/4041246363 shutdown_connections 2024-09-10T20:41:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.075+0000 7f23e6600640 1 -- 172.21.15.81:0/4041246363 wait complete. 2024-09-10T20:41:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.076+0000 7f23e6600640 1 Processor -- start 2024-09-10T20:41:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.076+0000 7f23e6600640 1 -- start start 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23e6600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e00cf240 0x7f23e0154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23e6600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d2280 0x7f23e00b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23e6600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e015df60 0x7f23e00b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23e6600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00d0fa0 con 0x7f23e00d2280 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23e6600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00d0e20 con 0x7f23e015df60 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23e6600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f23e00d1120 con 0x7f23e00cf240 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23dfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d2280 0x7f23e00b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.077+0000 7f23dfe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d2280 0x7f23e00b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36042/0 (socket says 172.21.15.81:36042) 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dfe00640 1 -- 172.21.15.81:0/1825449954 learned_addr learned my addr 172.21.15.81:0/1825449954 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23e5200640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e00cf240 0x7f23e0154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23e5c00640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e015df60 0x7f23e00b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dfe00640 1 -- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e00cf240 msgr2=0x7f23e0154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dfe00640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e00cf240 0x7f23e0154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dfe00640 1 -- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e015df60 msgr2=0x7f23e00b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dfe00640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e015df60 0x7f23e00b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dfe00640 1 -- 172.21.15.81:0/1825449954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e0154aa0 con 0x7f23e00d2280 2024-09-10T20:41:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dfe00640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d2280 0x7f23e00b5730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f23cc02ab50 tx=0x7f23cc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.078+0000 7f23dcc00640 1 -- 172.21.15.81:0/1825449954 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc03f070 con 0x7f23e00d2280 2024-09-10T20:41:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.079+0000 7f23dcc00640 1 -- 172.21.15.81:0/1825449954 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23cc004890 con 0x7f23e00d2280 2024-09-10T20:41:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.079+0000 7f23dcc00640 1 -- 172.21.15.81:0/1825449954 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc035030 con 0x7f23e00d2280 2024-09-10T20:41:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.079+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01f7e10 con 0x7f23e00d2280 2024-09-10T20:41:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.079+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e01f80d0 con 0x7f23e00d2280 2024-09-10T20:41:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.080+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e00b3430 con 0x7f23e00d2280 2024-09-10T20:41:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.081+0000 7f23dcc00640 1 -- 172.21.15.81:0/1825449954 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f23cc004ce0 con 0x7f23e00d2280 2024-09-10T20:41:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.082+0000 7f23dcc00640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f23c0077f70 0x7f23c007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.082+0000 7f23dcc00640 1 -- 172.21.15.81:0/1825449954 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6347+0+0 (secure 0 0 0) 0x7f23cc0bb230 con 0x7f23e00d2280 2024-09-10T20:41:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.082+0000 7f23e5200640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f23c0077f70 0x7f23c007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.083+0000 7f23e5200640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f23c0077f70 0x7f23c007a430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098e0 tx=0x7f23d4009060 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:51.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.086+0000 7f23dcc00640 1 -- 172.21.15.81:0/1825449954 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f23cc083450 con 0x7f23e00d2280 2024-09-10T20:41:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.271+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23e00b1b00 con 0x7f23e00d2280 2024-09-10T20:41:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.272+0000 7f23dcc00640 1 -- 172.21.15.81:0/1825449954 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17308 (secure 0 0 0) 0x7f23cc087e80 con 0x7f23e00d2280 2024-09-10T20:41:51.277 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:51.277 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":51,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:50.112422+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-10T20:41:21.973646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.17","mappings":[{"from":1,"to":2}]},{"pgid":"6.1e","mappings":[{"from":3,"to":7}]},{"pgid":"6.28","mappings":[{"from":4,"to":7}]},{"pgid":"6.2b","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f23c0077f70 msgr2=0x7f23c007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f23c0077f70 0x7f23c007a430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23d40098e0 tx=0x7f23d4009060 comp rx=0 tx=0).stop 2024-09-10T20:41:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d2280 msgr2=0x7f23e00b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d2280 0x7f23e00b5730 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f23cc02ab50 tx=0x7f23cc0039e0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 shutdown_connections 2024-09-10T20:41:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f23c0077f70 0x7f23c007a430 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f23e015df60 0x7f23e00b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d2280 0x7f23e00b5730 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 --2- 172.21.15.81:0/1825449954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f23e00cf240 0x7f23e0154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 >> 172.21.15.81:0/1825449954 conn(0x7f23e00d3cc0 msgr2=0x7f23e00b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 shutdown_connections 2024-09-10T20:41:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.275+0000 7f23e6600640 1 -- 172.21.15.81:0/1825449954 wait complete. 2024-09-10T20:41:51.295 INFO:tasks.cephfs.filesystem:Destroying file system recovery_fs and related pools 2024-09-10T20:41:51.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.450+0000 7fe611200640 1 -- 172.21.15.81:0/3353696446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 msgr2=0x7fe5f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.450+0000 7fe611200640 1 --2- 172.21.15.81:0/3353696446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 0x7fe5f0003e70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc006f80 tx=0x7fe5f0005830 comp rx=0 tx=0).stop 2024-09-10T20:41:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.450+0000 7fe60a800640 1 -- 172.21.15.81:0/3353696446 reap_dead start 2024-09-10T20:41:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.450+0000 7fe611200640 1 -- 172.21.15.81:0/3353696446 shutdown_connections 2024-09-10T20:41:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.450+0000 7fe611200640 1 -- 172.21.15.81:0/3353696446 >> 172.21.15.81:0/3353696446 conn(0x7fe60c068f90 msgr2=0x7fe60c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.450+0000 7fe611200640 1 -- 172.21.15.81:0/3353696446 shutdown_connections 2024-09-10T20:41:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.450+0000 7fe611200640 1 -- 172.21.15.81:0/3353696446 wait complete. 2024-09-10T20:41:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.451+0000 7fe611200640 1 Processor -- start 2024-09-10T20:41:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.452+0000 7fe611200640 1 -- start start 2024-09-10T20:41:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.452+0000 7fe611200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 0x7fe60c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.452+0000 7fe611200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe60c1f8d30 0x7fe60c0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.452+0000 7fe611200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe60c0c68b0 0x7fe60c15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.452+0000 7fe611200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c0b39d0 con 0x7fe5f0003a50 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.452+0000 7fe611200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c0cf200 con 0x7fe60c0c68b0 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.452+0000 7fe611200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe60c0b3b50 con 0x7fe60c1f8d30 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 0x7fe60c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 0x7fe60c0b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36058/0 (socket says 172.21.15.81:36058) 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 -- 172.21.15.81:0/242573767 learned_addr learned my addr 172.21.15.81:0/242573767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609400640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe60c1f8d30 0x7fe60c0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe60a800640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe60c0c68b0 0x7fe60c15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 -- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe60c1f8d30 msgr2=0x7fe60c0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe60c1f8d30 0x7fe60c0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 -- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe60c0c68b0 msgr2=0x7fe60c15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe60c0c68b0 0x7fe60c15b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 -- 172.21.15.81:0/242573767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c140580 con 0x7fe5f0003a50 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609400640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe60c1f8d30 0x7fe60c0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe60a800640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe60c0c68b0 0x7fe60c15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.453+0000 7fe609e00640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 0x7fe60c0b0d40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00c350 tx=0x7fe5fc006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.454+0000 7fe602000640 1 -- 172.21.15.81:0/242573767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc032030 con 0x7fe5f0003a50 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.454+0000 7fe602000640 1 -- 172.21.15.81:0/242573767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5fc003be0 con 0x7fe5f0003a50 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.454+0000 7fe602000640 1 -- 172.21.15.81:0/242573767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc037450 con 0x7fe5f0003a50 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.454+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c0c6ee0 con 0x7fe5f0003a50 2024-09-10T20:41:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.454+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c1f8530 con 0x7fe5f0003a50 2024-09-10T20:41:51.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.455+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60c0ce610 con 0x7fe5f0003a50 2024-09-10T20:41:51.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.456+0000 7fe602000640 1 -- 172.21.15.81:0/242573767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe5fc037610 con 0x7fe5f0003a50 2024-09-10T20:41:51.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.457+0000 7fe602000640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5ec077f70 0x7fe5ec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.457+0000 7fe602000640 1 -- 172.21.15.81:0/242573767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6347+0+0 (secure 0 0 0) 0x7fe5fc0ba7a0 con 0x7fe5f0003a50 2024-09-10T20:41:51.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.457+0000 7fe609400640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5ec077f70 0x7fe5ec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.458+0000 7fe609400640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5ec077f70 0x7fe5ec07a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0cc1c0 tx=0x7fe5f8005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.461+0000 7fe602000640 1 -- 172.21.15.81:0/242573767 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe60c0ce610 con 0x7fe5f0003a50 2024-09-10T20:41:51.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.684+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe60c1f8070 con 0x7fe5f0003a50 2024-09-10T20:41:51.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.684+0000 7fe602000640 1 -- 172.21.15.81:0/242573767 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5235 (secure 0 0 0) 0x7fe60c1f8070 con 0x7fe5f0003a50 2024-09-10T20:41:51.688 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:51.688 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-10T20:41:49:105840+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:51.689 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-10T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5ec077f70 msgr2=0x7fe5ec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5ec077f70 0x7fe5ec07a430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0cc1c0 tx=0x7fe5f8005f90 comp rx=0 tx=0).stop 2024-09-10T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 msgr2=0x7fe60c0b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 0x7fe60c0b0d40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00c350 tx=0x7fe5fc006650 comp rx=0 tx=0).stop 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 shutdown_connections 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5ec077f70 0x7fe5ec07a430 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe60c0c68b0 0x7fe60c15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe60c1f8d30 0x7fe60c0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 --2- 172.21.15.81:0/242573767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f0003a50 0x7fe60c0b0d40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 >> 172.21.15.81:0/242573767 conn(0x7fe60c068f90 msgr2=0x7fe60c0cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 shutdown_connections 2024-09-10T20:41:51.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.687+0000 7fe611200640 1 -- 172.21.15.81:0/242573767 wait complete. 2024-09-10T20:41:51.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:41:51.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2958174245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a00ceff0 msgr2=0x7fd3a006e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2958174245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a00ceff0 0x7fd3a006e660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd38c005fd0 tx=0x7fd38c02a530 comp rx=0 tx=0).stop 2024-09-10T20:41:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2958174245 shutdown_connections 2024-09-10T20:41:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2958174245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a00ceff0 0x7fd3a006e660 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2958174245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3a01453e0 0x7fd3a00cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2958174245 >> 172.21.15.81:0/2958174245 conn(0x7fd3a0068f90 msgr2=0x7fd3a006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2958174245 shutdown_connections 2024-09-10T20:41:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.859+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2958174245 wait complete. 2024-09-10T20:41:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.861+0000 7fd3a5c00640 1 Processor -- start 2024-09-10T20:41:51.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.861+0000 7fd3a5c00640 1 -- start start 2024-09-10T20:41:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd3a5c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3a006eba0 0x7fd3a01f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd3a5c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3a00ceff0 0x7fd3a01f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd3a5c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a01453e0 0x7fd3a013cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd3a5c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a00b47d0 con 0x7fd3a01453e0 2024-09-10T20:41:51.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd3a5c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a00b4650 con 0x7fd3a00ceff0 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd3a5c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a00b4950 con 0x7fd3a006eba0 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd39f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a01453e0 0x7fd3a013cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd39f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a01453e0 0x7fd3a013cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36088/0 (socket says 172.21.15.81:36088) 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd39f400640 1 -- 172.21.15.81:0/2031994004 learned_addr learned my addr 172.21.15.81:0/2031994004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd39ea00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3a006eba0 0x7fd3a01f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.862+0000 7fd39e000640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3a00ceff0 0x7fd3a01f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd39f400640 1 -- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3a006eba0 msgr2=0x7fd3a01f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd39f400640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3a006eba0 0x7fd3a01f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd39f400640 1 -- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3a00ceff0 msgr2=0x7fd3a01f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd39f400640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3a00ceff0 0x7fd3a01f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd39f400640 1 -- 172.21.15.81:0/2031994004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a01f94e0 con 0x7fd3a01453e0 2024-09-10T20:41:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd39f400640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a01453e0 0x7fd3a013cf10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c780 tx=0x7fd39800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd396a00640 1 -- 172.21.15.81:0/2031994004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398004b60 con 0x7fd3a01453e0 2024-09-10T20:41:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd396a00640 1 -- 172.21.15.81:0/2031994004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd398004df0 con 0x7fd3a01453e0 2024-09-10T20:41:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a01f5890 con 0x7fd3a01453e0 2024-09-10T20:41:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd396a00640 1 -- 172.21.15.81:0/2031994004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39800aa70 con 0x7fd3a01453e0 2024-09-10T20:41:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.863+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a01f5e50 con 0x7fd3a01453e0 2024-09-10T20:41:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.864+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a006e660 con 0x7fd3a01453e0 2024-09-10T20:41:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.865+0000 7fd396a00640 1 -- 172.21.15.81:0/2031994004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd39800ac10 con 0x7fd3a01453e0 2024-09-10T20:41:51.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.866+0000 7fd396a00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd380077f70 0x7fd38007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:51.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.866+0000 7fd396a00640 1 -- 172.21.15.81:0/2031994004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6347+0+0 (secure 0 0 0) 0x7fd39809a160 con 0x7fd3a01453e0 2024-09-10T20:41:51.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.867+0000 7fd39ea00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd380077f70 0x7fd38007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:51.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.867+0000 7fd39ea00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd380077f70 0x7fd38007a430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd390004630 tx=0x7fd39000b2e0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:51.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:51.870+0000 7fd396a00640 1 -- 172.21.15.81:0/2031994004 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fd398020070 con 0x7fd3a01453e0 2024-09-10T20:41:52.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.087+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3a006c970 con 0x7fd3a01453e0 2024-09-10T20:41:52.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.088+0000 7fd396a00640 1 -- 172.21.15.81:0/2031994004 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5235 (secure 0 0 0) 0x7fd3a01f94e0 con 0x7fd3a01453e0 2024-09-10T20:41:52.092 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:52.092 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-10T20:41:49:105840+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T20:41:23.771863+0000","modified":"2024-09-10T20:41:39.070169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5184},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5184":{"gid":5184,"name":"c","rank":0,"incarnation":27,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2525007844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2525007844},{"type":"v1","addr":"172.21.15.81:6835","nonce":2525007844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5184,"qdb_cluster":[5184]},"id":3}]} 2024-09-10T20:41:52.092 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-10T20:41:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd380077f70 msgr2=0x7fd38007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd380077f70 0x7fd38007a430 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd390004630 tx=0x7fd39000b2e0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a01453e0 msgr2=0x7fd3a013cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a01453e0 0x7fd3a013cf10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c780 tx=0x7fd39800cc40 comp rx=0 tx=0).stop 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 shutdown_connections 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd380077f70 0x7fd38007a430 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3a01453e0 0x7fd3a013cf10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd3a00ceff0 0x7fd3a01f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 --2- 172.21.15.81:0/2031994004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd3a006eba0 0x7fd3a01f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 >> 172.21.15.81:0/2031994004 conn(0x7fd3a0068f90 msgr2=0x7fd3a0144170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 shutdown_connections 2024-09-10T20:41:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.090+0000 7fd3a5c00640 1 -- 172.21.15.81:0/2031994004 wait complete. 2024-09-10T20:41:52.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.262+0000 7f32d1c00640 1 -- 172.21.15.81:0/869235572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 msgr2=0x7f32cc0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.262+0000 7f32d1c00640 1 --2- 172.21.15.81:0/869235572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc0cb530 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f32cc072ff0 tx=0x7f32b802a560 comp rx=0 tx=0).stop 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.262+0000 7f32d1c00640 1 -- 172.21.15.81:0/869235572 shutdown_connections 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.262+0000 7f32d1c00640 1 --2- 172.21.15.81:0/869235572 >> v2:172.21.15.143:3300/0 conn(0x7f32cc0cba70 0x7f32cc0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.262+0000 7f32d1c00640 1 --2- 172.21.15.81:0/869235572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc0cb530 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.262+0000 7f32d1c00640 1 -- 172.21.15.81:0/869235572 >> 172.21.15.81:0/869235572 conn(0x7f32cc06c690 msgr2=0x7f32cc06ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.263+0000 7f32d1c00640 1 -- 172.21.15.81:0/869235572 shutdown_connections 2024-09-10T20:41:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.263+0000 7f32d1c00640 1 -- 172.21.15.81:0/869235572 wait complete. 2024-09-10T20:41:52.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.264+0000 7f32d1c00640 1 Processor -- start 2024-09-10T20:41:52.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.264+0000 7f32d1c00640 1 -- start start 2024-09-10T20:41:52.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32d1c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32d1c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32cc0cba70 0x7f32cc14acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32d1c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32cc15b910 0x7f32cc0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32d1c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc0ca390 con 0x7f32cc06eee0 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32d1c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc073b70 con 0x7f32cc0cba70 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32d1c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f32cc0ca510 con 0x7f32cc15b910 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32cbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32cbe00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc14e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36104/0 (socket says 172.21.15.81:36104) 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32cbe00640 1 -- 172.21.15.81:0/237005264 learned_addr learned my addr 172.21.15.81:0/237005264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.265+0000 7f32cb400640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32cc0cba70 0x7f32cc14acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32d1200640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32cc15b910 0x7f32cc0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32cbe00640 1 -- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32cc15b910 msgr2=0x7f32cc0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32cbe00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32cc15b910 0x7f32cc0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32cbe00640 1 -- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32cc0cba70 msgr2=0x7f32cc14acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32cbe00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32cc0cba70 0x7f32cc14acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32cbe00640 1 -- 172.21.15.81:0/237005264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc14b200 con 0x7f32cc06eee0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32cbe00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc14e9f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b3e0 tx=0x7f32bc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.266+0000 7f32c3e00640 1 -- 172.21.15.81:0/237005264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc015020 con 0x7f32cc06eee0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.267+0000 7f32c3e00640 1 -- 172.21.15.81:0/237005264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32bc011940 con 0x7f32cc06eee0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.267+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc14b5a0 con 0x7f32cc06eee0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.267+0000 7f32c3e00640 1 -- 172.21.15.81:0/237005264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc011d90 con 0x7f32cc06eee0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.267+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc14be40 con 0x7f32cc06eee0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.268+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32cc0caa20 con 0x7f32cc06eee0 2024-09-10T20:41:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.269+0000 7f32c3e00640 1 -- 172.21.15.81:0/237005264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f32bc01a400 con 0x7f32cc06eee0 2024-09-10T20:41:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.270+0000 7f32c3e00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f32ac077f70 0x7f32ac07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.270+0000 7f32c3e00640 1 -- 172.21.15.81:0/237005264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6347+0+0 (secure 0 0 0) 0x7f32bc09a0b0 con 0x7f32cc06eee0 2024-09-10T20:41:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.270+0000 7f32cb400640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f32ac077f70 0x7f32ac07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.271+0000 7f32cb400640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f32ac077f70 0x7f32ac07a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32b8033000 tx=0x7f32b8004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.274+0000 7f32c3e00640 1 -- 172.21.15.81:0/237005264 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f32bc01f020 con 0x7f32cc06eee0 2024-09-10T20:41:52.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.458+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32cc075eb0 con 0x7f32cc06eee0 2024-09-10T20:41:52.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.459+0000 7f32c3e00640 1 -- 172.21.15.81:0/237005264 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17308 (secure 0 0 0) 0x7f32bc0622e0 con 0x7f32cc06eee0 2024-09-10T20:41:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:52.463 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":51,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:50.112422+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T20:40:56.152868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-10T20:41:21.973646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.f","mappings":[{"from":4,"to":2}]},{"pgid":"6.17","mappings":[{"from":1,"to":2}]},{"pgid":"6.1e","mappings":[{"from":3,"to":7}]},{"pgid":"6.28","mappings":[{"from":4,"to":7}]},{"pgid":"6.2b","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:41:52.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f32ac077f70 msgr2=0x7f32ac07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f32ac077f70 0x7f32ac07a430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32b8033000 tx=0x7f32b8004730 comp rx=0 tx=0).stop 2024-09-10T20:41:52.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 msgr2=0x7f32cc14e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc14e9f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b3e0 tx=0x7f32bc00b8a0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 shutdown_connections 2024-09-10T20:41:52.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f32ac077f70 0x7f32ac07a430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f32cc15b910 0x7f32cc0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32cc0cba70 0x7f32cc14acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 --2- 172.21.15.81:0/237005264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32cc06eee0 0x7f32cc14e9f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 >> 172.21.15.81:0/237005264 conn(0x7f32cc06c690 msgr2=0x7f32cc0b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:52.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 shutdown_connections 2024-09-10T20:41:52.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.461+0000 7f32d1c00640 1 -- 172.21.15.81:0/237005264 wait complete. 2024-09-10T20:41:52.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail recovery_fs 2024-09-10T20:41:52.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 -- 172.21.15.81:0/738465512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659806e660 msgr2=0x7f659806ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 --2- 172.21.15.81:0/738465512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659806e660 0x7f659806ea80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6584005fd0 tx=0x7f658402a5d0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 -- 172.21.15.81:0/738465512 shutdown_connections 2024-09-10T20:41:52.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 --2- 172.21.15.81:0/738465512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f659806e660 0x7f659806ea80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 --2- 172.21.15.81:0/738465512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f65981453e0 0x7f65980cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 -- 172.21.15.81:0/738465512 >> 172.21.15.81:0/738465512 conn(0x7f6598068f90 msgr2=0x7f659806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 -- 172.21.15.81:0/738465512 shutdown_connections 2024-09-10T20:41:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.634+0000 7f659f200640 1 -- 172.21.15.81:0/738465512 wait complete. 2024-09-10T20:41:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.636+0000 7f659f200640 1 Processor -- start 2024-09-10T20:41:52.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.636+0000 7f659f200640 1 -- start start 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f659f200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f659806e660 0x7f6598130380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f659f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65981453e0 0x7f65981ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f659f200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f659815f6b0 0x7f65981ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f659f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65980cf170 con 0x7f65981453e0 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f659f200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f65980ceff0 con 0x7f659806e660 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f659f200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6598160230 con 0x7f659815f6b0 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65981453e0 0x7f65981ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65981453e0 0x7f65981ea1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36120/0 (socket says 172.21.15.81:36120) 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 -- 172.21.15.81:0/2795617817 learned_addr learned my addr 172.21.15.81:0/2795617817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597e00640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f659806e660 0x7f6598130380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f659d200640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f659815f6b0 0x7f65981ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 -- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f659815f6b0 msgr2=0x7f65981ea6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f659815f6b0 0x7f65981ea6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 -- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f659806e660 msgr2=0x7f6598130380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f659806e660 0x7f6598130380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597400640 1 -- 172.21.15.81:0/2795617817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65981e5740 con 0x7f65981453e0 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.637+0000 7f6597e00640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f659806e660 0x7f6598130380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.638+0000 7f6597400640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65981453e0 0x7f65981ea1a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6584009850 tx=0x7f65840038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.638+0000 7f658fe00640 1 -- 172.21.15.81:0/2795617817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658403f070 con 0x7f65981453e0 2024-09-10T20:41:52.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.638+0000 7f658fe00640 1 -- 172.21.15.81:0/2795617817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6584005600 con 0x7f65981453e0 2024-09-10T20:41:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.638+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65981e5a20 con 0x7f65981453e0 2024-09-10T20:41:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.638+0000 7f658fe00640 1 -- 172.21.15.81:0/2795617817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584035030 con 0x7f65981453e0 2024-09-10T20:41:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.638+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65981308c0 con 0x7f65981453e0 2024-09-10T20:41:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.639+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65980b4b30 con 0x7f65981453e0 2024-09-10T20:41:52.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.640+0000 7f658fe00640 1 -- 172.21.15.81:0/2795617817 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f65840049e0 con 0x7f65981453e0 2024-09-10T20:41:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.641+0000 7f658fe00640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6578077f70 0x7f657807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.641+0000 7f658fe00640 1 -- 172.21.15.81:0/2795617817 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6347+0+0 (secure 0 0 0) 0x7f65840baf00 con 0x7f65981453e0 2024-09-10T20:41:52.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.641+0000 7f6597e00640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6578077f70 0x7f657807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.642+0000 7f6597e00640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6578077f70 0x7f657807a430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6588005fd0 tx=0x7f6588005850 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:52.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.645+0000 7f658fe00640 1 -- 172.21.15.81:0/2795617817 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6584083770 con 0x7f65981453e0 2024-09-10T20:41:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.866+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "recovery_fs"} v 0) -- 0x7f65980b4850 con 0x7f65981453e0 2024-09-10T20:41:52.870 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T20:41:52.867+0000 7f54aae00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T20:41:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.869+0000 7f658fe00640 1 -- 172.21.15.81:0/2795617817 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "recovery_fs"}]=0 recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 171+0+0 (secure 0 0 0) 0x7f6584083070 con 0x7f65981453e0 2024-09-10T20:41:52.872 INFO:teuthology.orchestra.run.smithi081.stderr:recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T20:41:52.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6578077f70 msgr2=0x7f657807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6578077f70 0x7f657807a430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6588005fd0 tx=0x7f6588005850 comp rx=0 tx=0).stop 2024-09-10T20:41:52.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65981453e0 msgr2=0x7f65981ea1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65981453e0 0x7f65981ea1a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6584009850 tx=0x7f65840038a0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 shutdown_connections 2024-09-10T20:41:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6578077f70 0x7f657807a430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f659815f6b0 0x7f65981ea6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65981453e0 0x7f65981ea1a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 --2- 172.21.15.81:0/2795617817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f659806e660 0x7f6598130380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 >> 172.21.15.81:0/2795617817 conn(0x7f6598068f90 msgr2=0x7f65980af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 shutdown_connections 2024-09-10T20:41:52.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:52.872+0000 7f659f200640 1 -- 172.21.15.81:0/2795617817 wait complete. 2024-09-10T20:41:52.880 INFO:tasks.ceph.mds.c.smithi081.stderr: -3800> 2024-09-10T20:41:36.066+0000 7f896a800640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-09-10T20:41:52.883 INFO:tasks.ceph.mds.c.smithi081.stderr: -2061> 2024-09-10T20:41:41.344+0000 7f896a800640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2024-09-10T20:41:52.884 INFO:tasks.ceph.mds.c.smithi081.stderr: -1885> 2024-09-10T20:41:41.345+0000 7f896a800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x564370d79180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-10T20:41:52.884 INFO:tasks.ceph.mds.c.smithi081.stderr: -1751> 2024-09-10T20:41:41.346+0000 7f896a800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() | request=0 lock=0 dirtyparent=1 authpin=1 scrubqueue=0 0x564371022580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(6)0x10000000001:[<0x10000000000/sixmegs v8>,<0x1/subdir v10>]//[]","memoryvalue":"(6)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-10T20:41:52.885 INFO:tasks.ceph.mds.c.smithi081.stderr: -1405> 2024-09-10T20:41:41.354+0000 7f896a800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 pv6 ap=5 snaprealm=0x564370d746c0 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (inest mix->lock(2) w=1 flushing) (ifile mix->sync w=1 flushing) | dirtyscattered=2 lock=2 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x564370d76b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-10T20:41:52.885 INFO:tasks.ceph.mds.c.smithi081.stderr: -1297> 2024-09-10T20:41:41.954+0000 7f896f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T20:41:52.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm recovery_fs --yes-i-really-mean-it 2024-09-10T20:41:52.930 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-10T20:41:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.049+0000 7f9e55000640 1 -- 172.21.15.81:0/1029176830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 msgr2=0x7f9e5015e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.049+0000 7f9e55000640 1 --2- 172.21.15.81:0/1029176830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5015e690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009830 tx=0x7f9e3c02a5b0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.049+0000 7f9e55000640 1 -- 172.21.15.81:0/1029176830 shutdown_connections 2024-09-10T20:41:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.049+0000 7f9e55000640 1 --2- 172.21.15.81:0/1029176830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5015e690 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.049+0000 7f9e55000640 1 -- 172.21.15.81:0/1029176830 >> 172.21.15.81:0/1029176830 conn(0x7f9e50068f90 msgr2=0x7f9e5006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.049+0000 7f9e55000640 1 -- 172.21.15.81:0/1029176830 shutdown_connections 2024-09-10T20:41:53.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.049+0000 7f9e55000640 1 -- 172.21.15.81:0/1029176830 wait complete. 2024-09-10T20:41:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.050+0000 7f9e55000640 1 Processor -- start 2024-09-10T20:41:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.051+0000 7f9e55000640 1 -- start start 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e55000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e55000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e50144320 0x7f9e501f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e55000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e5015ebd0 0x7f9e501f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e55000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50144880 con 0x7f9e500b3a90 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e55000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50144700 con 0x7f9e5015ebd0 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e55000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e50072b90 con 0x7f9e50144320 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5013f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36156/0 (socket says 172.21.15.81:36156) 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 -- 172.21.15.81:0/1967426583 learned_addr learned my addr 172.21.15.81:0/1967426583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4d400640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e50144320 0x7f9e501f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:53.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4e800640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e5015ebd0 0x7f9e501f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 -- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e50144320 msgr2=0x7f9e501f74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e50144320 0x7f9e501f74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 -- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e5015ebd0 msgr2=0x7f9e501f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e5015ebd0 0x7f9e501f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.052+0000 7f9e4de00640 1 -- 172.21.15.81:0/1967426583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e501f8130 con 0x7f9e500b3a90 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.053+0000 7f9e4de00640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5013f490 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c500 tx=0x7f9e4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.053+0000 7f9e46000640 1 -- 172.21.15.81:0/1967426583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40016020 con 0x7f9e500b3a90 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.053+0000 7f9e46000640 1 -- 172.21.15.81:0/1967426583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e40012920 con 0x7f9e500b3a90 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.053+0000 7f9e46000640 1 -- 172.21.15.81:0/1967426583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40012d90 con 0x7f9e500b3a90 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.053+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e501f8410 con 0x7f9e500b3a90 2024-09-10T20:41:53.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.053+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e501f89d0 con 0x7f9e500b3a90 2024-09-10T20:41:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.054+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e50073050 con 0x7f9e500b3a90 2024-09-10T20:41:53.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.055+0000 7f9e46000640 1 -- 172.21.15.81:0/1967426583 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f9e4001a3b0 con 0x7f9e500b3a90 2024-09-10T20:41:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.056+0000 7f9e46000640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e30077f70 0x7f9e3007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.056+0000 7f9e46000640 1 -- 172.21.15.81:0/1967426583 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6433+0+0 (secure 0 0 0) 0x7f9e40099ff0 con 0x7f9e500b3a90 2024-09-10T20:41:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.057+0000 7f9e4d400640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e30077f70 0x7f9e3007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:53.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.058+0000 7f9e4d400640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e30077f70 0x7f9e3007a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c034000 tx=0x7f9e3c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.060+0000 7f9e46000640 1 -- 172.21.15.81:0/1967426583 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f9e40020030 con 0x7f9e500b3a90 2024-09-10T20:41:53.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.283+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true} v 0) -- 0x7f9e50074100 con 0x7f9e500b3a90 2024-09-10T20:41:53.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.870+0000 7f9e46000640 1 -- 172.21.15.81:0/1967426583 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true}]=0 v34) ==== 109+0+0 (secure 0 0 0) 0x7f9e40062820 con 0x7f9e500b3a90 2024-09-10T20:41:53.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e30077f70 msgr2=0x7f9e3007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e30077f70 0x7f9e3007a430 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c034000 tx=0x7f9e3c004730 comp rx=0 tx=0).stop 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 msgr2=0x7f9e5013f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5013f490 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c500 tx=0x7f9e4000c9c0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 shutdown_connections 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9e30077f70 0x7f9e3007a430 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e5015ebd0 0x7f9e501f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e50144320 0x7f9e501f74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 --2- 172.21.15.81:0/1967426583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e500b3a90 0x7f9e5013f490 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 >> 172.21.15.81:0/1967426583 conn(0x7f9e50068f90 msgr2=0x7f9e5015b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.873+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 shutdown_connections 2024-09-10T20:41:53.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:53.874+0000 7f9e55000640 1 -- 172.21.15.81:0/1967426583 wait complete. 2024-09-10T20:41:53.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm recovery_fs_metadata recovery_fs_metadata --yes-i-really-really-mean-it 2024-09-10T20:41:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.093+0000 7f1943c00640 1 -- 172.21.15.81:0/2803675596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15e820 msgr2=0x7f193c0cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.093+0000 7f1943c00640 1 --2- 172.21.15.81:0/2803675596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15e820 0x7f193c0cf430 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1934009900 tx=0x7f193402a610 comp rx=0 tx=0).stop 2024-09-10T20:41:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.093+0000 7f1943c00640 1 -- 172.21.15.81:0/2803675596 shutdown_connections 2024-09-10T20:41:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.093+0000 7f1943c00640 1 --2- 172.21.15.81:0/2803675596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15e820 0x7f193c0cf430 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.093+0000 7f1943c00640 1 -- 172.21.15.81:0/2803675596 >> 172.21.15.81:0/2803675596 conn(0x7f193c069020 msgr2=0x7f193c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.094+0000 7f1943c00640 1 -- 172.21.15.81:0/2803675596 shutdown_connections 2024-09-10T20:41:54.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.094+0000 7f1943c00640 1 -- 172.21.15.81:0/2803675596 wait complete. 2024-09-10T20:41:54.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.095+0000 7f1943c00640 1 Processor -- start 2024-09-10T20:41:54.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.095+0000 7f1943c00640 1 -- start start 2024-09-10T20:41:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f1943c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193c06e660 0x7f193c13ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f1943c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15c120 0x7f193c073f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f1943c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193c15e820 0x7f193c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f1943c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f193c145500 con 0x7f193c15c120 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f1943c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f193c145380 con 0x7f193c15e820 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f1943c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f193c145680 con 0x7f193c06e660 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f193be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15c120 0x7f193c073f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f193be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15c120 0x7f193c073f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36174/0 (socket says 172.21.15.81:36174) 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.096+0000 7f193be00640 1 -- 172.21.15.81:0/3247639270 learned_addr learned my addr 172.21.15.81:0/3247639270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f1941c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193c15e820 0x7f193c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f1941200640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193c06e660 0x7f193c13ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f193be00640 1 -- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193c06e660 msgr2=0x7f193c13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f193be00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193c06e660 0x7f193c13ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f193be00640 1 -- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193c15e820 msgr2=0x7f193c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f193be00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193c15e820 0x7f193c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f193be00640 1 -- 172.21.15.81:0/3247639270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193c072910 con 0x7f193c15c120 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f1941200640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193c06e660 0x7f193c13ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f193be00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15c120 0x7f193c073f70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f192800c450 tx=0x7f192800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f1938c00640 1 -- 172.21.15.81:0/3247639270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19280052d0 con 0x7f193c15c120 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f1938c00640 1 -- 172.21.15.81:0/3247639270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1928005470 con 0x7f193c15c120 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193c1f50f0 con 0x7f193c15c120 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.097+0000 7f1938c00640 1 -- 172.21.15.81:0/3247639270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928012870 con 0x7f193c15c120 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.098+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c1f4d60 con 0x7f193c15c120 2024-09-10T20:41:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.099+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193c0cf430 con 0x7f193c15c120 2024-09-10T20:41:54.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.100+0000 7f1938c00640 1 -- 172.21.15.81:0/3247639270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f19280035f0 con 0x7f193c15c120 2024-09-10T20:41:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.101+0000 7f1938c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f191c077f70 0x7f191c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.101+0000 7f1938c00640 1 -- 172.21.15.81:0/3247639270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6433+0+0 (secure 0 0 0) 0x7f1928099b60 con 0x7f193c15c120 2024-09-10T20:41:54.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.102+0000 7f1941200640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f191c077f70 0x7f191c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:54.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.102+0000 7f1941200640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f191c077f70 0x7f191c07a430 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f192c0045b0 tx=0x7f192c009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:54.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.105+0000 7f1938c00640 1 -- 172.21.15.81:0/3247639270 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f19280622e0 con 0x7f193c15c120 2024-09-10T20:41:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:54.289+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f193c1599c0 con 0x7f193c15c120 2024-09-10T20:41:55.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.134+0000 7f1938c00640 1 -- 172.21.15.81:0/3247639270 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'recovery_fs_metadata' removed v53) ==== 196+0+0 (secure 0 0 0) 0x7f1928061be0 con 0x7f193c15c120 2024-09-10T20:41:55.139 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'recovery_fs_metadata' removed 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f191c077f70 msgr2=0x7f191c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f191c077f70 0x7f191c07a430 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f192c0045b0 tx=0x7f192c009040 comp rx=0 tx=0).stop 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15c120 msgr2=0x7f193c073f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15c120 0x7f193c073f70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f192800c450 tx=0x7f192800c910 comp rx=0 tx=0).stop 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 shutdown_connections 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f191c077f70 0x7f191c07a430 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f193c15e820 0x7f193c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c15c120 0x7f193c073f70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 --2- 172.21.15.81:0/3247639270 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f193c06e660 0x7f193c13ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 >> 172.21.15.81:0/3247639270 conn(0x7f193c069020 msgr2=0x7f193c0b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 shutdown_connections 2024-09-10T20:41:55.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.139+0000 7f1943c00640 1 -- 172.21.15.81:0/3247639270 wait complete. 2024-09-10T20:41:55.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T20:41:55.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 -- 172.21.15.81:0/3726924555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b2d70 msgr2=0x7f72380ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:55.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 --2- 172.21.15.81:0/3726924555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b2d70 0x7f72380ceeb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f72380cfc30 tx=0x7f722c02a950 comp rx=0 tx=0).stop 2024-09-10T20:41:55.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 -- 172.21.15.81:0/3726924555 shutdown_connections 2024-09-10T20:41:55.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 --2- 172.21.15.81:0/3726924555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72380cdea0 0x7f723815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 --2- 172.21.15.81:0/3726924555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380b2d70 0x7f72380ceeb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 -- 172.21.15.81:0/3726924555 >> 172.21.15.81:0/3726924555 conn(0x7f72380b36c0 msgr2=0x7f72380b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:55.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 -- 172.21.15.81:0/3726924555 shutdown_connections 2024-09-10T20:41:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.324+0000 7f7240600640 1 -- 172.21.15.81:0/3726924555 wait complete. 2024-09-10T20:41:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.325+0000 7f7240600640 1 Processor -- start 2024-09-10T20:41:55.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.326+0000 7f7240600640 1 -- start start 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.326+0000 7f7240600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72380b2d70 0x7f72380b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f7240600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72380b3150 0x7f72380caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f7240600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cdea0 0x7f72380cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f7240600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72380cca80 con 0x7f72380cdea0 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f7240600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f72380cc900 con 0x7f72380b3150 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f7240600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f72380ccc00 con 0x7f72380b2d70 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cdea0 0x7f72380cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cdea0 0x7f72380cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35008/0 (socket says 172.21.15.81:35008) 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 -- 172.21.15.81:0/2335755001 learned_addr learned my addr 172.21.15.81:0/2335755001 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723dc00640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72380b2d70 0x7f72380b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723d200640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72380b3150 0x7f72380caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 -- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72380b2d70 msgr2=0x7f72380b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72380b2d70 0x7f72380b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 -- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72380b3150 msgr2=0x7f72380caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72380b3150 0x7f72380caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723e600640 1 -- 172.21.15.81:0/2335755001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72381f4bd0 con 0x7f72380cdea0 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.327+0000 7f723d200640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72380b3150 0x7f72380caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.328+0000 7f723e600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cdea0 0x7f72380cb410 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f723000b410 tx=0x7f723000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.328+0000 7f7235600640 1 -- 172.21.15.81:0/2335755001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230015020 con 0x7f72380cdea0 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.328+0000 7f7235600640 1 -- 172.21.15.81:0/2335755001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7230011940 con 0x7f72380cdea0 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.328+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72380b6ea0 con 0x7f72380cdea0 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.328+0000 7f7235600640 1 -- 172.21.15.81:0/2335755001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230011d90 con 0x7f72380cdea0 2024-09-10T20:41:55.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.328+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72381f5170 con 0x7f72380cdea0 2024-09-10T20:41:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.329+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72380ceeb0 con 0x7f72380cdea0 2024-09-10T20:41:55.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.330+0000 7f7235600640 1 -- 172.21.15.81:0/2335755001 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f723001a400 con 0x7f72380cdea0 2024-09-10T20:41:55.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.331+0000 7f7235600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7218077f70 0x7f721807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:55.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.331+0000 7f7235600640 1 -- 172.21.15.81:0/2335755001 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5985+0+0 (secure 0 0 0) 0x7f7230099ff0 con 0x7f72380cdea0 2024-09-10T20:41:55.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.332+0000 7f723dc00640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7218077f70 0x7f721807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:55.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.332+0000 7f723dc00640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7218077f70 0x7f721807a430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f722c035000 tx=0x7f722c004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.335+0000 7f7235600640 1 -- 172.21.15.81:0/2335755001 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f723001f020 con 0x7f72380cdea0 2024-09-10T20:41:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:55.517+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7238074920 con 0x7f72380cdea0 2024-09-10T20:41:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.141+0000 7f7235600640 1 -- 172.21.15.81:0/2335755001 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7f72300629e0 con 0x7f72380cdea0 2024-09-10T20:41:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-10T20:41:56.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.144+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7218077f70 msgr2=0x7f721807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.144+0000 7f7240600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7218077f70 0x7f721807a430 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f722c035000 tx=0x7f722c004ab0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.144+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cdea0 msgr2=0x7f72380cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.144+0000 7f7240600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cdea0 0x7f72380cb410 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f723000b410 tx=0x7f723000b8d0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 shutdown_connections 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7218077f70 0x7f721807a430 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72380cdea0 0x7f72380cb410 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f72380b3150 0x7f72380caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 --2- 172.21.15.81:0/2335755001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f72380b2d70 0x7f72380b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 >> 172.21.15.81:0/2335755001 conn(0x7f72380b36c0 msgr2=0x7f72380b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 shutdown_connections 2024-09-10T20:41:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.146+0000 7f7240600640 1 -- 172.21.15.81:0/2335755001 wait complete. 2024-09-10T20:41:56.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-10T20:41:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.336+0000 7f7ef6200640 1 -- 172.21.15.81:0/92907616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef00b5b80 msgr2=0x7f7ef006f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.336+0000 7f7ef6200640 1 --2- 172.21.15.81:0/92907616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef00b5b80 0x7f7ef006f5c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7edc005fd0 tx=0x7f7edc02a5f0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.336+0000 7f7ef6200640 1 -- 172.21.15.81:0/92907616 shutdown_connections 2024-09-10T20:41:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.336+0000 7f7ef6200640 1 --2- 172.21.15.81:0/92907616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef00b5b80 0x7f7ef006f5c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.336+0000 7f7ef6200640 1 -- 172.21.15.81:0/92907616 >> 172.21.15.81:0/92907616 conn(0x7f7ef00d0ad0 msgr2=0x7f7ef00d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.336+0000 7f7ef6200640 1 -- 172.21.15.81:0/92907616 shutdown_connections 2024-09-10T20:41:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.336+0000 7f7ef6200640 1 -- 172.21.15.81:0/92907616 wait complete. 2024-09-10T20:41:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.338+0000 7f7ef6200640 1 Processor -- start 2024-09-10T20:41:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.338+0000 7f7ef6200640 1 -- start start 2024-09-10T20:41:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7ef6200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef006fb00 0x7f7ef015d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7ef6200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ef00b5b80 0x7f7ef013f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7ef6200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ef0147760 0x7f7ef013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7ef6200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef006c810 con 0x7f7ef006fb00 2024-09-10T20:41:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7ef6200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef006c690 con 0x7f7ef00b5b80 2024-09-10T20:41:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7ef6200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef006c990 con 0x7f7ef0147760 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef006fb00 0x7f7ef015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef006fb00 0x7f7ef015d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35034/0 (socket says 172.21.15.81:35034) 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 -- 172.21.15.81:0/1815345623 learned_addr learned my addr 172.21.15.81:0/1815345623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 -- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ef0147760 msgr2=0x7f7ef013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ef0147760 0x7f7ef013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 -- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ef00b5b80 msgr2=0x7f7ef013f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ef00b5b80 0x7f7ef013f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.339+0000 7f7eef400640 1 -- 172.21.15.81:0/1815345623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef0140490 con 0x7f7ef006fb00 2024-09-10T20:41:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.340+0000 7f7eef400640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef006fb00 0x7f7ef015d490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000c3a0 tx=0x7f7ee000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:56.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.340+0000 7f7ee7400640 1 -- 172.21.15.81:0/1815345623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0017070 con 0x7f7ef006fb00 2024-09-10T20:41:56.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.340+0000 7f7ee7400640 1 -- 172.21.15.81:0/1815345623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ee00035f0 con 0x7f7ef006fb00 2024-09-10T20:41:56.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.340+0000 7f7ee7400640 1 -- 172.21.15.81:0/1815345623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0003a40 con 0x7f7ef006fb00 2024-09-10T20:41:56.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.340+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef01f4840 con 0x7f7ef006fb00 2024-09-10T20:41:56.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.340+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef01f4550 con 0x7f7ef006fb00 2024-09-10T20:41:56.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.341+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef015de50 con 0x7f7ef006fb00 2024-09-10T20:41:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.342+0000 7f7ee7400640 1 -- 172.21.15.81:0/1815345623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f7ee0003be0 con 0x7f7ef006fb00 2024-09-10T20:41:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.343+0000 7f7ee7400640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7ed0077f70 0x7f7ed007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.343+0000 7f7ee7400640 1 -- 172.21.15.81:0/1815345623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f7ee00991a0 con 0x7f7ef006fb00 2024-09-10T20:41:56.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.343+0000 7f7eeea00640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7ed0077f70 0x7f7ed007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.344+0000 7f7eeea00640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7ed0077f70 0x7f7ed007a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7edc033000 tx=0x7f7edc0046c0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.347+0000 7f7ee7400640 1 -- 172.21.15.81:0/1815345623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f7ef015de50 con 0x7f7ef006fb00 2024-09-10T20:41:56.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.530+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f7ef01f4f50 con 0x7f7ef006fb00 2024-09-10T20:41:56.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.533+0000 7f7ee7400640 1 -- 172.21.15.81:0/1815345623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f7ee0061db0 con 0x7f7ef006fb00 2024-09-10T20:41:56.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7ed0077f70 msgr2=0x7f7ed007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7ed0077f70 0x7f7ed007a430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7edc033000 tx=0x7f7edc0046c0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef006fb00 msgr2=0x7f7ef015d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef006fb00 0x7f7ef015d490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000c3a0 tx=0x7f7ee000c860 comp rx=0 tx=0).stop 2024-09-10T20:41:56.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 shutdown_connections 2024-09-10T20:41:56.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7ed0077f70 0x7f7ed007a430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ef0147760 0x7f7ef013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ef00b5b80 0x7f7ef013f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 --2- 172.21.15.81:0/1815345623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef006fb00 0x7f7ef015d490 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 >> 172.21.15.81:0/1815345623 conn(0x7f7ef00d0ad0 msgr2=0x7f7ef00ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 shutdown_connections 2024-09-10T20:41:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.536+0000 7f7ef6200640 1 -- 172.21.15.81:0/1815345623 wait complete. 2024-09-10T20:41:56.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2024-09-10T20:41:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.710+0000 7f1046200640 1 -- 172.21.15.81:0/3129970877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 msgr2=0x7f1024003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.710+0000 7f1046200640 1 --2- 172.21.15.81:0/3129970877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f1024003ec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1030009b20 tx=0x7f1024005830 comp rx=0 tx=0).stop 2024-09-10T20:41:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.710+0000 7f1046200640 1 -- 172.21.15.81:0/3129970877 shutdown_connections 2024-09-10T20:41:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.710+0000 7f1046200640 1 --2- 172.21.15.81:0/3129970877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f1024003ec0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.710+0000 7f1046200640 1 -- 172.21.15.81:0/3129970877 >> 172.21.15.81:0/3129970877 conn(0x7f1040068f90 msgr2=0x7f104006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.710+0000 7f1046200640 1 -- 172.21.15.81:0/3129970877 shutdown_connections 2024-09-10T20:41:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.710+0000 7f1046200640 1 -- 172.21.15.81:0/3129970877 wait complete. 2024-09-10T20:41:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.711+0000 7f1046200640 1 Processor -- start 2024-09-10T20:41:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.712+0000 7f1046200640 1 -- start start 2024-09-10T20:41:56.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f1046200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f10401f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f103f400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f10401f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f1046200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10400b1b50 0x7f10401f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f103f400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f10401f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.81:33216/0 (socket says 172.21.15.81:33216) 2024-09-10T20:41:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f1046200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400b1fb0 0x7f10401f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f103f400640 1 -- 172.21.15.81:0/3623703564 learned_addr learned my addr 172.21.15.81:0/3623703564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10400cf170 con 0x7f10400b1fb0 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f10400ceff0 con 0x7f1024003aa0 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10400cd5a0 con 0x7f10400b1b50 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f103fe00640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400b1fb0 0x7f10401f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f103ea00640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10400b1b50 0x7f10401f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f103f400640 1 -- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10400b1b50 msgr2=0x7f10401f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.713+0000 7f103f400640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10400b1b50 0x7f10401f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f103f400640 1 -- 172.21.15.81:0/3623703564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400b1fb0 msgr2=0x7f10401f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f103f400640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400b1fb0 0x7f10401f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f103f400640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10401f8f90 con 0x7f1024003aa0 2024-09-10T20:41:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f103f400640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f10401f56a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1030009c40 tx=0x7f1030033670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f1037400640 1 -- 172.21.15.81:0/3623703564 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030038040 con 0x7f1024003aa0 2024-09-10T20:41:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f1037400640 1 -- 172.21.15.81:0/3623703564 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1030004020 con 0x7f1024003aa0 2024-09-10T20:41:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f1037400640 1 -- 172.21.15.81:0/3623703564 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030004450 con 0x7f1024003aa0 2024-09-10T20:41:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.714+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10401f8cb0 con 0x7f1024003aa0 2024-09-10T20:41:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.715+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10401f4ea0 con 0x7f1024003aa0 2024-09-10T20:41:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.716+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10401f49f0 con 0x7f1024003aa0 2024-09-10T20:41:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.717+0000 7f1037400640 1 -- 172.21.15.81:0/3623703564 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f103003b030 con 0x7f1024003aa0 2024-09-10T20:41:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.718+0000 7f1037400640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1020077f70 0x7f102007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.718+0000 7f1037400640 1 -- 172.21.15.81:0/3623703564 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f10300ba950 con 0x7f1024003aa0 2024-09-10T20:41:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.718+0000 7f103ea00640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1020077f70 0x7f102007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.719+0000 7f103ea00640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1020077f70 0x7f102007a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10401e7020 tx=0x7f102c001e50 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:56.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.722+0000 7f1037400640 1 -- 172.21.15.81:0/3623703564 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1030082f00 con 0x7f1024003aa0 2024-09-10T20:41:56.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:56.972+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) -- 0x7f10400b4d70 con 0x7f1024003aa0 2024-09-10T20:41:57.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.147+0000 7f1037400640 1 -- 172.21.15.81:0/3623703564 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v139) ==== 147+0+0 (secure 0 0 0) 0x7f10400b4d70 con 0x7f1024003aa0 2024-09-10T20:41:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1020077f70 msgr2=0x7f102007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1020077f70 0x7f102007a430 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10401e7020 tx=0x7f102c001e50 comp rx=0 tx=0).stop 2024-09-10T20:41:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 msgr2=0x7f10401f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f10401f56a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1030009c40 tx=0x7f1030033670 comp rx=0 tx=0).stop 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 shutdown_connections 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1020077f70 0x7f102007a430 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400b1fb0 0x7f10401f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10400b1b50 0x7f10401f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 --2- 172.21.15.81:0/3623703564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1024003aa0 0x7f10401f56a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 >> 172.21.15.81:0/3623703564 conn(0x7f1040068f90 msgr2=0x7f10400ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 shutdown_connections 2024-09-10T20:41:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:57.149+0000 7f1046200640 1 -- 172.21.15.81:0/3623703564 wait complete. 2024-09-10T20:41:57.169 INFO:tasks.cephfs_test_runner:test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) ... ok 2024-09-10T20:41:57.170 INFO:tasks.cephfs_test_runner: 2024-09-10T20:41:57.170 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T20:41:57.170 INFO:tasks.cephfs_test_runner:Ran 1 test in 81.717s 2024-09-10T20:41:57.170 INFO:tasks.cephfs_test_runner: 2024-09-10T20:41:57.170 INFO:tasks.cephfs_test_runner:OK 2024-09-10T20:41:57.170 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T20:41:57.181 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-10T20:41:57.198 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-10T20:41:57.198 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:57.198 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:57.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T20:41:57.234 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T20:41:57.234 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:57.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T20:41:57.309 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:41:57.309 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:57.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:41:57.349 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-10T20:41:57.349 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T20:41:57.427 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052627,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497972k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T20:41:57.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:57.428 DEBUG:teuthology.orchestra.run.smithi143:> ip netns list 2024-09-10T20:41:57.505 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T20:41:57.505 INFO:teuthology.orchestra.run.smithi143.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T20:41:57.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:57.505 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T20:41:57.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:57.604 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T20:41:57.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:57.845 DEBUG:teuthology.orchestra.run.smithi143:> sudo ip link delete ceph-brx 2024-09-10T20:41:58.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:58.155 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-10T20:41:58.194 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T20:41:58.194 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T20:41:58.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:58.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T20:41:58.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:58.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T20:41:58.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T20:41:58.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-10T20:41:58.821 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T20:41:58.830 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T20:41:58.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.983+0000 7fe5c7200640 1 -- 172.21.15.81:0/2667871384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c806eee0 msgr2=0x7fe5c80cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.983+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2667871384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c806eee0 0x7fe5c80cb530 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0005fd0 tx=0x7fe5b002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.984+0000 7fe5c7200640 1 -- 172.21.15.81:0/2667871384 shutdown_connections 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.984+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2667871384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c80cba70 0x7fe5c80c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.984+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2667871384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c806eee0 0x7fe5c80cb530 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.984+0000 7fe5c7200640 1 -- 172.21.15.81:0/2667871384 >> 172.21.15.81:0/2667871384 conn(0x7fe5c806c690 msgr2=0x7fe5c806ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.984+0000 7fe5c7200640 1 -- 172.21.15.81:0/2667871384 shutdown_connections 2024-09-10T20:41:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.984+0000 7fe5c7200640 1 -- 172.21.15.81:0/2667871384 wait complete. 2024-09-10T20:41:58.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.985+0000 7fe5c7200640 1 Processor -- start 2024-09-10T20:41:58.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.985+0000 7fe5c7200640 1 -- start start 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.986+0000 7fe5c7200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c806eee0 0x7fe5c80c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.986+0000 7fe5c7200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c80cba70 0x7fe5c80c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.986+0000 7fe5c7200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c815b910 0x7fe5c80b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.986+0000 7fe5c7200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c80ca390 con 0x7fe5c80cba70 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.986+0000 7fe5c7200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8073b70 con 0x7fe5c806eee0 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.986+0000 7fe5c7200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c80ca510 con 0x7fe5c815b910 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c80cba70 0x7fe5c80c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c80cba70 0x7fe5c80c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35070/0 (socket says 172.21.15.81:35070) 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 -- 172.21.15.81:0/2418444532 learned_addr learned my addr 172.21.15.81:0/2418444532 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5c5e00640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c806eee0 0x7fe5c80c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5c6800640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c815b910 0x7fe5c80b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 -- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c815b910 msgr2=0x7fe5c80b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c815b910 0x7fe5c80b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 -- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c806eee0 msgr2=0x7fe5c80c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c806eee0 0x7fe5c80c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 -- 172.21.15.81:0/2418444532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c80c8f40 con 0x7fe5c80cba70 2024-09-10T20:41:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.987+0000 7fe5bd400640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c80cba70 0x7fe5c80c8870 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009850 tx=0x7fe5b00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.988+0000 7fe5bea00640 1 -- 172.21.15.81:0/2418444532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b003f070 con 0x7fe5c80cba70 2024-09-10T20:41:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.988+0000 7fe5bea00640 1 -- 172.21.15.81:0/2418444532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5b0005600 con 0x7fe5c80cba70 2024-09-10T20:41:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.988+0000 7fe5bea00640 1 -- 172.21.15.81:0/2418444532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0035030 con 0x7fe5c80cba70 2024-09-10T20:41:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.988+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c80c9220 con 0x7fe5c80cba70 2024-09-10T20:41:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.988+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c815e9b0 con 0x7fe5c80cba70 2024-09-10T20:41:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.989+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c80ca9c0 con 0x7fe5c80cba70 2024-09-10T20:41:58.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.990+0000 7fe5bea00640 1 -- 172.21.15.81:0/2418444532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe5b00049e0 con 0x7fe5c80cba70 2024-09-10T20:41:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.991+0000 7fe5bea00640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5a4077f70 0x7fe5a407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.991+0000 7fe5bea00640 1 -- 172.21.15.81:0/2418444532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fe5b00bab90 con 0x7fe5c80cba70 2024-09-10T20:41:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.992+0000 7fe5c5e00640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5a4077f70 0x7fe5a407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.992+0000 7fe5c5e00640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5a4077f70 0x7fe5a407a430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80012e0 tx=0x7fe5b8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:58.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:58.995+0000 7fe5bea00640 1 -- 172.21.15.81:0/2418444532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fe5b00830c0 con 0x7fe5c80cba70 2024-09-10T20:41:59.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.175+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5c8150780 con 0x7fe5a4077f70 2024-09-10T20:41:59.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.176+0000 7fe5bea00640 1 -- 172.21.15.81:0/2418444532 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13495 (secure 0 0 0) 0x7fe5c8150780 con 0x7fe5a4077f70 2024-09-10T20:41:59.180 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:59.180 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:59.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5a4077f70 msgr2=0x7fe5a407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5a4077f70 0x7fe5a407a430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80012e0 tx=0x7fe5b8009040 comp rx=0 tx=0).stop 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c80cba70 msgr2=0x7fe5c80c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c80cba70 0x7fe5c80c8870 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0009850 tx=0x7fe5b00038a0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 shutdown_connections 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe5a4077f70 0x7fe5a407a430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe5c815b910 0x7fe5c80b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c80cba70 0x7fe5c80c8870 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 --2- 172.21.15.81:0/2418444532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe5c806eee0 0x7fe5c80c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 >> 172.21.15.81:0/2418444532 conn(0x7fe5c806c690 msgr2=0x7fe5c815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.178+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 shutdown_connections 2024-09-10T20:41:59.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.179+0000 7fe5c7200640 1 -- 172.21.15.81:0/2418444532 wait complete. 2024-09-10T20:41:59.198 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-10T20:41:57.878171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234508,"kb_used_data":18284,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740212,"statfs":{"total":773094113280,"available":772853977088,"internally_reserved":0,"allocated":18722816,"data_stored":16022605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322167,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001666"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-10T20:41:55.138849+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:55.138849+0000","last_peered":"2024-09-10T20:41:55.138849+0000","last_clean":"2024-09-10T20:41:55.138849+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:55.138849+0000","last_undegraded":"2024-09-10T20:41:55.138849+0000","last_fullsized":"2024-09-10T20:41:55.138849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":276847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":277373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":622592,"data_stored":283432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33768,"kb_used_data":6740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338072,"statfs":{"total":96636764160,"available":96602185728,"internally_reserved":0,"allocated":6901760,"data_stored":6568337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":276825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1216512,"data_stored":873800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29672,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342168,"statfs":{"total":96636764160,"available":96606380032,"internally_reserved":0,"allocated":2707456,"data_stored":2374525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":5312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":5439488,"data_stored":5091466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:59.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.351+0000 7fa547e00640 1 -- 172.21.15.81:0/2676282384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5480d47e0 msgr2=0x7fa5480cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.351+0000 7fa547e00640 1 --2- 172.21.15.81:0/2676282384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5480d47e0 0x7fa5480cf240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa540005fd0 tx=0x7fa54002a940 comp rx=0 tx=0).stop 2024-09-10T20:41:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.351+0000 7fa547e00640 1 -- 172.21.15.81:0/2676282384 shutdown_connections 2024-09-10T20:41:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.351+0000 7fa547e00640 1 --2- 172.21.15.81:0/2676282384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5480d47e0 0x7fa5480cf240 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.351+0000 7fa547e00640 1 -- 172.21.15.81:0/2676282384 >> 172.21.15.81:0/2676282384 conn(0x7fa5480d3cc0 msgr2=0x7fa5480d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.351+0000 7fa547e00640 1 -- 172.21.15.81:0/2676282384 shutdown_connections 2024-09-10T20:41:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.351+0000 7fa547e00640 1 -- 172.21.15.81:0/2676282384 wait complete. 2024-09-10T20:41:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.353+0000 7fa547e00640 1 Processor -- start 2024-09-10T20:41:59.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.353+0000 7fa547e00640 1 -- start start 2024-09-10T20:41:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa547e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5480d2450 0x7fa548150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa547e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5480d47e0 0x7fa548156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa547e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54815df60 0x7fa5480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa547e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480b4f40 con 0x7fa5480d2450 2024-09-10T20:41:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa547e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480b4dc0 con 0x7fa54815df60 2024-09-10T20:41:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa547e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5480b50c0 con 0x7fa5480d47e0 2024-09-10T20:41:59.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5480d2450 0x7fa548150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5480d2450 0x7fa548150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35082/0 (socket says 172.21.15.81:35082) 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 -- 172.21.15.81:0/1531438905 learned_addr learned my addr 172.21.15.81:0/1531438905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa547400640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54815df60 0x7fa5480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546000640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5480d47e0 0x7fa548156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 -- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5480d47e0 msgr2=0x7fa548156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5480d47e0 0x7fa548156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 -- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54815df60 msgr2=0x7fa5480b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54815df60 0x7fa5480b8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546a00640 1 -- 172.21.15.81:0/1531438905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa548157660 con 0x7fa5480d2450 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.354+0000 7fa546000640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5480d47e0 0x7fa548156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.355+0000 7fa546a00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5480d2450 0x7fa548150840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa53800c390 tx=0x7fa53800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.355+0000 7fa53f400640 1 -- 172.21.15.81:0/1531438905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538011790 con 0x7fa5480d2450 2024-09-10T20:41:59.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.355+0000 7fa53f400640 1 -- 172.21.15.81:0/1531438905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa538017070 con 0x7fa5480d2450 2024-09-10T20:41:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.355+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5481f8110 con 0x7fa5480d2450 2024-09-10T20:41:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.355+0000 7fa53f400640 1 -- 172.21.15.81:0/1531438905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538011ca0 con 0x7fa5480d2450 2024-09-10T20:41:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.355+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5481f86d0 con 0x7fa5480d2450 2024-09-10T20:41:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.356+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5481f88d0 con 0x7fa5480d2450 2024-09-10T20:41:59.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.357+0000 7fa53f400640 1 -- 172.21.15.81:0/1531438905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa53801c460 con 0x7fa5480d2450 2024-09-10T20:41:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.358+0000 7fa53f400640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa528077fa0 0x7fa52807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.358+0000 7fa53f400640 1 -- 172.21.15.81:0/1531438905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fa5380999b0 con 0x7fa5480d2450 2024-09-10T20:41:59.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.358+0000 7fa546000640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa528077fa0 0x7fa52807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.359+0000 7fa546000640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa528077fa0 0x7fa52807a460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa54815c8f0 tx=0x7fa534009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:59.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.362+0000 7fa53f400640 1 -- 172.21.15.81:0/1531438905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa5481f88d0 con 0x7fa5480d2450 2024-09-10T20:41:59.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.542+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5480cf240 con 0x7fa528077fa0 2024-09-10T20:41:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.543+0000 7fa53f400640 1 -- 172.21.15.81:0/1531438905 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13495 (secure 0 0 0) 0x7fa5480cf240 con 0x7fa528077fa0 2024-09-10T20:41:59.547 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa528077fa0 msgr2=0x7fa52807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa528077fa0 0x7fa52807a460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa54815c8f0 tx=0x7fa534009040 comp rx=0 tx=0).stop 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5480d2450 msgr2=0x7fa548150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5480d2450 0x7fa548150840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa53800c390 tx=0x7fa53800c850 comp rx=0 tx=0).stop 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 shutdown_connections 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa528077fa0 0x7fa52807a460 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54815df60 0x7fa5480b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5480d47e0 0x7fa548156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 --2- 172.21.15.81:0/1531438905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5480d2450 0x7fa548150840 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 >> 172.21.15.81:0/1531438905 conn(0x7fa5480d3cc0 msgr2=0x7fa5480ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.545+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 shutdown_connections 2024-09-10T20:41:59.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.546+0000 7fa547e00640 1 -- 172.21.15.81:0/1531438905 wait complete. 2024-09-10T20:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-10T20:41:57.878171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234508,"kb_used_data":18284,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740212,"statfs":{"total":773094113280,"available":772853977088,"internally_reserved":0,"allocated":18722816,"data_stored":16022605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322167,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001666"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-10T20:41:55.138849+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:55.138849+0000","last_peered":"2024-09-10T20:41:55.138849+0000","last_clean":"2024-09-10T20:41:55.138849+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:55.138849+0000","last_undegraded":"2024-09-10T20:41:55.138849+0000","last_fullsized":"2024-09-10T20:41:55.138849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":276847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":277373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":622592,"data_stored":283432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33768,"kb_used_data":6740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338072,"statfs":{"total":96636764160,"available":96602185728,"internally_reserved":0,"allocated":6901760,"data_stored":6568337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":276825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1216512,"data_stored":873800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29672,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342168,"statfs":{"total":96636764160,"available":96606380032,"internally_reserved":0,"allocated":2707456,"data_stored":2374525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":5312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":5439488,"data_stored":5091466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:59.566 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T20:41:59.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:41:59.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.719+0000 7f0451e00640 1 -- 172.21.15.81:0/241609505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 msgr2=0x7f043000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.719+0000 7f0451e00640 1 --2- 172.21.15.81:0/241609505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 0x7f043000b9c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0444009b90 tx=0x7f0430005830 comp rx=0 tx=0).stop 2024-09-10T20:41:59.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.719+0000 7f0451400640 1 -- 172.21.15.81:0/241609505 reap_dead start 2024-09-10T20:41:59.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.720+0000 7f0451e00640 1 -- 172.21.15.81:0/241609505 shutdown_connections 2024-09-10T20:41:59.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.720+0000 7f0451e00640 1 -- 172.21.15.81:0/241609505 >> 172.21.15.81:0/241609505 conn(0x7f044c06c690 msgr2=0x7f044c06ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:59.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.720+0000 7f0451e00640 1 -- 172.21.15.81:0/241609505 shutdown_connections 2024-09-10T20:41:59.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.720+0000 7f0451e00640 1 -- 172.21.15.81:0/241609505 wait complete. 2024-09-10T20:41:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.721+0000 7f0451e00640 1 Processor -- start 2024-09-10T20:41:59.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.721+0000 7f0451e00640 1 -- start start 2024-09-10T20:41:59.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.722+0000 7f0451e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 0x7f044c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.722+0000 7f0451e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f044c15e540 0x7f044c1f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.722+0000 7f0451e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f044c1f8480 0x7f044c1f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0451e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0c9fd0 con 0x7f0430005210 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0451e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0c9e50 con 0x7f044c15e540 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0451e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f044c0ca150 con 0x7f044c1f8480 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 0x7f044c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 0x7f044c15bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35094/0 (socket says 172.21.15.81:35094) 2024-09-10T20:41:59.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 -- 172.21.15.81:0/2823443353 learned_addr learned my addr 172.21.15.81:0/2823443353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f044be00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f044c15e540 0x7f044c1f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0451400640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f044c1f8480 0x7f044c1f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 -- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f044c1f8480 msgr2=0x7f044c1f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f044c1f8480 0x7f044c1f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 -- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f044c15e540 msgr2=0x7f044c1f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f044c15e540 0x7f044c1f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 -- 172.21.15.81:0/2823443353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c15eab0 con 0x7f0430005210 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0451400640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f044c1f8480 0x7f044c1f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f044be00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f044c15e540 0x7f044c1f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0450a00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 0x7f044c15bf60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f043c006110 tx=0x7f043c0065d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.723+0000 7f0448c00640 1 -- 172.21.15.81:0/2823443353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c015070 con 0x7f0430005210 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.724+0000 7f0448c00640 1 -- 172.21.15.81:0/2823443353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f043c00fd40 con 0x7f0430005210 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.724+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c15ed90 con 0x7f0430005210 2024-09-10T20:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.724+0000 7f0448c00640 1 -- 172.21.15.81:0/2823443353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c011690 con 0x7f0430005210 2024-09-10T20:41:59.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.724+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c158ca0 con 0x7f0430005210 2024-09-10T20:41:59.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.725+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c158ea0 con 0x7f0430005210 2024-09-10T20:41:59.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.726+0000 7f0448c00640 1 -- 172.21.15.81:0/2823443353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f043c011830 con 0x7f0430005210 2024-09-10T20:41:59.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.727+0000 7f0448c00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0428077fa0 0x7f042807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:41:59.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.727+0000 7f0448c00640 1 -- 172.21.15.81:0/2823443353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f043c09ab80 con 0x7f0430005210 2024-09-10T20:41:59.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.727+0000 7f044be00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0428077fa0 0x7f042807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:41:59.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.728+0000 7f044be00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0428077fa0 0x7f042807a460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0434000c00 tx=0x7f0434001580 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:41:59.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.731+0000 7f0448c00640 1 -- 172.21.15.81:0/2823443353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f044c158ea0 con 0x7f0430005210 2024-09-10T20:41:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.910+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f044c0ca670 con 0x7f0428077fa0 2024-09-10T20:41:59.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.911+0000 7f0448c00640 1 -- 172.21.15.81:0/2823443353 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13493 (secure 0 0 0) 0x7f044c0ca670 con 0x7f0428077fa0 2024-09-10T20:41:59.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:41:59.915 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.913+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0428077fa0 msgr2=0x7f042807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.913+0000 7f0451e00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0428077fa0 0x7f042807a460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0434000c00 tx=0x7f0434001580 comp rx=0 tx=0).stop 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.913+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 msgr2=0x7f044c15bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.913+0000 7f0451e00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 0x7f044c15bf60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f043c006110 tx=0x7f043c0065d0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 shutdown_connections 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f0428077fa0 0x7f042807a460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f044c1f8480 0x7f044c1f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f044c15e540 0x7f044c1f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 --2- 172.21.15.81:0/2823443353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0430005210 0x7f044c15bf60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 >> 172.21.15.81:0/2823443353 conn(0x7f044c06c690 msgr2=0x7f044c0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:41:59.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 shutdown_connections 2024-09-10T20:41:59.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:41:59.914+0000 7f0451e00640 1 -- 172.21.15.81:0/2823443353 wait complete. 2024-09-10T20:41:59.933 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-09-10T20:41:59.878502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230404,"kb_used_data":14176,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754744316,"statfs":{"total":773094113280,"available":772858179584,"internally_reserved":0,"allocated":14516224,"data_stored":11811072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322167,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.007413"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-10T20:41:55.138849+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:55.138849+0000","last_peered":"2024-09-10T20:41:55.138849+0000","last_clean":"2024-09-10T20:41:55.138849+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:55.138849+0000","last_undegraded":"2024-09-10T20:41:55.138849+0000","last_fullsized":"2024-09-10T20:41:55.138849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":276847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":277373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":622592,"data_stored":283432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33768,"kb_used_data":6740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338072,"statfs":{"total":96636764160,"available":96602185728,"internally_reserved":0,"allocated":6901760,"data_stored":6568337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":610304,"data_stored":276825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509472,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1216512,"data_stored":873800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29672,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342168,"statfs":{"total":96636764160,"available":96606380032,"internally_reserved":0,"allocated":2707456,"data_stored":2374525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1232896,"data_stored":879933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:41:59.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T20:42:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 -- 172.21.15.81:0/2750860353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c0cf240 msgr2=0x7fa74c0d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 --2- 172.21.15.81:0/2750860353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c0cf240 0x7fa74c0d1d40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa738009830 tx=0x7fa73802a500 comp rx=0 tx=0).stop 2024-09-10T20:42:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 -- 172.21.15.81:0/2750860353 shutdown_connections 2024-09-10T20:42:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 --2- 172.21.15.81:0/2750860353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c0cf240 0x7fa74c0d1d40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 --2- 172.21.15.81:0/2750860353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa74c15df60 0x7fa74c0d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 -- 172.21.15.81:0/2750860353 >> 172.21.15.81:0/2750860353 conn(0x7fa74c0d3cc0 msgr2=0x7fa74c0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 -- 172.21.15.81:0/2750860353 shutdown_connections 2024-09-10T20:42:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.087+0000 7fa752200640 1 -- 172.21.15.81:0/2750860353 wait complete. 2024-09-10T20:42:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.089+0000 7fa752200640 1 Processor -- start 2024-09-10T20:42:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.089+0000 7fa752200640 1 -- start start 2024-09-10T20:42:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa752200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa74c0cf240 0x7fa74c160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa752200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c0d2280 0x7fa74c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa752200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c15df60 0x7fa74c1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa752200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c0d0de0 con 0x7fa74c0d2280 2024-09-10T20:42:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa752200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c0b54c0 con 0x7fa74c15df60 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa752200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa74c0d0f60 con 0x7fa74c0cf240 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa74be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c0d2280 0x7fa74c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa74be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c0d2280 0x7fa74c152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35100/0 (socket says 172.21.15.81:35100) 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa74be00640 1 -- 172.21.15.81:0/17240016 learned_addr learned my addr 172.21.15.81:0/17240016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa750e00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa74c0cf240 0x7fa74c160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa751800640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c15df60 0x7fa74c1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.090+0000 7fa74be00640 1 -- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa74c0cf240 msgr2=0x7fa74c160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa74be00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa74c0cf240 0x7fa74c160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa74be00640 1 -- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c15df60 msgr2=0x7fa74c1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa74be00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c15df60 0x7fa74c1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa74be00640 1 -- 172.21.15.81:0/17240016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c0b6c20 con 0x7fa74c0d2280 2024-09-10T20:42:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa750e00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa74c0cf240 0x7fa74c160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa74be00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c0d2280 0x7fa74c152c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa738000c00 tx=0x7fa738032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa748c00640 1 -- 172.21.15.81:0/17240016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738040070 con 0x7fa74c0d2280 2024-09-10T20:42:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa748c00640 1 -- 172.21.15.81:0/17240016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7380038e0 con 0x7fa74c0d2280 2024-09-10T20:42:00.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c0b6ec0 con 0x7fa74c0d2280 2024-09-10T20:42:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa748c00640 1 -- 172.21.15.81:0/17240016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738005c90 con 0x7fa74c0d2280 2024-09-10T20:42:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.091+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c0b7480 con 0x7fa74c0d2280 2024-09-10T20:42:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.092+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c0d1480 con 0x7fa74c0d2280 2024-09-10T20:42:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.093+0000 7fa748c00640 1 -- 172.21.15.81:0/17240016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fa738045460 con 0x7fa74c0d2280 2024-09-10T20:42:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.094+0000 7fa748c00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa72c077fa0 0x7fa72c07a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.094+0000 7fa748c00640 1 -- 172.21.15.81:0/17240016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fa7380bb630 con 0x7fa74c0d2280 2024-09-10T20:42:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.095+0000 7fa750e00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa72c077fa0 0x7fa72c07a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.095+0000 7fa750e00640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa72c077fa0 0x7fa72c07a460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa74c1608a0 tx=0x7fa73c005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:00.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.098+0000 7fa748c00640 1 -- 172.21.15.81:0/17240016 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fa7380841c0 con 0x7fa74c0d2280 2024-09-10T20:42:00.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.283+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa74c0b16d0 con 0x7fa74c0d2280 2024-09-10T20:42:00.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.283+0000 7fa748c00640 1 -- 172.21.15.81:0/17240016 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13425 (secure 0 0 0) 0x7fa738083ac0 con 0x7fa74c0d2280 2024-09-10T20:42:00.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:42:00.288 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"fsid":"0ea88071-0b16-46b5-b258-7e2fd8f41721","created":"2024-09-10T20:39:26.580761+0000","modified":"2024-09-10T20:41:56.135898+0000","last_up_change":"2024-09-10T20:39:40.869091+0000","last_in_change":"2024-09-10T20:39:30.770629+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T20:39:41.868775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"19c30155-6b91-4056-b040-1a86a4664e88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6801","nonce":4080460515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6803","nonce":4080460515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6807","nonce":4080460515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":4080460515},{"type":"v1","addr":"172.21.15.81:6805","nonce":4080460515}]},"public_addr":"172.21.15.81:6801/4080460515","cluster_addr":"172.21.15.81:6803/4080460515","heartbeat_back_addr":"172.21.15.81:6807/4080460515","heartbeat_front_addr":"172.21.15.81:6805/4080460515","state":["exists","up"]},{"osd":1,"uuid":"89867ff2-a374-4c4b-a833-3ec4923b4e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6813","nonce":310566059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6819","nonce":310566059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6831","nonce":310566059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":310566059},{"type":"v1","addr":"172.21.15.81:6825","nonce":310566059}]},"public_addr":"172.21.15.81:6813/310566059","cluster_addr":"172.21.15.81:6819/310566059","heartbeat_back_addr":"172.21.15.81:6831/310566059","heartbeat_front_addr":"172.21.15.81:6825/310566059","state":["exists","up"]},{"osd":2,"uuid":"83c8e5d3-77de-4127-a9fa-0708ae29bd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6809","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6812","nonce":2010302829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6815","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6818","nonce":2010302829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6830","nonce":2010302829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6821","nonce":2010302829},{"type":"v1","addr":"172.21.15.81:6824","nonce":2010302829}]},"public_addr":"172.21.15.81:6812/2010302829","cluster_addr":"172.21.15.81:6818/2010302829","heartbeat_back_addr":"172.21.15.81:6830/2010302829","heartbeat_front_addr":"172.21.15.81:6824/2010302829","state":["exists","up"]},{"osd":3,"uuid":"3fa9706d-3b77-4f7a-983e-8ba2994b58fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6811","nonce":906295494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6817","nonce":906295494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6829","nonce":906295494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":906295494},{"type":"v1","addr":"172.21.15.81:6823","nonce":906295494}]},"public_addr":"172.21.15.81:6811/906295494","cluster_addr":"172.21.15.81:6817/906295494","heartbeat_back_addr":"172.21.15.81:6829/906295494","heartbeat_front_addr":"172.21.15.81:6823/906295494","state":["exists","up"]},{"osd":4,"uuid":"60735205-4db2-44f8-a938-28feae88b9b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6827","nonce":4019230190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6829","nonce":4019230190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6833","nonce":4019230190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":4019230190},{"type":"v1","addr":"172.21.15.143:6831","nonce":4019230190}]},"public_addr":"172.21.15.143:6827/4019230190","cluster_addr":"172.21.15.143:6829/4019230190","heartbeat_back_addr":"172.21.15.143:6833/4019230190","heartbeat_front_addr":"172.21.15.143:6831/4019230190","state":["exists","up"]},{"osd":5,"uuid":"294e189c-0ca0-440d-823d-103c42c6dab6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6803","nonce":1659339177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6805","nonce":1659339177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6809","nonce":1659339177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1659339177},{"type":"v1","addr":"172.21.15.143:6807","nonce":1659339177}]},"public_addr":"172.21.15.143:6803/1659339177","cluster_addr":"172.21.15.143:6805/1659339177","heartbeat_back_addr":"172.21.15.143:6809/1659339177","heartbeat_front_addr":"172.21.15.143:6807/1659339177","state":["exists","up"]},{"osd":6,"uuid":"201fea3a-0302-4e05-b2e0-6e283996e641","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6819","nonce":294800477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6821","nonce":294800477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6825","nonce":294800477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":294800477},{"type":"v1","addr":"172.21.15.143:6823","nonce":294800477}]},"public_addr":"172.21.15.143:6819/294800477","cluster_addr":"172.21.15.143:6821/294800477","heartbeat_back_addr":"172.21.15.143:6825/294800477","heartbeat_front_addr":"172.21.15.143:6823/294800477","state":["exists","up"]},{"osd":7,"uuid":"ffa4dac4-7ce1-471f-8d31-d6c1b2ed83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6811","nonce":3238341229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6813","nonce":3238341229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6817","nonce":3238341229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3238341229},{"type":"v1","addr":"172.21.15.143:6815","nonce":3238341229}]},"public_addr":"172.21.15.143:6811/3238341229","cluster_addr":"172.21.15.143:6813/3238341229","heartbeat_back_addr":"172.21.15.143:6817/3238341229","heartbeat_front_addr":"172.21.15.143:6815/3238341229","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.262877+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.370580+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.158049+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.321936+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.641490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.067824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.616087+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T20:39:37.359454+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2525007844":"2024-09-11T20:41:52.867467+0000","172.21.15.81:6833/2525007844":"2024-09-11T20:41:52.867467+0000","172.21.15.143:6837/3550323967":"2024-09-11T20:41:14.470093+0000","172.21.15.143:6835/3550323967":"2024-09-11T20:41:14.470093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T20:42:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa72c077fa0 msgr2=0x7fa72c07a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa72c077fa0 0x7fa72c07a460 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa74c1608a0 tx=0x7fa73c005f90 comp rx=0 tx=0).stop 2024-09-10T20:42:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c0d2280 msgr2=0x7fa74c152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c0d2280 0x7fa74c152c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa738000c00 tx=0x7fa738032c10 comp rx=0 tx=0).stop 2024-09-10T20:42:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 shutdown_connections 2024-09-10T20:42:00.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fa72c077fa0 0x7fa72c07a460 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa74c15df60 0x7fa74c1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa74c0d2280 0x7fa74c152c90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 --2- 172.21.15.81:0/17240016 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa74c0cf240 0x7fa74c160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 >> 172.21.15.81:0/17240016 conn(0x7fa74c0d3cc0 msgr2=0x7fa74c0d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 shutdown_connections 2024-09-10T20:42:00.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:00.286+0000 7fa752200640 1 -- 172.21.15.81:0/17240016 wait complete. 2024-09-10T20:42:01.306 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T20:42:01.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.467+0000 7f623a200640 1 -- 172.21.15.81:0/492993609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62340d47f0 msgr2=0x7f62340d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.467+0000 7f623a200640 1 --2- 172.21.15.81:0/492993609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62340d47f0 0x7f62340d25b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f62340b66f0 tx=0x7f622002a6c0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.468+0000 7f623a200640 1 -- 172.21.15.81:0/492993609 shutdown_connections 2024-09-10T20:42:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.468+0000 7f623a200640 1 --2- 172.21.15.81:0/492993609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62340d47f0 0x7f62340d25b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.468+0000 7f623a200640 1 --2- 172.21.15.81:0/492993609 >> v2:172.21.15.143:3300/0 conn(0x7f623415dce0 0x7f62340cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.468+0000 7f623a200640 1 -- 172.21.15.81:0/492993609 >> 172.21.15.81:0/492993609 conn(0x7f62340d3bf0 msgr2=0x7f62340d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:01.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.468+0000 7f623a200640 1 -- 172.21.15.81:0/492993609 shutdown_connections 2024-09-10T20:42:01.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.468+0000 7f623a200640 1 -- 172.21.15.81:0/492993609 wait complete. 2024-09-10T20:42:01.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.469+0000 7f623a200640 1 Processor -- start 2024-09-10T20:42:01.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.469+0000 7f623a200640 1 -- start start 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.470+0000 7f623a200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62340d47f0 0x7f6234160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.470+0000 7f623a200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623415dce0 0x7f6234160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.470+0000 7f623a200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6234161850 0x7f6234153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.470+0000 7f623a200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62340b7150 con 0x7f623415dce0 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.470+0000 7f623a200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f62340d2d00 con 0x7f6234161850 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.470+0000 7f623a200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f62340b72d0 con 0x7f62340d47f0 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623415dce0 0x7f6234160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623415dce0 0x7f6234160880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35120/0 (socket says 172.21.15.81:35120) 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 -- 172.21.15.81:0/408156596 learned_addr learned my addr 172.21.15.81:0/408156596 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6238e00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62340d47f0 0x7f6234160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6239800640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6234161850 0x7f6234153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 -- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62340d47f0 msgr2=0x7f6234160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62340d47f0 0x7f6234160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 -- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6234161850 msgr2=0x7f6234153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6234161850 0x7f6234153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 -- 172.21.15.81:0/408156596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62340b0a40 con 0x7f623415dce0 2024-09-10T20:42:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.471+0000 7f6233e00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623415dce0 0x7f6234160880 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6220009850 tx=0x7f6220003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.472+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622003f070 con 0x7f623415dce0 2024-09-10T20:42:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.472+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62200047a0 con 0x7f623415dce0 2024-09-10T20:42:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.472+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220035030 con 0x7f623415dce0 2024-09-10T20:42:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.472+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62341f81e0 con 0x7f623415dce0 2024-09-10T20:42:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.472+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341f87a0 con 0x7f623415dce0 2024-09-10T20:42:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.473+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62340d25b0 con 0x7f623415dce0 2024-09-10T20:42:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.474+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6220004bb0 con 0x7f623415dce0 2024-09-10T20:42:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.475+0000 7f6230c00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6214077f70 0x7f621407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.475+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f62200bacb0 con 0x7f623415dce0 2024-09-10T20:42:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.475+0000 7f6230c00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f621407e4b0 0x7f62140808f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.475+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6220036e90 con 0x7f621407e4b0 2024-09-10T20:42:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.475+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f62200bd3b0 con 0x7f623415dce0 2024-09-10T20:42:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.476+0000 7f6238e00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6214077f70 0x7f621407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.476+0000 7f6239800640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f621407e4b0 0x7f62140808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.476+0000 7f6238e00640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6214077f70 0x7f621407a430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f62340cb590 tx=0x7f62240096d0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.476+0000 7f6239800640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f621407e4b0 0x7f62140808f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.477+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== osd.0 v2:172.21.15.81:6800/4080460515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6220036e90 con 0x7f621407e4b0 2024-09-10T20:42:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.490+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 --> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f62340b9b70 con 0x7f621407e4b0 2024-09-10T20:42:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.490+0000 7f6230c00640 1 -- 172.21.15.81:0/408156596 <== osd.0 v2:172.21.15.81:6800/4080460515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f62340b9b70 con 0x7f621407e4b0 2024-09-10T20:42:01.494 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:01.495 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f621407e4b0 msgr2=0x7f62140808f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:6800/4080460515,v1:172.21.15.81:6801/4080460515] conn(0x7f621407e4b0 0x7f62140808f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6214077f70 msgr2=0x7f621407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6214077f70 0x7f621407a430 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f62340cb590 tx=0x7f62240096d0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623415dce0 msgr2=0x7f6234160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 --2- 172.21.15.81:0/408156596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f623415dce0 0x7f6234160880 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6220009850 tx=0x7f6220003910 comp rx=0 tx=0).stop 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f6239800640 1 -- 172.21.15.81:0/408156596 reap_dead start 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 shutdown_connections 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 >> 172.21.15.81:0/408156596 conn(0x7f62340d3bf0 msgr2=0x7f623406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 shutdown_connections 2024-09-10T20:42:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.491+0000 7f623a200640 1 -- 172.21.15.81:0/408156596 wait complete. 2024-09-10T20:42:01.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T20:42:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 -- 172.21.15.81:0/1451881007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 msgr2=0x7f6d2015fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1451881007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d2015fac0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6d20074910 tx=0x7f6d1802aa30 comp rx=0 tx=0).stop 2024-09-10T20:42:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 -- 172.21.15.81:0/1451881007 shutdown_connections 2024-09-10T20:42:01.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1451881007 >> v2:172.21.15.143:3300/0 conn(0x7f6d2006e660 0x7f6d2006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1451881007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d2015fac0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1451881007 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d2015ee50 0x7f6d2015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 -- 172.21.15.81:0/1451881007 >> 172.21.15.81:0/1451881007 conn(0x7f6d20068f90 msgr2=0x7f6d2006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 -- 172.21.15.81:0/1451881007 shutdown_connections 2024-09-10T20:42:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.664+0000 7f6d24a00640 1 -- 172.21.15.81:0/1451881007 wait complete. 2024-09-10T20:42:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.666+0000 7f6d24a00640 1 Processor -- start 2024-09-10T20:42:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.666+0000 7f6d24a00640 1 -- start start 2024-09-10T20:42:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d24a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d2006e660 0x7f6d200cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d24a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d2015ee50 0x7f6d201594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d24a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d201f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d24a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d200cccf0 con 0x7f6d2015f630 2024-09-10T20:42:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d24a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6d200ccb70 con 0x7f6d2006e660 2024-09-10T20:42:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d24a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6d20160000 con 0x7f6d2015ee50 2024-09-10T20:42:01.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d201f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d201f76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35138/0 (socket says 172.21.15.81:35138) 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 -- 172.21.15.81:0/1228089321 learned_addr learned my addr 172.21.15.81:0/1228089321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1de00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d2006e660 0x7f6d200cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1d400640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d2015ee50 0x7f6d201594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 -- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d2015ee50 msgr2=0x7f6d201594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d2015ee50 0x7f6d201594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 -- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d2006e660 msgr2=0x7f6d200cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d2006e660 0x7f6d200cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.667+0000 7f6d1e800640 1 -- 172.21.15.81:0/1228089321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d200725b0 con 0x7f6d2015f630 2024-09-10T20:42:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.668+0000 7f6d1e800640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d201f76f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6d18005fd0 tx=0x7f6d18003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.668+0000 7f6d16000640 1 -- 172.21.15.81:0/1228089321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18033050 con 0x7f6d2015f630 2024-09-10T20:42:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.668+0000 7f6d16000640 1 -- 172.21.15.81:0/1228089321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d18004450 con 0x7f6d2015f630 2024-09-10T20:42:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.668+0000 7f6d16000640 1 -- 172.21.15.81:0/1228089321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18004840 con 0x7f6d2015f630 2024-09-10T20:42:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.668+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d20072890 con 0x7f6d2015f630 2024-09-10T20:42:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.668+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d20072e50 con 0x7f6d2015f630 2024-09-10T20:42:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.669+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d20073050 con 0x7f6d2015f630 2024-09-10T20:42:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.670+0000 7f6d16000640 1 -- 172.21.15.81:0/1228089321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6d18040070 con 0x7f6d2015f630 2024-09-10T20:42:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.671+0000 7f6d16000640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d00077f70 0x7f6d0007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.671+0000 7f6d16000640 1 -- 172.21.15.81:0/1228089321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f6d180bae00 con 0x7f6d2015f630 2024-09-10T20:42:01.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.672+0000 7f6d1de00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d00077f70 0x7f6d0007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:01.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.672+0000 7f6d1de00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d00077f70 0x7f6d0007a430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6d20144b80 tx=0x7f6d1000b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:01.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.675+0000 7f6d16000640 1 -- 172.21.15.81:0/1228089321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6d20073050 con 0x7f6d2015f630 2024-09-10T20:42:01.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.860+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6d201f50a0 con 0x7f6d00077f70 2024-09-10T20:42:01.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.861+0000 7f6d16000640 1 -- 172.21.15.81:0/1228089321 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d201f50a0 con 0x7f6d00077f70 2024-09-10T20:42:01.865 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.863+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d00077f70 msgr2=0x7f6d0007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.863+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d00077f70 0x7f6d0007a430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6d20144b80 tx=0x7f6d1000b390 comp rx=0 tx=0).stop 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.863+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 msgr2=0x7f6d201f76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.863+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d201f76f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6d18005fd0 tx=0x7f6d18003f10 comp rx=0 tx=0).stop 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.863+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 shutdown_connections 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.863+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d00077f70 0x7f6d0007a430 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.863+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d2015f630 0x7f6d201f76f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.864+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d2015ee50 0x7f6d201594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.864+0000 7f6d24a00640 1 --2- 172.21.15.81:0/1228089321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d2006e660 0x7f6d200cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:01.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.864+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 >> 172.21.15.81:0/1228089321 conn(0x7f6d20068f90 msgr2=0x7f6d20153060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:01.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.864+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 shutdown_connections 2024-09-10T20:42:01.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:01.864+0000 7f6d24a00640 1 -- 172.21.15.81:0/1228089321 wait complete. 2024-09-10T20:42:01.883 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T20:42:01.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:02.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.042+0000 7fd58e000640 1 -- 172.21.15.81:0/3236945073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c003c60 msgr2=0x7fd56c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.042+0000 7fd58e000640 1 --2- 172.21.15.81:0/3236945073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd56c003c60 0x7fd56c004060 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd578006e50 tx=0x7fd56c005830 comp rx=0 tx=0).stop 2024-09-10T20:42:02.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.042+0000 7fd587e00640 1 -- 172.21.15.81:0/3236945073 reap_dead start 2024-09-10T20:42:02.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.042+0000 7fd58e000640 1 -- 172.21.15.81:0/3236945073 shutdown_connections 2024-09-10T20:42:02.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.042+0000 7fd58e000640 1 -- 172.21.15.81:0/3236945073 >> 172.21.15.81:0/3236945073 conn(0x7fd588069020 msgr2=0x7fd58806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:02.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.042+0000 7fd58e000640 1 -- 172.21.15.81:0/3236945073 shutdown_connections 2024-09-10T20:42:02.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.042+0000 7fd58e000640 1 -- 172.21.15.81:0/3236945073 wait complete. 2024-09-10T20:42:02.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.044+0000 7fd58e000640 1 Processor -- start 2024-09-10T20:42:02.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.044+0000 7fd58e000640 1 -- start start 2024-09-10T20:42:02.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd58e000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c003c60 0x7fd588143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd58e000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5880736a0 0x7fd588073fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd58e000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd588143700 0x7fd5881e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd58e000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd58815e820 con 0x7fd588143700 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd58e000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd588145810 con 0x7fd56c003c60 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd58e000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd58815e9a0 con 0x7fd5880736a0 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd587e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd588143700 0x7fd5881e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd587e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd588143700 0x7fd5881e60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35162/0 (socket says 172.21.15.81:35162) 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd587e00640 1 -- 172.21.15.81:0/501041958 learned_addr learned my addr 172.21.15.81:0/501041958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd587400640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c003c60 0x7fd588143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.045+0000 7fd586a00640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5880736a0 0x7fd588073fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd587e00640 1 -- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5880736a0 msgr2=0x7fd588073fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd587e00640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5880736a0 0x7fd588073fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd587e00640 1 -- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c003c60 msgr2=0x7fd588143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd587e00640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c003c60 0x7fd588143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd587e00640 1 -- 172.21.15.81:0/501041958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5881f8780 con 0x7fd588143700 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd587400640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd56c003c60 0x7fd588143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd586a00640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5880736a0 0x7fd588073fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd587e00640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd588143700 0x7fd5881e60a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd580001330 tx=0x7fd580006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580015070 con 0x7fd588143700 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd580011920 con 0x7fd588143700 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5881f8a60 con 0x7fd588143700 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580011d70 con 0x7fd588143700 2024-09-10T20:42:02.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.046+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5881e7770 con 0x7fd588143700 2024-09-10T20:42:02.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.047+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5880cf5f0 con 0x7fd588143700 2024-09-10T20:42:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.048+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd58000f430 con 0x7fd588143700 2024-09-10T20:42:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.049+0000 7fd57f400640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd568077fa0 0x7fd56807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.049+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fd58009a900 con 0x7fd588143700 2024-09-10T20:42:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.050+0000 7fd57f400640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd56807e4e0 0x7fd568080920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.050+0000 7fd587400640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd568077fa0 0x7fd56807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.050+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd580008e50 con 0x7fd56807e4e0 2024-09-10T20:42:02.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.050+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd58009f2a0 con 0x7fd588143700 2024-09-10T20:42:02.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.050+0000 7fd586a00640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd56807e4e0 0x7fd568080920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.050+0000 7fd586a00640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd56807e4e0 0x7fd568080920 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.050+0000 7fd587400640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd568077fa0 0x7fd56807a460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd578033000 tx=0x7fd58815c920 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.051+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== osd.1 v2:172.21.15.81:6810/310566059 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd580008e50 con 0x7fd56807e4e0 2024-09-10T20:42:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.064+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 --> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd58806eae0 con 0x7fd56807e4e0 2024-09-10T20:42:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.064+0000 7fd57f400640 1 -- 172.21.15.81:0/501041958 <== osd.1 v2:172.21.15.81:6810/310566059 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd58806eae0 con 0x7fd56807e4e0 2024-09-10T20:42:02.068 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:02.069 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:02.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd56807e4e0 msgr2=0x7fd568080920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:6810/310566059,v1:172.21.15.81:6813/310566059] conn(0x7fd56807e4e0 0x7fd568080920 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd568077fa0 msgr2=0x7fd56807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd568077fa0 0x7fd56807a460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd578033000 tx=0x7fd58815c920 comp rx=0 tx=0).stop 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd588143700 msgr2=0x7fd5881e60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 --2- 172.21.15.81:0/501041958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd588143700 0x7fd5881e60a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd580001330 tx=0x7fd580006430 comp rx=0 tx=0).stop 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd587e00640 1 -- 172.21.15.81:0/501041958 reap_dead start 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 shutdown_connections 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 >> 172.21.15.81:0/501041958 conn(0x7fd588069020 msgr2=0x7fd588075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 shutdown_connections 2024-09-10T20:42:02.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.065+0000 7fd58e000640 1 -- 172.21.15.81:0/501041958 wait complete. 2024-09-10T20:42:02.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T20:42:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 -- 172.21.15.81:0/250399153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe815ee50 msgr2=0x7fbbe815c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 --2- 172.21.15.81:0/250399153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe815ee50 0x7fbbe815c900 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbbe815c040 tx=0x7fbbdc02a560 comp rx=0 tx=0).stop 2024-09-10T20:42:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 -- 172.21.15.81:0/250399153 shutdown_connections 2024-09-10T20:42:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 --2- 172.21.15.81:0/250399153 >> v2:172.21.15.143:3300/0 conn(0x7fbbe815f630 0x7fbbe815fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 --2- 172.21.15.81:0/250399153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe806e660 0x7fbbe806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 --2- 172.21.15.81:0/250399153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe815ee50 0x7fbbe815c900 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 -- 172.21.15.81:0/250399153 >> 172.21.15.81:0/250399153 conn(0x7fbbe8068f90 msgr2=0x7fbbe806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 -- 172.21.15.81:0/250399153 shutdown_connections 2024-09-10T20:42:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.238+0000 7fbbf0000640 1 -- 172.21.15.81:0/250399153 wait complete. 2024-09-10T20:42:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.240+0000 7fbbf0000640 1 Processor -- start 2024-09-10T20:42:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.240+0000 7fbbf0000640 1 -- start start 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.240+0000 7fbbf0000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806e660 0x7fbbe81f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.240+0000 7fbbf0000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe815ee50 0x7fbbe8153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbf0000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe815f630 0x7fbbe81f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbf0000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe80cccf0 con 0x7fbbe806e660 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbf0000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe80ccb70 con 0x7fbbe815f630 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbf0000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe8160000 con 0x7fbbe815ee50 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806e660 0x7fbbe81f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806e660 0x7fbbe81f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35188/0 (socket says 172.21.15.81:35188) 2024-09-10T20:42:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 -- 172.21.15.81:0/1888670047 learned_addr learned my addr 172.21.15.81:0/1888670047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbecc00640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe815ee50 0x7fbbe8153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbee000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe815f630 0x7fbbe81f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 -- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe815ee50 msgr2=0x7fbbe8153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe815ee50 0x7fbbe8153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 -- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe815f630 msgr2=0x7fbbe81f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe815f630 0x7fbbe81f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 -- 172.21.15.81:0/1888670047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe81f41b0 con 0x7fbbe806e660 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbee000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe815f630 0x7fbbe81f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.241+0000 7fbbed600640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806e660 0x7fbbe81f5250 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0099c0 tx=0x7fbbdc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.242+0000 7fbbe5600640 1 -- 172.21.15.81:0/1888670047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc03f070 con 0x7fbbe806e660 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.242+0000 7fbbe5600640 1 -- 172.21.15.81:0/1888670047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbdc004890 con 0x7fbbe806e660 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.242+0000 7fbbe5600640 1 -- 172.21.15.81:0/1888670047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc035030 con 0x7fbbe806e660 2024-09-10T20:42:02.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.242+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe81f4490 con 0x7fbbe806e660 2024-09-10T20:42:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.242+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe81f4a50 con 0x7fbbe806e660 2024-09-10T20:42:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.243+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe815c8e0 con 0x7fbbe806e660 2024-09-10T20:42:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.244+0000 7fbbe5600640 1 -- 172.21.15.81:0/1888670047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fbbdc004ce0 con 0x7fbbe806e660 2024-09-10T20:42:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.245+0000 7fbbe5600640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbbc8077f70 0x7fbbc807a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.245+0000 7fbbe5600640 1 -- 172.21.15.81:0/1888670047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fbbdc0bad20 con 0x7fbbe806e660 2024-09-10T20:42:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.246+0000 7fbbecc00640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbbc8077f70 0x7fbbc807a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.246+0000 7fbbecc00640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbbc8077f70 0x7fbbc807a430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbbe81f34a0 tx=0x7fbbd400b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.249+0000 7fbbe5600640 1 -- 172.21.15.81:0/1888670047 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fbbdc0832f0 con 0x7fbbe806e660 2024-09-10T20:42:02.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.433+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fbbe815e350 con 0x7fbbc8077f70 2024-09-10T20:42:02.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.434+0000 7fbbe5600640 1 -- 172.21.15.81:0/1888670047 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbbe815e350 con 0x7fbbc8077f70 2024-09-10T20:42:02.437 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T20:42:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbbc8077f70 msgr2=0x7fbbc807a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbbc8077f70 0x7fbbc807a430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbbe81f34a0 tx=0x7fbbd400b390 comp rx=0 tx=0).stop 2024-09-10T20:42:02.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806e660 msgr2=0x7fbbe81f5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806e660 0x7fbbe81f5250 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0099c0 tx=0x7fbbdc0039e0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 shutdown_connections 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fbbc8077f70 0x7fbbc807a430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe815f630 0x7fbbe81f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe815ee50 0x7fbbe8153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 --2- 172.21.15.81:0/1888670047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806e660 0x7fbbe81f5250 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 >> 172.21.15.81:0/1888670047 conn(0x7fbbe8068f90 msgr2=0x7fbbe80c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 shutdown_connections 2024-09-10T20:42:02.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.436+0000 7fbbf0000640 1 -- 172.21.15.81:0/1888670047 wait complete. 2024-09-10T20:42:02.456 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T20:42:02.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.614+0000 7f71b9e00640 1 -- 172.21.15.81:0/3697700108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 msgr2=0x7f71b415a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.614+0000 7f71b9e00640 1 --2- 172.21.15.81:0/3697700108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 0x7f71b415a780 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005fd0 tx=0x7f71a402a530 comp rx=0 tx=0).stop 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.615+0000 7f71b9e00640 1 -- 172.21.15.81:0/3697700108 shutdown_connections 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.615+0000 7f71b9e00640 1 --2- 172.21.15.81:0/3697700108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b41513a0 0x7f71b40b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.615+0000 7f71b9e00640 1 --2- 172.21.15.81:0/3697700108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 0x7f71b415a780 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.615+0000 7f71b9e00640 1 -- 172.21.15.81:0/3697700108 >> 172.21.15.81:0/3697700108 conn(0x7f71b4069020 msgr2=0x7f71b406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.615+0000 7f71b9e00640 1 -- 172.21.15.81:0/3697700108 shutdown_connections 2024-09-10T20:42:02.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.615+0000 7f71b9e00640 1 -- 172.21.15.81:0/3697700108 wait complete. 2024-09-10T20:42:02.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.616+0000 7f71b9e00640 1 Processor -- start 2024-09-10T20:42:02.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.616+0000 7f71b9e00640 1 -- start start 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.617+0000 7f71b9e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b40b3000 0x7f71b413d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.617+0000 7f71b9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 0x7f71b41f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.617+0000 7f71b9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b41513a0 0x7f71b4158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.617+0000 7f71b9e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71b406eef0 con 0x7f71b4150fc0 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.617+0000 7f71b9e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4074350 con 0x7f71b40b3000 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.617+0000 7f71b9e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f71b406f070 con 0x7f71b41513a0 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 0x7f71b41f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 0x7f71b41f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35204/0 (socket says 172.21.15.81:35204) 2024-09-10T20:42:02.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 -- 172.21.15.81:0/470584958 learned_addr learned my addr 172.21.15.81:0/470584958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71b2a00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b40b3000 0x7f71b413d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71b3400640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b41513a0 0x7f71b4158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 -- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b41513a0 msgr2=0x7f71b4158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b41513a0 0x7f71b4158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 -- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b40b3000 msgr2=0x7f71b413d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f71b40b3000 0x7f71b413d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 -- 172.21.15.81:0/470584958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b41f6af0 con 0x7f71b4150fc0 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71b3400640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f71b41513a0 0x7f71b4158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.618+0000 7f71aa000640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 0x7f71b41f65b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f719c00b440 tx=0x7f719c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.619+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c015020 con 0x7f71b4150fc0 2024-09-10T20:42:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.619+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f719c0119a0 con 0x7f71b4150fc0 2024-09-10T20:42:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.619+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b41f2ae0 con 0x7f71b4150fc0 2024-09-10T20:42:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.619+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c011df0 con 0x7f71b4150fc0 2024-09-10T20:42:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.619+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b41f30a0 con 0x7f71b4150fc0 2024-09-10T20:42:02.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.620+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71b406f560 con 0x7f71b4150fc0 2024-09-10T20:42:02.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.621+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f719c01a400 con 0x7f71b4150fc0 2024-09-10T20:42:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.622+0000 7f71abe00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7190077f70 0x7f719007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.622+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f719c099f70 con 0x7f71b4150fc0 2024-09-10T20:42:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.622+0000 7f71abe00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f719007e4b0 0x7f71900808f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.622+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f719c01deb0 con 0x7f719007e4b0 2024-09-10T20:42:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.622+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f719c09c610 con 0x7f71b4150fc0 2024-09-10T20:42:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.622+0000 7f71b3400640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f719007e4b0 0x7f71900808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.622+0000 7f71b2a00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7190077f70 0x7f719007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.623+0000 7f71b3400640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f719007e4b0 0x7f71900808f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.623+0000 7f71b2a00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7190077f70 0x7f719007a430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71a4033000 tx=0x7f71a4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.624+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== osd.2 v2:172.21.15.81:6809/2010302829 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f719c01deb0 con 0x7f719007e4b0 2024-09-10T20:42:02.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.636+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 --> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f71b4156ba0 con 0x7f719007e4b0 2024-09-10T20:42:02.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71abe00640 1 -- 172.21.15.81:0/470584958 <== osd.2 v2:172.21.15.81:6809/2010302829 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f71b4156ba0 con 0x7f719007e4b0 2024-09-10T20:42:02.641 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:02.641 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:02.641 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:02.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f719007e4b0 msgr2=0x7f71900808f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:6809/2010302829,v1:172.21.15.81:6812/2010302829] conn(0x7f719007e4b0 0x7f71900808f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7190077f70 msgr2=0x7f719007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f7190077f70 0x7f719007a430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71a4033000 tx=0x7f71a4004730 comp rx=0 tx=0).stop 2024-09-10T20:42:02.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 msgr2=0x7f71b41f65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 --2- 172.21.15.81:0/470584958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71b4150fc0 0x7f71b41f65b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f719c00b440 tx=0x7f719c00b900 comp rx=0 tx=0).stop 2024-09-10T20:42:02.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b3400640 1 -- 172.21.15.81:0/470584958 reap_dead start 2024-09-10T20:42:02.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 shutdown_connections 2024-09-10T20:42:02.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.637+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 >> 172.21.15.81:0/470584958 conn(0x7f71b4069020 msgr2=0x7f71b415a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:02.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.638+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 shutdown_connections 2024-09-10T20:42:02.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.638+0000 7f71b9e00640 1 -- 172.21.15.81:0/470584958 wait complete. 2024-09-10T20:42:02.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.810+0000 7f3e15400640 1 -- 172.21.15.81:0/3948098289 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 msgr2=0x7f3e1015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.810+0000 7f3e15400640 1 --2- 172.21.15.81:0/3948098289 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 0x7f3e1015c900 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3e100cdcc0 tx=0x7f3e0002a820 comp rx=0 tx=0).stop 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.811+0000 7f3e15400640 1 -- 172.21.15.81:0/3948098289 shutdown_connections 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.811+0000 7f3e15400640 1 --2- 172.21.15.81:0/3948098289 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e1006e660 0x7f3e1006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.811+0000 7f3e15400640 1 --2- 172.21.15.81:0/3948098289 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 0x7f3e1015c900 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.811+0000 7f3e15400640 1 -- 172.21.15.81:0/3948098289 >> 172.21.15.81:0/3948098289 conn(0x7f3e10068f90 msgr2=0x7f3e1006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.811+0000 7f3e15400640 1 -- 172.21.15.81:0/3948098289 shutdown_connections 2024-09-10T20:42:02.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.811+0000 7f3e15400640 1 -- 172.21.15.81:0/3948098289 wait complete. 2024-09-10T20:42:02.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.812+0000 7f3e15400640 1 Processor -- start 2024-09-10T20:42:02.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.813+0000 7f3e15400640 1 -- start start 2024-09-10T20:42:02.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.813+0000 7f3e15400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1006e660 0x7f3e10159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.813+0000 7f3e15400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 0x7f3e1015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e15400640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e1015f630 0x7f3e100c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e15400640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e100cccf0 con 0x7f3e1006e660 2024-09-10T20:42:02.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e15400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3e100ccb70 con 0x7f3e1015ee50 2024-09-10T20:42:02.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e15400640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3e101601d0 con 0x7f3e1015f630 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1006e660 0x7f3e10159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1006e660 0x7f3e10159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35208/0 (socket says 172.21.15.81:35208) 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 -- 172.21.15.81:0/2446048082 learned_addr learned my addr 172.21.15.81:0/2446048082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0de00640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 0x7f3e1015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0f200640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e1015f630 0x7f3e100c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 -- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e1015f630 msgr2=0x7f3e100c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e1015f630 0x7f3e100c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 -- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 msgr2=0x7f3e1015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 0x7f3e1015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0e800640 1 -- 172.21.15.81:0/2446048082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1015aa60 con 0x7f3e1006e660 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.814+0000 7f3e0f200640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e1015f630 0x7f3e100c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:02.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.815+0000 7f3e0e800640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1006e660 0x7f3e10159e70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ca0 tx=0x7f3e00032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.815+0000 7f3e06a00640 1 -- 172.21.15.81:0/2446048082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00041020 con 0x7f3e1006e660 2024-09-10T20:42:02.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.815+0000 7f3e06a00640 1 -- 172.21.15.81:0/2446048082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e00032e50 con 0x7f3e1006e660 2024-09-10T20:42:02.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.815+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1015ad40 con 0x7f3e1006e660 2024-09-10T20:42:02.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.815+0000 7f3e06a00640 1 -- 172.21.15.81:0/2446048082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00036040 con 0x7f3e1006e660 2024-09-10T20:42:02.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.815+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1015b300 con 0x7f3e1006e660 2024-09-10T20:42:02.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.816+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1006eaa0 con 0x7f3e1006e660 2024-09-10T20:42:02.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.817+0000 7f3e06a00640 1 -- 172.21.15.81:0/2446048082 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3e000045f0 con 0x7f3e1006e660 2024-09-10T20:42:02.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.818+0000 7f3e06a00640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3df0077f70 0x7f3df007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:02.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.819+0000 7f3e06a00640 1 -- 172.21.15.81:0/2446048082 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f3e000bad80 con 0x7f3e1006e660 2024-09-10T20:42:02.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.819+0000 7f3e0de00640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3df0077f70 0x7f3df007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:02.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.820+0000 7f3e0de00640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3df0077f70 0x7f3df007a430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e101f7d80 tx=0x7f3dfc005f90 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:02.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:02.823+0000 7f3e06a00640 1 -- 172.21.15.81:0/2446048082 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f3e0004b030 con 0x7f3e1006e660 2024-09-10T20:42:03.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.006+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f3e100b26a0 con 0x7f3df0077f70 2024-09-10T20:42:03.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.006+0000 7f3e06a00640 1 -- 172.21.15.81:0/2446048082 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3dfc01b3f0 con 0x7f3df0077f70 2024-09-10T20:42:03.010 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3df0077f70 msgr2=0x7f3df007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3df0077f70 0x7f3df007a430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e101f7d80 tx=0x7f3dfc005f90 comp rx=0 tx=0).stop 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1006e660 msgr2=0x7f3e10159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1006e660 0x7f3e10159e70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009ca0 tx=0x7f3e00032c60 comp rx=0 tx=0).stop 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 shutdown_connections 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3df0077f70 0x7f3df007a430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e1015f630 0x7f3e100c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e1015ee50 0x7f3e1015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 --2- 172.21.15.81:0/2446048082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e1006e660 0x7f3e10159e70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 >> 172.21.15.81:0/2446048082 conn(0x7f3e10068f90 msgr2=0x7f3e10153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 shutdown_connections 2024-09-10T20:42:03.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.009+0000 7f3e15400640 1 -- 172.21.15.81:0/2446048082 wait complete. 2024-09-10T20:42:03.028 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T20:42:03.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.189+0000 7f3db6c00640 1 -- 172.21.15.81:0/1950842311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3db00742c0 msgr2=0x7f3db00ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.189+0000 7f3db6c00640 1 --2- 172.21.15.81:0/1950842311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3db00742c0 0x7f3db00ad8b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009820 tx=0x7f3da402a510 comp rx=0 tx=0).stop 2024-09-10T20:42:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.189+0000 7f3db6c00640 1 -- 172.21.15.81:0/1950842311 shutdown_connections 2024-09-10T20:42:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.189+0000 7f3db6c00640 1 --2- 172.21.15.81:0/1950842311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3db00ca760 0x7f3db0072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.189+0000 7f3db6c00640 1 --2- 172.21.15.81:0/1950842311 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3db00742c0 0x7f3db00ad8b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.189+0000 7f3db6c00640 1 -- 172.21.15.81:0/1950842311 >> 172.21.15.81:0/1950842311 conn(0x7f3db00cc480 msgr2=0x7f3db00cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.190+0000 7f3db6c00640 1 -- 172.21.15.81:0/1950842311 shutdown_connections 2024-09-10T20:42:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.190+0000 7f3db6c00640 1 -- 172.21.15.81:0/1950842311 wait complete. 2024-09-10T20:42:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.191+0000 7f3db6c00640 1 Processor -- start 2024-09-10T20:42:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.191+0000 7f3db6c00640 1 -- start start 2024-09-10T20:42:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.192+0000 7f3db6c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3db00742c0 0x7f3db00c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.192+0000 7f3db6c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3db00addf0 0x7f3db00b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.192+0000 7f3db6c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3db00ca760 0x7f3db01f1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.192+0000 7f3db6c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0072da0 con 0x7f3db00ca760 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.192+0000 7f3db6c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0072c20 con 0x7f3db00addf0 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.192+0000 7f3db6c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3db0072f20 con 0x7f3db00742c0 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3db00ca760 0x7f3db01f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3db00ca760 0x7f3db01f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35212/0 (socket says 172.21.15.81:35212) 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 -- 172.21.15.81:0/3528744429 learned_addr learned my addr 172.21.15.81:0/3528744429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db4e00640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3db00addf0 0x7f3db00b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db5800640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3db00742c0 0x7f3db00c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 -- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3db00742c0 msgr2=0x7f3db00c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3db00742c0 0x7f3db00c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 -- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3db00addf0 msgr2=0x7f3db00b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3db00addf0 0x7f3db00b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 -- 172.21.15.81:0/3528744429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db01f4e80 con 0x7f3db00ca760 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3db6200640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3db00ca760 0x7f3db01f1850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3da800ea10 tx=0x7f3da800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.193+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da800cde0 con 0x7f3db00ca760 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.194+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da8004c10 con 0x7f3db00ca760 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.194+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8005020 con 0x7f3db00ca760 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.194+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db00c4f00 con 0x7f3db00ca760 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.194+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01f5120 con 0x7f3db00ca760 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.194+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3db0073480 con 0x7f3db00ca760 2024-09-10T20:42:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.196+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3da80051c0 con 0x7f3db00ca760 2024-09-10T20:42:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.197+0000 7f3dad600640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3d90077f70 0x7f3d9007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.197+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f3da809af20 con 0x7f3db00ca760 2024-09-10T20:42:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.197+0000 7f3dad600640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f3d9007e4b0 0x7f3d900808f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.197+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d90080fc0 con 0x7f3d9007e4b0 2024-09-10T20:42:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.197+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f3da809b2d0 con 0x7f3db00ca760 2024-09-10T20:42:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.197+0000 7f3db5800640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3d90077f70 0x7f3d9007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.197+0000 7f3db4e00640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f3d9007e4b0 0x7f3d900808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.198+0000 7f3db4e00640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f3d9007e4b0 0x7f3d900808f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.198+0000 7f3db5800640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3d90077f70 0x7f3d9007a430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3da4034000 tx=0x7f3da4004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.198+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== osd.3 v2:172.21.15.81:6808/906295494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d90080fc0 con 0x7f3d9007e4b0 2024-09-10T20:42:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.211+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 --> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3db00cd2e0 con 0x7f3d9007e4b0 2024-09-10T20:42:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3dad600640 1 -- 172.21.15.81:0/3528744429 <== osd.3 v2:172.21.15.81:6808/906295494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3db00cd2e0 con 0x7f3d9007e4b0 2024-09-10T20:42:03.216 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:03.216 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f3d9007e4b0 msgr2=0x7f3d900808f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:6808/906295494,v1:172.21.15.81:6811/906295494] conn(0x7f3d9007e4b0 0x7f3d900808f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3d90077f70 msgr2=0x7f3d9007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3d90077f70 0x7f3d9007a430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3da4034000 tx=0x7f3da4004730 comp rx=0 tx=0).stop 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3db00ca760 msgr2=0x7f3db01f1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 --2- 172.21.15.81:0/3528744429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3db00ca760 0x7f3db01f1850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3da800ea10 tx=0x7f3da800eed0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6200640 1 -- 172.21.15.81:0/3528744429 reap_dead start 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 shutdown_connections 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.212+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 >> 172.21.15.81:0/3528744429 conn(0x7f3db00cc480 msgr2=0x7f3db00cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.213+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 shutdown_connections 2024-09-10T20:42:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.213+0000 7f3db6c00640 1 -- 172.21.15.81:0/3528744429 wait complete. 2024-09-10T20:42:03.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T20:42:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 -- 172.21.15.81:0/392116012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 msgr2=0x7fea9406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 --2- 172.21.15.81:0/392116012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 0x7fea9406eaa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea940cdcc0 tx=0x7fea8002a5d0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 -- 172.21.15.81:0/392116012 shutdown_connections 2024-09-10T20:42:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 --2- 172.21.15.81:0/392116012 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 0x7fea9406eaa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 --2- 172.21.15.81:0/392116012 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea9415ee50 0x7fea9415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 -- 172.21.15.81:0/392116012 >> 172.21.15.81:0/392116012 conn(0x7fea94068f90 msgr2=0x7fea9406c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 -- 172.21.15.81:0/392116012 shutdown_connections 2024-09-10T20:42:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.385+0000 7fea9c200640 1 -- 172.21.15.81:0/392116012 wait complete. 2024-09-10T20:42:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.386+0000 7fea9c200640 1 Processor -- start 2024-09-10T20:42:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.387+0000 7fea9c200640 1 -- start start 2024-09-10T20:42:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.387+0000 7fea9c200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 0x7fea9414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.387+0000 7fea9c200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea9415ee50 0x7fea941597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.387+0000 7fea9c200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9415f630 0x7fea94157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.387+0000 7fea9c200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea940cccf0 con 0x7fea9415f630 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.387+0000 7fea9c200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fea940ccb70 con 0x7fea9406e660 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.387+0000 7fea9c200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fea941601d0 con 0x7fea9415ee50 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9415f630 0x7fea94157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9415f630 0x7fea94157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35226/0 (socket says 172.21.15.81:35226) 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 -- 172.21.15.81:0/2209842910 learned_addr learned my addr 172.21.15.81:0/2209842910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea98e00640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea9415ee50 0x7fea941597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea99800640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 0x7fea9414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 -- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea9415ee50 msgr2=0x7fea941597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea9415ee50 0x7fea941597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 -- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 msgr2=0x7fea9414a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 0x7fea9414a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.388+0000 7fea9a200640 1 -- 172.21.15.81:0/2209842910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9414ad60 con 0x7fea9415f630 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.389+0000 7fea9a200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9415f630 0x7fea94157370 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00c3f0 tx=0x7fea8c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.389+0000 7fea91600640 1 -- 172.21.15.81:0/2209842910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c017070 con 0x7fea9415f630 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.389+0000 7fea91600640 1 -- 172.21.15.81:0/2209842910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea8c0053c0 con 0x7fea9415f630 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.389+0000 7fea91600640 1 -- 172.21.15.81:0/2209842910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c003850 con 0x7fea9415f630 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.389+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9414b040 con 0x7fea9415f630 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.389+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea94159d10 con 0x7fea9415f630 2024-09-10T20:42:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.390+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9406eaa0 con 0x7fea9415f630 2024-09-10T20:42:03.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.391+0000 7fea91600640 1 -- 172.21.15.81:0/2209842910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fea8c0039f0 con 0x7fea9415f630 2024-09-10T20:42:03.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.392+0000 7fea91600640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fea74077f70 0x7fea7407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.392+0000 7fea91600640 1 -- 172.21.15.81:0/2209842910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fea8c099190 con 0x7fea9415f630 2024-09-10T20:42:03.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.393+0000 7fea99800640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fea74077f70 0x7fea7407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.393+0000 7fea99800640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fea74077f70 0x7fea7407a430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea88005fd0 tx=0x7fea88009500 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.396+0000 7fea91600640 1 -- 172.21.15.81:0/2209842910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fea8c061760 con 0x7fea9415f630 2024-09-10T20:42:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.579+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fea940cc410 con 0x7fea74077f70 2024-09-10T20:42:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.580+0000 7fea91600640 1 -- 172.21.15.81:0/2209842910 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fea940cc410 con 0x7fea74077f70 2024-09-10T20:42:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fea74077f70 msgr2=0x7fea7407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fea74077f70 0x7fea7407a430 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea88005fd0 tx=0x7fea88009500 comp rx=0 tx=0).stop 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9415f630 msgr2=0x7fea94157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9415f630 0x7fea94157370 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00c3f0 tx=0x7fea8c00c8b0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 shutdown_connections 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fea74077f70 0x7fea7407a430 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9415f630 0x7fea94157370 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea9415ee50 0x7fea941597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 --2- 172.21.15.81:0/2209842910 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea9406e660 0x7fea9414a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 >> 172.21.15.81:0/2209842910 conn(0x7fea94068f90 msgr2=0x7fea941534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 shutdown_connections 2024-09-10T20:42:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.582+0000 7fea9c200640 1 -- 172.21.15.81:0/2209842910 wait complete. 2024-09-10T20:42:03.602 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T20:42:03.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 -- 172.21.15.81:0/3287615201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 msgr2=0x7f3e700d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 --2- 172.21.15.81:0/3287615201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 0x7f3e700d25b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005fd0 tx=0x7f3e5c02a670 comp rx=0 tx=0).stop 2024-09-10T20:42:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 -- 172.21.15.81:0/3287615201 shutdown_connections 2024-09-10T20:42:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 --2- 172.21.15.81:0/3287615201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 0x7f3e700d25b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 --2- 172.21.15.81:0/3287615201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e7015dce0 0x7f3e700cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 -- 172.21.15.81:0/3287615201 >> 172.21.15.81:0/3287615201 conn(0x7f3e700d3bf0 msgr2=0x7f3e700d4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 -- 172.21.15.81:0/3287615201 shutdown_connections 2024-09-10T20:42:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.759+0000 7f3e76600640 1 -- 172.21.15.81:0/3287615201 wait complete. 2024-09-10T20:42:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.760+0000 7f3e76600640 1 Processor -- start 2024-09-10T20:42:03.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.761+0000 7f3e76600640 1 -- start start 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.761+0000 7f3e76600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 0x7f3e70153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.761+0000 7f3e76600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e7015dce0 0x7f3e701f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.761+0000 7f3e76600640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e70161850 0x7f3e701e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.761+0000 7f3e76600640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e700b7150 con 0x7f3e700d47f0 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.761+0000 7f3e76600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3e700d2d00 con 0x7f3e7015dce0 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.761+0000 7f3e76600640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3e700b72d0 con 0x7f3e70161850 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 0x7f3e70153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 0x7f3e70153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35238/0 (socket says 172.21.15.81:35238) 2024-09-10T20:42:03.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 -- 172.21.15.81:0/1870059027 learned_addr learned my addr 172.21.15.81:0/1870059027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e6fe00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e7015dce0 0x7f3e701f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75c00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e70161850 0x7f3e701e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 -- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e70161850 msgr2=0x7f3e701e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3e70161850 0x7f3e701e9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 -- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e7015dce0 msgr2=0x7f3e701f8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e7015dce0 0x7f3e701f8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 -- 172.21.15.81:0/1870059027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e70154180 con 0x7f3e700d47f0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e6fe00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e7015dce0 0x7f3e701f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.762+0000 7f3e75200640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 0x7f3e70153c40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400d950 tx=0x7f3e6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.763+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64017070 con 0x7f3e700d47f0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.763+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e64009d20 con 0x7f3e700d47f0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.763+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e640106c0 con 0x7f3e700d47f0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.763+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e701550a0 con 0x7f3e700d47f0 2024-09-10T20:42:03.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.763+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e70155660 con 0x7f3e700d47f0 2024-09-10T20:42:03.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.764+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e70154e50 con 0x7f3e700d47f0 2024-09-10T20:42:03.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.765+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f3e64010860 con 0x7f3e700d47f0 2024-09-10T20:42:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.766+0000 7f3e6cc00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3e50077f70 0x7f3e5007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.766+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f3e6409a170 con 0x7f3e700d47f0 2024-09-10T20:42:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.766+0000 7f3e6cc00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7f3e5007e4b0 0x7f3e500808f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.766+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e50080fc0 con 0x7f3e5007e4b0 2024-09-10T20:42:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.766+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f3e640a1050 con 0x7f3e700d47f0 2024-09-10T20:42:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.766+0000 7f3e6fe00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3e50077f70 0x7f3e5007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.767+0000 7f3e75c00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7f3e5007e4b0 0x7f3e500808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.767+0000 7f3e75c00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7f3e5007e4b0 0x7f3e500808f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.767+0000 7f3e6fe00640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3e50077f70 0x7f3e5007a430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c033000 tx=0x7f3e5c004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.768+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== osd.4 v2:172.21.15.143:6826/4019230190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e50080fc0 con 0x7f3e5007e4b0 2024-09-10T20:42:03.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.781+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 --> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3e700d25b0 con 0x7f3e5007e4b0 2024-09-10T20:42:03.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.782+0000 7f3e6cc00640 1 -- 172.21.15.81:0/1870059027 <== osd.4 v2:172.21.15.143:6826/4019230190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3e700d25b0 con 0x7f3e5007e4b0 2024-09-10T20:42:03.786 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:03.787 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7f3e5007e4b0 msgr2=0x7f3e500808f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6826/4019230190,v1:172.21.15.143:6827/4019230190] conn(0x7f3e5007e4b0 0x7f3e500808f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3e50077f70 msgr2=0x7f3e5007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f3e50077f70 0x7f3e5007a430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c033000 tx=0x7f3e5c004730 comp rx=0 tx=0).stop 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 msgr2=0x7f3e70153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 --2- 172.21.15.81:0/1870059027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e700d47f0 0x7f3e70153c40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400d950 tx=0x7f3e6400de10 comp rx=0 tx=0).stop 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e75c00640 1 -- 172.21.15.81:0/1870059027 reap_dead start 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 shutdown_connections 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 >> 172.21.15.81:0/1870059027 conn(0x7f3e700d3bf0 msgr2=0x7f3e700b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 shutdown_connections 2024-09-10T20:42:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.783+0000 7f3e76600640 1 -- 172.21.15.81:0/1870059027 wait complete. 2024-09-10T20:42:03.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T20:42:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.957+0000 7f2d5f200640 1 -- 172.21.15.81:0/3342504941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 msgr2=0x7f2d580cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.957+0000 7f2d5f200640 1 --2- 172.21.15.81:0/3342504941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d580cd5a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2d48005fd0 tx=0x7f2d4802a670 comp rx=0 tx=0).stop 2024-09-10T20:42:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.957+0000 7f2d5f200640 1 -- 172.21.15.81:0/3342504941 shutdown_connections 2024-09-10T20:42:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.957+0000 7f2d5f200640 1 --2- 172.21.15.81:0/3342504941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d580cd5a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.957+0000 7f2d5f200640 1 -- 172.21.15.81:0/3342504941 >> 172.21.15.81:0/3342504941 conn(0x7f2d58068f90 msgr2=0x7f2d5806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.957+0000 7f2d5f200640 1 -- 172.21.15.81:0/3342504941 shutdown_connections 2024-09-10T20:42:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.957+0000 7f2d5f200640 1 -- 172.21.15.81:0/3342504941 wait complete. 2024-09-10T20:42:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.959+0000 7f2d5f200640 1 Processor -- start 2024-09-10T20:42:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.959+0000 7f2d5f200640 1 -- start start 2024-09-10T20:42:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5f200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d5806e660 0x7f2d580738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5f200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d580b45b0 0x7f2d581402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5f200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d58140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5f200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d580cf170 con 0x7f2d581453e0 2024-09-10T20:42:03.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5f200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2d580ceff0 con 0x7f2d5806e660 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5f200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5806eab0 con 0x7f2d580b45b0 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d58140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d58140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35260/0 (socket says 172.21.15.81:35260) 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 -- 172.21.15.81:0/1178357982 learned_addr learned my addr 172.21.15.81:0/1178357982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d57e00640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d5806e660 0x7f2d580738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d57400640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d580b45b0 0x7f2d581402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 -- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d580b45b0 msgr2=0x7f2d581402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d580b45b0 0x7f2d581402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 -- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d5806e660 msgr2=0x7f2d580738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d5806e660 0x7f2d580738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d5d200640 1 -- 172.21.15.81:0/1178357982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5813e4a0 con 0x7f2d581453e0 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.960+0000 7f2d57e00640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d5806e660 0x7f2d580738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.961+0000 7f2d5d200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d58140820 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000c7a0 tx=0x7f2d5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.961+0000 7f2d4fe00640 1 -- 172.21.15.81:0/1178357982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50003b70 con 0x7f2d581453e0 2024-09-10T20:42:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.961+0000 7f2d4fe00640 1 -- 172.21.15.81:0/1178357982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d50003d10 con 0x7f2d581453e0 2024-09-10T20:42:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.961+0000 7f2d4fe00640 1 -- 172.21.15.81:0/1178357982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000aab0 con 0x7f2d581453e0 2024-09-10T20:42:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.961+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5813e780 con 0x7f2d581453e0 2024-09-10T20:42:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.961+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d580733c0 con 0x7f2d581453e0 2024-09-10T20:42:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.962+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d58075430 con 0x7f2d581453e0 2024-09-10T20:42:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.963+0000 7f2d4fe00640 1 -- 172.21.15.81:0/1178357982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f2d5000ac50 con 0x7f2d581453e0 2024-09-10T20:42:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.964+0000 7f2d4fe00640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2d38077fa0 0x7f2d3807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.964+0000 7f2d4fe00640 1 -- 172.21.15.81:0/1178357982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f2d50099a80 con 0x7f2d581453e0 2024-09-10T20:42:03.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.964+0000 7f2d57e00640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2d38077fa0 0x7f2d3807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:03.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.965+0000 7f2d57e00640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2d38077fa0 0x7f2d3807a460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d48033000 tx=0x7f2d48004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:03.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:03.968+0000 7f2d4fe00640 1 -- 172.21.15.81:0/1178357982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f2d58075430 con 0x7f2d581453e0 2024-09-10T20:42:04.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.151+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f2d5813eea0 con 0x7f2d38077fa0 2024-09-10T20:42:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.152+0000 7f2d4fe00640 1 -- 172.21.15.81:0/1178357982 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2d48004420 con 0x7f2d38077fa0 2024-09-10T20:42:04.156 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2d38077fa0 msgr2=0x7f2d3807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2d38077fa0 0x7f2d3807a460 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d48033000 tx=0x7f2d48004730 comp rx=0 tx=0).stop 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 msgr2=0x7f2d58140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d58140820 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000c7a0 tx=0x7f2d5000cc60 comp rx=0 tx=0).stop 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 shutdown_connections 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f2d38077fa0 0x7f2d3807a460 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d581453e0 0x7f2d58140820 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d580b45b0 0x7f2d581402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.154+0000 7f2d5f200640 1 --2- 172.21.15.81:0/1178357982 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d5806e660 0x7f2d580738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.155+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 >> 172.21.15.81:0/1178357982 conn(0x7f2d58068f90 msgr2=0x7f2d5806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.155+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 shutdown_connections 2024-09-10T20:42:04.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.155+0000 7f2d5f200640 1 -- 172.21.15.81:0/1178357982 wait complete. 2024-09-10T20:42:04.177 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T20:42:04.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.334+0000 7fe57f800640 1 -- 172.21.15.81:0/521138200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 msgr2=0x7fe5780cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.334+0000 7fe57f800640 1 --2- 172.21.15.81:0/521138200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 0x7fe5780cf430 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe564005fd0 tx=0x7fe56402a580 comp rx=0 tx=0).stop 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.335+0000 7fe57f800640 1 -- 172.21.15.81:0/521138200 shutdown_connections 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.335+0000 7fe57f800640 1 --2- 172.21.15.81:0/521138200 >> v2:172.21.15.143:3300/0 conn(0x7fe578144a60 0x7fe578144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.335+0000 7fe57f800640 1 --2- 172.21.15.81:0/521138200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 0x7fe5780cf430 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.335+0000 7fe57f800640 1 -- 172.21.15.81:0/521138200 >> 172.21.15.81:0/521138200 conn(0x7fe578069020 msgr2=0x7fe57806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.335+0000 7fe57f800640 1 -- 172.21.15.81:0/521138200 shutdown_connections 2024-09-10T20:42:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.335+0000 7fe57f800640 1 -- 172.21.15.81:0/521138200 wait complete. 2024-09-10T20:42:04.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.336+0000 7fe57f800640 1 Processor -- start 2024-09-10T20:42:04.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.336+0000 7fe57f800640 1 -- start start 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.337+0000 7fe57f800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe57806e660 0x7fe5781566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.337+0000 7fe57f800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe578144a60 0x7fe5781f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.337+0000 7fe57f800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 0x7fe578143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.337+0000 7fe57f800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe578145780 con 0x7fe57815c120 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.337+0000 7fe57f800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe578145600 con 0x7fe578144a60 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.337+0000 7fe57f800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe57815d810 con 0x7fe57806e660 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.337+0000 7fe57d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 0x7fe578143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 0x7fe578143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35292/0 (socket says 172.21.15.81:35292) 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 -- 172.21.15.81:0/2020063038 learned_addr learned my addr 172.21.15.81:0/2020063038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe577e00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe578144a60 0x7fe5781f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57ce00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe57806e660 0x7fe5781566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 -- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe57806e660 msgr2=0x7fe5781566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe57806e660 0x7fe5781566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 -- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe578144a60 msgr2=0x7fe5781f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe578144a60 0x7fe5781f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 -- 172.21.15.81:0/2020063038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe578143740 con 0x7fe57815c120 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57ce00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe57806e660 0x7fe5781566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe57d800640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 0x7fe578143200 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe57000ead0 tx=0x7fe57000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.338+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57000cde0 con 0x7fe57815c120 2024-09-10T20:42:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.339+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe570004c10 con 0x7fe57815c120 2024-09-10T20:42:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.339+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5781531b0 con 0x7fe57815c120 2024-09-10T20:42:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.339+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570005020 con 0x7fe57815c120 2024-09-10T20:42:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.339+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe578158ab0 con 0x7fe57815c120 2024-09-10T20:42:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.340+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe578144eb0 con 0x7fe57815c120 2024-09-10T20:42:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.341+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fe57000f040 con 0x7fe57815c120 2024-09-10T20:42:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.342+0000 7fe574c00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe558077fa0 0x7fe55807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.342+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fe57009a230 con 0x7fe57815c120 2024-09-10T20:42:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.342+0000 7fe574c00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fe55807e4e0 0x7fe558080920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.342+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe558080ff0 con 0x7fe55807e4e0 2024-09-10T20:42:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.342+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe5700a1050 con 0x7fe57815c120 2024-09-10T20:42:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.342+0000 7fe57ce00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe558077fa0 0x7fe55807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.342+0000 7fe577e00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fe55807e4e0 0x7fe558080920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.343+0000 7fe57ce00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe558077fa0 0x7fe55807a460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe568003eb0 tx=0x7fe568009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.343+0000 7fe577e00640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fe55807e4e0 0x7fe558080920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.344+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== osd.5 v2:172.21.15.143:6802/1659339177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe558080ff0 con 0x7fe55807e4e0 2024-09-10T20:42:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.357+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 --> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe5780cc280 con 0x7fe55807e4e0 2024-09-10T20:42:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe574c00640 1 -- 172.21.15.81:0/2020063038 <== osd.5 v2:172.21.15.143:6802/1659339177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe5780cc280 con 0x7fe55807e4e0 2024-09-10T20:42:04.362 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:04.362 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fe55807e4e0 msgr2=0x7fe558080920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6802/1659339177,v1:172.21.15.143:6803/1659339177] conn(0x7fe55807e4e0 0x7fe558080920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe558077fa0 msgr2=0x7fe55807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fe558077fa0 0x7fe55807a460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe568003eb0 tx=0x7fe568009040 comp rx=0 tx=0).stop 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 msgr2=0x7fe578143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 --2- 172.21.15.81:0/2020063038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57815c120 0x7fe578143200 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe57000ead0 tx=0x7fe57000ef90 comp rx=0 tx=0).stop 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57d800640 1 -- 172.21.15.81:0/2020063038 reap_dead start 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 shutdown_connections 2024-09-10T20:42:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 >> 172.21.15.81:0/2020063038 conn(0x7fe578069020 msgr2=0x7fe578073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 shutdown_connections 2024-09-10T20:42:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.358+0000 7fe57f800640 1 -- 172.21.15.81:0/2020063038 wait complete. 2024-09-10T20:42:04.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T20:42:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.531+0000 7f8d11e00640 1 -- 172.21.15.81:0/3595191017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c15df60 msgr2=0x7f8d0c0d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.531+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3595191017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c15df60 0x7f8d0c0d47e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009830 tx=0x7f8d0002a5c0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.531+0000 7f8d11e00640 1 -- 172.21.15.81:0/3595191017 shutdown_connections 2024-09-10T20:42:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.531+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3595191017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c15df60 0x7f8d0c0d47e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.531+0000 7f8d11e00640 1 -- 172.21.15.81:0/3595191017 >> 172.21.15.81:0/3595191017 conn(0x7f8d0c0d3cc0 msgr2=0x7f8d0c0d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.531+0000 7f8d11e00640 1 -- 172.21.15.81:0/3595191017 shutdown_connections 2024-09-10T20:42:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.531+0000 7f8d11e00640 1 -- 172.21.15.81:0/3595191017 wait complete. 2024-09-10T20:42:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.532+0000 7f8d11e00640 1 Processor -- start 2024-09-10T20:42:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.532+0000 7f8d11e00640 1 -- start start 2024-09-10T20:42:04.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.533+0000 7f8d11e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c0cf240 0x7f8d0c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.533+0000 7f8d11e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d0c0d2450 0x7f8d0c158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.533+0000 7f8d11e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d0c15df60 0x7f8d0c1f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.533+0000 7f8d11e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0c0b4f60 con 0x7f8d0c0cf240 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.533+0000 7f8d11e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0c0b4de0 con 0x7f8d0c0d2450 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.533+0000 7f8d11e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0c0b50e0 con 0x7f8d0c15df60 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c0cf240 0x7f8d0c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c0cf240 0x7f8d0c1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35306/0 (socket says 172.21.15.81:35306) 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 -- 172.21.15.81:0/3668184692 learned_addr learned my addr 172.21.15.81:0/3668184692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d0be00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d0c0d2450 0x7f8d0c158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d11400640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d0c15df60 0x7f8d0c1f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 -- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d0c15df60 msgr2=0x7f8d0c1f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d0c15df60 0x7f8d0c1f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 -- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d0c0d2450 msgr2=0x7f8d0c158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d0c0d2450 0x7f8d0c158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 -- 172.21.15.81:0/3668184692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0c14e5e0 con 0x7f8d0c0cf240 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d10a00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c0cf240 0x7f8d0c1583e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8d00000c00 tx=0x7f8d00033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.534+0000 7f8d08c00640 1 -- 172.21.15.81:0/3668184692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00031d60 con 0x7f8d0c0cf240 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.535+0000 7f8d08c00640 1 -- 172.21.15.81:0/3668184692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d000330d0 con 0x7f8d0c0cf240 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.535+0000 7f8d08c00640 1 -- 172.21.15.81:0/3668184692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d00033520 con 0x7f8d0c0cf240 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.535+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0c14e8c0 con 0x7f8d0c0cf240 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.535+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d0c14ee80 con 0x7f8d0c0cf240 2024-09-10T20:42:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.536+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d0c0d04b0 con 0x7f8d0c0cf240 2024-09-10T20:42:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.537+0000 7f8d08c00640 1 -- 172.21.15.81:0/3668184692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f8d000035f0 con 0x7f8d0c0cf240 2024-09-10T20:42:04.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.538+0000 7f8d08c00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cec077f70 0x7f8cec07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.538+0000 7f8d08c00640 1 -- 172.21.15.81:0/3668184692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f8d000bafe0 con 0x7f8d0c0cf240 2024-09-10T20:42:04.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.538+0000 7f8d0be00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cec077f70 0x7f8cec07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.539+0000 7f8d0be00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cec077f70 0x7f8cec07a430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c15d050 tx=0x7f8cf8009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.542+0000 7f8d08c00640 1 -- 172.21.15.81:0/3668184692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f8d0003f030 con 0x7f8d0c0cf240 2024-09-10T20:42:04.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.727+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f8d0c0b62c0 con 0x7f8cec077f70 2024-09-10T20:42:04.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.728+0000 7f8d08c00640 1 -- 172.21.15.81:0/3668184692 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8d0c0b62c0 con 0x7f8cec077f70 2024-09-10T20:42:04.732 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T20:42:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.730+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cec077f70 msgr2=0x7f8cec07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.730+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cec077f70 0x7f8cec07a430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c15d050 tx=0x7f8cf8009040 comp rx=0 tx=0).stop 2024-09-10T20:42:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c0cf240 msgr2=0x7f8d0c1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c0cf240 0x7f8d0c1583e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8d00000c00 tx=0x7f8d00033d60 comp rx=0 tx=0).stop 2024-09-10T20:42:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 shutdown_connections 2024-09-10T20:42:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f8cec077f70 0x7f8cec07a430 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d0c15df60 0x7f8d0c1f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d0c0d2450 0x7f8d0c158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 --2- 172.21.15.81:0/3668184692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d0c0cf240 0x7f8d0c1583e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 >> 172.21.15.81:0/3668184692 conn(0x7f8d0c0d3cc0 msgr2=0x7f8d0c075c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 shutdown_connections 2024-09-10T20:42:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.731+0000 7f8d11e00640 1 -- 172.21.15.81:0/3668184692 wait complete. 2024-09-10T20:42:04.750 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T20:42:04.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 -- 172.21.15.81:0/2074489740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a7806ed70 msgr2=0x7f5a7815d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 --2- 172.21.15.81:0/2074489740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a7806ed70 0x7f5a7815d7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5a70005fd0 tx=0x7f5a7002aa90 comp rx=0 tx=0).stop 2024-09-10T20:42:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 -- 172.21.15.81:0/2074489740 shutdown_connections 2024-09-10T20:42:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 --2- 172.21.15.81:0/2074489740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a7806ed70 0x7f5a7815d7a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 --2- 172.21.15.81:0/2074489740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a78152b40 0x7f5a7815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 -- 172.21.15.81:0/2074489740 >> 172.21.15.81:0/2074489740 conn(0x7f5a78069020 msgr2=0x7f5a7806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 -- 172.21.15.81:0/2074489740 shutdown_connections 2024-09-10T20:42:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.907+0000 7f5a7fa00640 1 -- 172.21.15.81:0/2074489740 wait complete. 2024-09-10T20:42:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.909+0000 7f5a7fa00640 1 Processor -- start 2024-09-10T20:42:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.909+0000 7f5a7fa00640 1 -- start start 2024-09-10T20:42:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7fa00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a7806ed70 0x7f5a781f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7fa00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a780cf330 0x7f5a78150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7fa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a78152b40 0x7f5a781566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7fa00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7815e210 con 0x7f5a780cf330 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7fa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7815e090 con 0x7f5a78152b40 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7fa00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7815e390 con 0x7f5a7806ed70 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a77e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a780cf330 0x7f5a78150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a77e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a780cf330 0x7f5a78150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44304/0 (socket says 172.21.15.81:44304) 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a77e00640 1 -- 172.21.15.81:0/3875169038 learned_addr learned my addr 172.21.15.81:0/3875169038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7d000640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a7806ed70 0x7f5a781f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.910+0000 7f5a7da00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a78152b40 0x7f5a781566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a77e00640 1 -- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a7806ed70 msgr2=0x7f5a781f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a77e00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5a7806ed70 0x7f5a781f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a77e00640 1 -- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a78152b40 msgr2=0x7f5a781566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a77e00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5a78152b40 0x7f5a781566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a77e00640 1 -- 172.21.15.81:0/3875169038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a78157890 con 0x7f5a780cf330 2024-09-10T20:42:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a77e00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a780cf330 0x7f5a78150520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c450 tx=0x7f5a6400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a640052d0 con 0x7f5a780cf330 2024-09-10T20:42:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a64005470 con 0x7f5a780cf330 2024-09-10T20:42:04.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64012870 con 0x7f5a780cf330 2024-09-10T20:42:04.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a781f5570 con 0x7f5a780cf330 2024-09-10T20:42:04.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.911+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a781575b0 con 0x7f5a780cf330 2024-09-10T20:42:04.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.912+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a7815e8b0 con 0x7f5a780cf330 2024-09-10T20:42:04.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.913+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f5a640035f0 con 0x7f5a780cf330 2024-09-10T20:42:04.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.914+0000 7f5a74c00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a58077fa0 0x7f5a5807a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.914+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f5a6409a100 con 0x7f5a780cf330 2024-09-10T20:42:04.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.915+0000 7f5a74c00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f5a5807e4e0 0x7f5a58080920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:04.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.915+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a64015ec0 con 0x7f5a5807e4e0 2024-09-10T20:42:04.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.915+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f5a6409a4b0 con 0x7f5a780cf330 2024-09-10T20:42:04.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.915+0000 7f5a7d000640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a58077fa0 0x7f5a5807a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.915+0000 7f5a7da00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f5a5807e4e0 0x7f5a58080920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:04.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.916+0000 7f5a7d000640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a58077fa0 0x7f5a5807a460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005fd0 tx=0x7f5a6800b390 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.916+0000 7f5a7da00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f5a5807e4e0 0x7f5a58080920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:04.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.917+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== osd.6 v2:172.21.15.143:6818/294800477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a64015ec0 con 0x7f5a5807e4e0 2024-09-10T20:42:04.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.929+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 --> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5a7806e7e0 con 0x7f5a5807e4e0 2024-09-10T20:42:04.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.930+0000 7f5a74c00640 1 -- 172.21.15.81:0/3875169038 <== osd.6 v2:172.21.15.143:6818/294800477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5a7806e7e0 con 0x7f5a5807e4e0 2024-09-10T20:42:04.934 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:04.934 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f5a5807e4e0 msgr2=0x7f5a58080920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6818/294800477,v1:172.21.15.143:6819/294800477] conn(0x7f5a5807e4e0 0x7f5a58080920 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:04.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a58077fa0 msgr2=0x7f5a5807a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f5a58077fa0 0x7f5a5807a460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a68005fd0 tx=0x7f5a6800b390 comp rx=0 tx=0).stop 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a780cf330 msgr2=0x7f5a78150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 --2- 172.21.15.81:0/3875169038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a780cf330 0x7f5a78150520 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c450 tx=0x7f5a6400c910 comp rx=0 tx=0).stop 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7da00640 1 -- 172.21.15.81:0/3875169038 reap_dead start 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 shutdown_connections 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 >> 172.21.15.81:0/3875169038 conn(0x7f5a78069020 msgr2=0x7f5a78153140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 shutdown_connections 2024-09-10T20:42:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:04.931+0000 7f5a7fa00640 1 -- 172.21.15.81:0/3875169038 wait complete. 2024-09-10T20:42:04.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T20:42:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 -- 172.21.15.81:0/3851245307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b415df60 msgr2=0x7f95b40d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 --2- 172.21.15.81:0/3851245307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b415df60 0x7f95b40d47e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009830 tx=0x7f95a402a510 comp rx=0 tx=0).stop 2024-09-10T20:42:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 -- 172.21.15.81:0/3851245307 shutdown_connections 2024-09-10T20:42:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 --2- 172.21.15.81:0/3851245307 >> v2:172.21.15.143:3300/0 conn(0x7f95b40d2450 0x7f95b40b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 --2- 172.21.15.81:0/3851245307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b415df60 0x7f95b40d47e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 -- 172.21.15.81:0/3851245307 >> 172.21.15.81:0/3851245307 conn(0x7f95b40d3cc0 msgr2=0x7f95b40d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 -- 172.21.15.81:0/3851245307 shutdown_connections 2024-09-10T20:42:05.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.104+0000 7f95b9e00640 1 -- 172.21.15.81:0/3851245307 wait complete. 2024-09-10T20:42:05.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.105+0000 7f95b9e00640 1 Processor -- start 2024-09-10T20:42:05.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.105+0000 7f95b9e00640 1 -- start start 2024-09-10T20:42:05.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.106+0000 7f95b9e00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b40cf240 0x7f95b40b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.106+0000 7f95b9e00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b40d2450 0x7f95b41609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.106+0000 7f95b9e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b415df60 0x7f95b41f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.106+0000 7f95b9e00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95b40b4d60 con 0x7f95b40cf240 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.106+0000 7f95b9e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f95b40b4be0 con 0x7f95b415df60 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.106+0000 7f95b9e00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f95b40b4ee0 con 0x7f95b40d2450 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b40cf240 0x7f95b40b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b40cf240 0x7f95b40b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44320/0 (socket says 172.21.15.81:44320) 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 -- 172.21.15.81:0/1532798293 learned_addr learned my addr 172.21.15.81:0/1532798293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b9400640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b415df60 0x7f95b41f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b3e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b40d2450 0x7f95b41609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 -- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b40d2450 msgr2=0x7f95b41609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b40d2450 0x7f95b41609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 -- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b415df60 msgr2=0x7f95b41f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b415df60 0x7f95b41f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 -- 172.21.15.81:0/1532798293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b40b9500 con 0x7f95b40cf240 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.107+0000 7f95b8a00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b40cf240 0x7f95b40b7c30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.108+0000 7f95b0c00640 1 -- 172.21.15.81:0/1532798293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4005c90 con 0x7f95b40cf240 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.108+0000 7f95b0c00640 1 -- 172.21.15.81:0/1532798293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95a4031e50 con 0x7f95b40cf240 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.108+0000 7f95b0c00640 1 -- 172.21.15.81:0/1532798293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a40332f0 con 0x7f95b40cf240 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.108+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b40b6b90 con 0x7f95b40cf240 2024-09-10T20:42:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.108+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b40b7150 con 0x7f95b40cf240 2024-09-10T20:42:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.109+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b40b5400 con 0x7f95b40cf240 2024-09-10T20:42:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.110+0000 7f95b0c00640 1 -- 172.21.15.81:0/1532798293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f95a4033490 con 0x7f95b40cf240 2024-09-10T20:42:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.111+0000 7f95b0c00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9594077f70 0x7f959407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.111+0000 7f95b0c00640 1 -- 172.21.15.81:0/1532798293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f95a40bad20 con 0x7f95b40cf240 2024-09-10T20:42:05.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.112+0000 7f95b3e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9594077f70 0x7f959407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.112+0000 7f95b3e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9594077f70 0x7f959407a430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95b40cd610 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:05.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.115+0000 7f95b0c00640 1 -- 172.21.15.81:0/1532798293 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f95a403f030 con 0x7f95b40cf240 2024-09-10T20:42:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.299+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f95b40d04b0 con 0x7f9594077f70 2024-09-10T20:42:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.300+0000 7f95b0c00640 1 -- 172.21.15.81:0/1532798293 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f95b40d04b0 con 0x7f9594077f70 2024-09-10T20:42:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T20:42:05.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9594077f70 msgr2=0x7f959407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9594077f70 0x7f959407a430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95b40cd610 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b40cf240 msgr2=0x7f95b40b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b40cf240 0x7f95b40b7c30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a4033c20 comp rx=0 tx=0).stop 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 shutdown_connections 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f9594077f70 0x7f959407a430 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b415df60 0x7f95b41f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95b40d2450 0x7f95b41609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 --2- 172.21.15.81:0/1532798293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b40cf240 0x7f95b40b7c30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.302+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 >> 172.21.15.81:0/1532798293 conn(0x7f95b40d3cc0 msgr2=0x7f95b40d40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.303+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 shutdown_connections 2024-09-10T20:42:05.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.303+0000 7f95b9e00640 1 -- 172.21.15.81:0/1532798293 wait complete. 2024-09-10T20:42:05.323 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T20:42:05.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 -- 172.21.15.81:0/1848226934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 msgr2=0x7fd920144eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 --2- 172.21.15.81:0/1848226934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 0x7fd920144eb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd918005fd0 tx=0x7fd91802a620 comp rx=0 tx=0).stop 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 -- 172.21.15.81:0/1848226934 shutdown_connections 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 --2- 172.21.15.81:0/1848226934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 0x7fd920144eb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 --2- 172.21.15.81:0/1848226934 >> v2:172.21.15.143:3300/0 conn(0x7fd92015c120 0x7fd9200cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 -- 172.21.15.81:0/1848226934 >> 172.21.15.81:0/1848226934 conn(0x7fd920069020 msgr2=0x7fd92006c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 -- 172.21.15.81:0/1848226934 shutdown_connections 2024-09-10T20:42:05.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.481+0000 7fd926a00640 1 -- 172.21.15.81:0/1848226934 wait complete. 2024-09-10T20:42:05.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.483+0000 7fd926a00640 1 Processor -- start 2024-09-10T20:42:05.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.483+0000 7fd926a00640 1 -- start start 2024-09-10T20:42:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd926a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd92006e660 0x7fd9200b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd926a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 0x7fd9201529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd926a00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd92015c120 0x7fd9200ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd926a00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd920145780 con 0x7fd920144a60 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd926a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd920145600 con 0x7fd92006e660 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd926a00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd92015d810 con 0x7fd92015c120 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd91f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 0x7fd9201529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd91f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 0x7fd9201529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44346/0 (socket says 172.21.15.81:44346) 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.484+0000 7fd91f400640 1 -- 172.21.15.81:0/3624506681 learned_addr learned my addr 172.21.15.81:0/3624506681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd924a00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd92015c120 0x7fd9200ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd91fe00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd92006e660 0x7fd9200b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd91f400640 1 -- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd92015c120 msgr2=0x7fd9200ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd91f400640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd92015c120 0x7fd9200ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd91f400640 1 -- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd92006e660 msgr2=0x7fd9200b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd91f400640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd92006e660 0x7fd9200b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd91f400640 1 -- 172.21.15.81:0/3624506681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9200b1790 con 0x7fd920144a60 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd91f400640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 0x7fd9201529d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00d750 tx=0x7fd90c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c017070 con 0x7fd920144a60 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd90c004310 con 0x7fd920144a60 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9200b1a70 con 0x7fd920144a60 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.485+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00de60 con 0x7fd920144a60 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.486+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9200b2030 con 0x7fd920144a60 2024-09-10T20:42:05.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.486+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9200b1540 con 0x7fd920144a60 2024-09-10T20:42:05.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.488+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fd90c009c30 con 0x7fd920144a60 2024-09-10T20:42:05.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.488+0000 7fd917e00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd900077fa0 0x7fd90007a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.489+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fd90c099ef0 con 0x7fd920144a60 2024-09-10T20:42:05.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.489+0000 7fd917e00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7fd90007e4e0 0x7fd900080920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.489+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd90c019ec0 con 0x7fd90007e4e0 2024-09-10T20:42:05.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.489+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd90c09c510 con 0x7fd920144a60 2024-09-10T20:42:05.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.489+0000 7fd91fe00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd900077fa0 0x7fd90007a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.489+0000 7fd924a00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7fd90007e4e0 0x7fd900080920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.490+0000 7fd91fe00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd900077fa0 0x7fd90007a460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd910001ec0 tx=0x7fd910009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:05.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.490+0000 7fd924a00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7fd90007e4e0 0x7fd900080920 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:05.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.491+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== osd.7 v2:172.21.15.143:6810/3238341229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd90c019ec0 con 0x7fd90007e4e0 2024-09-10T20:42:05.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.504+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 --> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd920144eb0 con 0x7fd90007e4e0 2024-09-10T20:42:05.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd917e00640 1 -- 172.21.15.81:0/3624506681 <== osd.7 v2:172.21.15.143:6810/3238341229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd920144eb0 con 0x7fd90007e4e0 2024-09-10T20:42:05.509 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T20:42:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T20:42:05.509 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7fd90007e4e0 msgr2=0x7fd900080920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6810/3238341229,v1:172.21.15.143:6811/3238341229] conn(0x7fd90007e4e0 0x7fd900080920 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd900077fa0 msgr2=0x7fd90007a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fd900077fa0 0x7fd90007a460 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd910001ec0 tx=0x7fd910009040 comp rx=0 tx=0).stop 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 msgr2=0x7fd9201529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 --2- 172.21.15.81:0/3624506681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd920144a60 0x7fd9201529d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00d750 tx=0x7fd90c00dc10 comp rx=0 tx=0).stop 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd924a00640 1 -- 172.21.15.81:0/3624506681 reap_dead start 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 shutdown_connections 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 >> 172.21.15.81:0/3624506681 conn(0x7fd920069020 msgr2=0x7fd920153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:05.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 shutdown_connections 2024-09-10T20:42:05.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.505+0000 7fd926a00640 1 -- 172.21.15.81:0/3624506681 wait complete. 2024-09-10T20:42:05.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T20:42:05.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 -- 172.21.15.81:0/3309929692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9015df60 msgr2=0x7f6d900d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 --2- 172.21.15.81:0/3309929692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9015df60 0x7f6d900d47e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6d9006a370 tx=0x7f6d8002aac0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 -- 172.21.15.81:0/3309929692 shutdown_connections 2024-09-10T20:42:05.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 --2- 172.21.15.81:0/3309929692 >> v2:172.21.15.143:3300/0 conn(0x7f6d900cf240 0x7f6d900d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 --2- 172.21.15.81:0/3309929692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d9015df60 0x7f6d900d47e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 -- 172.21.15.81:0/3309929692 >> 172.21.15.81:0/3309929692 conn(0x7f6d900d3cc0 msgr2=0x7f6d900d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:05.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 -- 172.21.15.81:0/3309929692 shutdown_connections 2024-09-10T20:42:05.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.678+0000 7f6d95c00640 1 -- 172.21.15.81:0/3309929692 wait complete. 2024-09-10T20:42:05.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.680+0000 7f6d95c00640 1 Processor -- start 2024-09-10T20:42:05.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.680+0000 7f6d95c00640 1 -- start start 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95c00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d900cf240 0x7f6d900b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95c00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d900d2280 0x7f6d9014ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d9015df60 0x7f6d900c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95c00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d900d0de0 con 0x7f6d900d2280 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6d900b54c0 con 0x7f6d9015df60 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95c00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6d900d0f60 con 0x7f6d900cf240 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d900d2280 0x7f6d9014ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d900d2280 0x7f6d9014ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44368/0 (socket says 172.21.15.81:44368) 2024-09-10T20:42:05.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 -- 172.21.15.81:0/117915218 learned_addr learned my addr 172.21.15.81:0/117915218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8fe00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d900cf240 0x7f6d900b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95200640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d9015df60 0x7f6d900c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 -- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d900cf240 msgr2=0x7f6d900b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d900cf240 0x7f6d900b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 -- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d9015df60 msgr2=0x7f6d900c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d9015df60 0x7f6d900c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d8f400640 1 -- 172.21.15.81:0/117915218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d900b7030 con 0x7f6d900d2280 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.681+0000 7f6d95200640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d9015df60 0x7f6d900c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.682+0000 7f6d8f400640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d900d2280 0x7f6d9014ef50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00d950 tx=0x7f6d7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.682+0000 7f6d87e00640 1 -- 172.21.15.81:0/117915218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c017070 con 0x7f6d900d2280 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.682+0000 7f6d87e00640 1 -- 172.21.15.81:0/117915218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d7c009d20 con 0x7f6d900d2280 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.682+0000 7f6d87e00640 1 -- 172.21.15.81:0/117915218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c004280 con 0x7f6d900d2280 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.682+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d900b7310 con 0x7f6d900d2280 2024-09-10T20:42:05.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.682+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9015fe20 con 0x7f6d900d2280 2024-09-10T20:42:05.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.683+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d900b1070 con 0x7f6d900d2280 2024-09-10T20:42:05.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.684+0000 7f6d87e00640 1 -- 172.21.15.81:0/117915218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6d7c0035f0 con 0x7f6d900d2280 2024-09-10T20:42:05.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.685+0000 7f6d87e00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d70077f70 0x7f6d7007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:05.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.685+0000 7f6d87e00640 1 -- 172.21.15.81:0/117915218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f6d7c099e50 con 0x7f6d900d2280 2024-09-10T20:42:05.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.686+0000 7f6d8fe00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d70077f70 0x7f6d7007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:05.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.687+0000 7f6d8fe00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d70077f70 0x7f6d7007a430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6d80035000 tx=0x7f6d80004ab0 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:05.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.689+0000 7f6d87e00640 1 -- 172.21.15.81:0/117915218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6d900b1070 con 0x7f6d900d2280 2024-09-10T20:42:05.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.875+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6d900d1480 con 0x7f6d70077f70 2024-09-10T20:42:05.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.876+0000 7f6d87e00640 1 -- 172.21.15.81:0/117915218 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d900d1480 con 0x7f6d70077f70 2024-09-10T20:42:05.880 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T20:42:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d70077f70 msgr2=0x7f6d7007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d70077f70 0x7f6d7007a430 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6d80035000 tx=0x7f6d80004ab0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d900d2280 msgr2=0x7f6d9014ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d900d2280 0x7f6d9014ef50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00d950 tx=0x7f6d7c00de10 comp rx=0 tx=0).stop 2024-09-10T20:42:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 shutdown_connections 2024-09-10T20:42:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6d70077f70 0x7f6d7007a430 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6d9015df60 0x7f6d900c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d900d2280 0x7f6d9014ef50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 --2- 172.21.15.81:0/117915218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6d900cf240 0x7f6d900b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 >> 172.21.15.81:0/117915218 conn(0x7f6d900d3cc0 msgr2=0x7f6d9006db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 shutdown_connections 2024-09-10T20:42:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:05.878+0000 7f6d95c00640 1 -- 172.21.15.81:0/117915218 wait complete. 2024-09-10T20:42:05.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 -- 172.21.15.81:0/2129228004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 msgr2=0x7fb7a40d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 --2- 172.21.15.81:0/2129228004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a40d1d40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40b6880 tx=0x7fb79002a5f0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 -- 172.21.15.81:0/2129228004 shutdown_connections 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 --2- 172.21.15.81:0/2129228004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a40d1d40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 --2- 172.21.15.81:0/2129228004 >> v2:172.21.15.143:3300/0 conn(0x7fb7a415df60 0x7fb7a40d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 -- 172.21.15.81:0/2129228004 >> 172.21.15.81:0/2129228004 conn(0x7fb7a40d3cc0 msgr2=0x7fb7a40d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 -- 172.21.15.81:0/2129228004 shutdown_connections 2024-09-10T20:42:06.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.051+0000 7fb7aae00640 1 -- 172.21.15.81:0/2129228004 wait complete. 2024-09-10T20:42:06.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.052+0000 7fb7aae00640 1 Processor -- start 2024-09-10T20:42:06.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.052+0000 7fb7aae00640 1 -- start start 2024-09-10T20:42:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.053+0000 7fb7aae00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a4153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.053+0000 7fb7aae00640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7a40d2280 0x7fb7a40b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.053+0000 7fb7aae00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7a415df60 0x7fb7a40b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.053+0000 7fb7aae00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a40d0de0 con 0x7fb7a40cf240 2024-09-10T20:42:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.053+0000 7fb7aae00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a40b54c0 con 0x7fb7a415df60 2024-09-10T20:42:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.053+0000 7fb7aae00640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a40d0f60 con 0x7fb7a40d2280 2024-09-10T20:42:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a4153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a4153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44382/0 (socket says 172.21.15.81:44382) 2024-09-10T20:42:06.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 -- 172.21.15.81:0/978126339 learned_addr learned my addr 172.21.15.81:0/978126339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9000640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7a40d2280 0x7fb7a40b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7aa400640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7a415df60 0x7fb7a40b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 -- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7a40d2280 msgr2=0x7fb7a40b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7a40d2280 0x7fb7a40b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 -- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7a415df60 msgr2=0x7fb7a40b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7a415df60 0x7fb7a40b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 -- 172.21.15.81:0/978126339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a40b6ed0 con 0x7fb7a40cf240 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7aa400640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7a415df60 0x7fb7a40b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9000640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7a40d2280 0x7fb7a40b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.054+0000 7fb7a9a00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a4153250 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb79800e7c0 tx=0x7fb79800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.055+0000 7fb7a1600640 1 -- 172.21.15.81:0/978126339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79800ccc0 con 0x7fb7a40cf240 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.055+0000 7fb7a1600640 1 -- 172.21.15.81:0/978126339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb798010430 con 0x7fb7a40cf240 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.055+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a40b71b0 con 0x7fb7a40cf240 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.055+0000 7fb7a1600640 1 -- 172.21.15.81:0/978126339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798010860 con 0x7fb7a40cf240 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.055+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a40b7770 con 0x7fb7a40cf240 2024-09-10T20:42:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.056+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a408d320 con 0x7fb7a40cf240 2024-09-10T20:42:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.057+0000 7fb7a1600640 1 -- 172.21.15.81:0/978126339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7fb798010a00 con 0x7fb7a40cf240 2024-09-10T20:42:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.058+0000 7fb7a1600640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb784077f70 0x7fb78407a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.058+0000 7fb7a1600640 1 -- 172.21.15.81:0/978126339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7fb79809a6f0 con 0x7fb7a40cf240 2024-09-10T20:42:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.058+0000 7fb7a9000640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb784077f70 0x7fb78407a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.059+0000 7fb7a9000640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb784077f70 0x7fb78407a430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb790033000 tx=0x7fb790004730 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.062+0000 7fb7a1600640 1 -- 172.21.15.81:0/978126339 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7fb7a408d320 con 0x7fb7a40cf240 2024-09-10T20:42:06.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.248+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7a40d1430 con 0x7fb784077f70 2024-09-10T20:42:06.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.249+0000 7fb7a1600640 1 -- 172.21.15.81:0/978126339 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13458 (secure 0 0 0) 0x7fb7a40d1430 con 0x7fb784077f70 2024-09-10T20:42:06.253 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:42:06.253 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:42:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb784077f70 msgr2=0x7fb78407a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb784077f70 0x7fb78407a430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb790033000 tx=0x7fb790004730 comp rx=0 tx=0).stop 2024-09-10T20:42:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 msgr2=0x7fb7a4153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a4153250 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb79800e7c0 tx=0x7fb79800ec80 comp rx=0 tx=0).stop 2024-09-10T20:42:06.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 shutdown_connections 2024-09-10T20:42:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7fb784077f70 0x7fb78407a430 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7a415df60 0x7fb7a40b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7a40d2280 0x7fb7a40b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 --2- 172.21.15.81:0/978126339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a40cf240 0x7fb7a4153250 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.251+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 >> 172.21.15.81:0/978126339 conn(0x7fb7a40d3cc0 msgr2=0x7fb7a40b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.252+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 shutdown_connections 2024-09-10T20:42:06.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:06.252+0000 7fb7aae00640 1 -- 172.21.15.81:0/978126339 wait complete. 2024-09-10T20:42:06.271 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-10T20:42:05.879607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222388,"kb_used_data":6152,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752332,"statfs":{"total":773094113280,"available":772866387968,"internally_reserved":0,"allocated":6299648,"data_stored":3497256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-16,"num_read_kb":-9,"num_write":-8,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001832"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T20:41:56.145215+0000","last_change":"2024-09-10T20:39:43.191581+0000","last_active":"2024-09-10T20:41:56.145215+0000","last_peered":"2024-09-10T20:41:56.145215+0000","last_clean":"2024-09-10T20:41:56.145215+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:41:56.145215+0000","last_undegraded":"2024-09-10T20:41:56.145215+0000","last_fullsized":"2024-09-10T20:41:56.145215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T20:39:41.871675+0000","last_clean_scrub_stamp":"2024-09-10T20:39:41.871675+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:26:05.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1232896,"data_stored":879933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1232896,"data_stored":879933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:42:06.274 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T20:39:41.871675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=20, tm_min=39, tm_sec=41, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=20, tm_min=42, tm_sec=0, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T20:42:06.312 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T20:42:17.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:42:17.770 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:42:26.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T20:42:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.477+0000 7f6ba3200640 1 -- 172.21.15.81:0/643394801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba406eee0 msgr2=0x7f6ba40cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.477+0000 7f6ba3200640 1 --2- 172.21.15.81:0/643394801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba406eee0 0x7f6ba40cb530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009830 tx=0x7f6b8c02a5c0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.477+0000 7f6ba3200640 1 -- 172.21.15.81:0/643394801 shutdown_connections 2024-09-10T20:42:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.477+0000 7f6ba3200640 1 --2- 172.21.15.81:0/643394801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba406eee0 0x7f6ba40cb530 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.477+0000 7f6ba3200640 1 -- 172.21.15.81:0/643394801 >> 172.21.15.81:0/643394801 conn(0x7f6ba406c690 msgr2=0x7f6ba406ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.477+0000 7f6ba3200640 1 -- 172.21.15.81:0/643394801 shutdown_connections 2024-09-10T20:42:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.477+0000 7f6ba3200640 1 -- 172.21.15.81:0/643394801 wait complete. 2024-09-10T20:42:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.479+0000 7f6ba3200640 1 Processor -- start 2024-09-10T20:42:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.479+0000 7f6ba3200640 1 -- start start 2024-09-10T20:42:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba3200640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ba406eee0 0x7f6ba41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba3200640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba40cba70 0x7f6ba40c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba3200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ba415b910 0x7f6ba4149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba3200640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba40ca560 con 0x7f6ba40cba70 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba3200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4073b10 con 0x7f6ba415b910 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba3200640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba40ca6e0 con 0x7f6ba406eee0 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba40cba70 0x7f6ba40c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba40cba70 0x7f6ba40c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59176/0 (socket says 172.21.15.81:59176) 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 -- 172.21.15.81:0/1508851672 learned_addr learned my addr 172.21.15.81:0/1508851672 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba1e00640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ba406eee0 0x7f6ba41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba2800640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ba415b910 0x7f6ba4149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 -- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ba406eee0 msgr2=0x7f6ba41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ba406eee0 0x7f6ba41501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 -- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ba415b910 msgr2=0x7f6ba4149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ba415b910 0x7f6ba4149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6b9be00640 1 -- 172.21.15.81:0/1508851672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba414c8c0 con 0x7f6ba40cba70 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba1e00640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ba406eee0 0x7f6ba41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.480+0000 7f6ba2800640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ba415b910 0x7f6ba4149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.481+0000 7f6b9be00640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba40cba70 0x7f6ba40c8d10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.481+0000 7f6b9a000640 1 -- 172.21.15.81:0/1508851672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c040070 con 0x7f6ba40cba70 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.481+0000 7f6b9a000640 1 -- 172.21.15.81:0/1508851672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b8c0038e0 con 0x7f6ba40cba70 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.481+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba414cb60 con 0x7f6ba40cba70 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.481+0000 7f6b9a000640 1 -- 172.21.15.81:0/1508851672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c003d30 con 0x7f6ba40cba70 2024-09-10T20:42:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.481+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba414d120 con 0x7f6ba40cba70 2024-09-10T20:42:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.482+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba40741f0 con 0x7f6ba40cba70 2024-09-10T20:42:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.483+0000 7f6b9a000640 1 -- 172.21.15.81:0/1508851672 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f6b8c04d030 con 0x7f6ba40cba70 2024-09-10T20:42:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.484+0000 7f6b9a000640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6b80077f70 0x7f6b8007a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.484+0000 7f6b9a000640 1 -- 172.21.15.81:0/1508851672 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f6b8c0bb310 con 0x7f6ba40cba70 2024-09-10T20:42:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.485+0000 7f6ba1e00640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6b80077f70 0x7f6b8007a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.485+0000 7f6ba1e00640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6b80077f70 0x7f6b8007a430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b94007a50 tx=0x7f6b94009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:26.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.488+0000 7f6b9a000640 1 -- 172.21.15.81:0/1508851672 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f6b8c083f20 con 0x7f6ba40cba70 2024-09-10T20:42:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.668+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 --> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ba40cb4b0 con 0x7f6b80077f70 2024-09-10T20:42:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.670+0000 7f6b9a000640 1 -- 172.21.15.81:0/1508851672 <== mgr.4115 v2:172.21.15.143:6800/1719157968 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7f6ba40cb4b0 con 0x7f6b80077f70 2024-09-10T20:42:26.674 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:42:26.674 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6b80077f70 msgr2=0x7f6b8007a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6b80077f70 0x7f6b8007a430 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b94007a50 tx=0x7f6b94009040 comp rx=0 tx=0).stop 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba40cba70 msgr2=0x7f6ba40c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba40cba70 0x7f6ba40c8d10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c000c00 tx=0x7f6b8c032c10 comp rx=0 tx=0).stop 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 shutdown_connections 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f6b80077f70 0x7f6b8007a430 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ba415b910 0x7f6ba4149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba40cba70 0x7f6ba40c8d10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 --2- 172.21.15.81:0/1508851672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ba406eee0 0x7f6ba41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.671+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 >> 172.21.15.81:0/1508851672 conn(0x7f6ba406c690 msgr2=0x7f6ba40ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.672+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 shutdown_connections 2024-09-10T20:42:26.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.672+0000 7f6ba3200640 1 -- 172.21.15.81:0/1508851672 wait complete. 2024-09-10T20:42:26.692 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-10T20:42:25.883683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222372,"kb_used_data":6152,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752348,"statfs":{"total":773094113280,"available":772866404352,"internally_reserved":0,"allocated":6299648,"data_stored":3497256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002514"},"pg_stats":[{"pgid":"1.0","version":"54'74","reported_seq":182,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-10T20:42:03.191197+0000","last_change":"2024-09-10T20:42:03.191197+0000","last_active":"2024-09-10T20:42:03.191197+0000","last_peered":"2024-09-10T20:42:03.191197+0000","last_clean":"2024-09-10T20:42:03.191197+0000","last_became_active":"2024-09-10T20:39:43.191166+0000","last_became_peered":"2024-09-10T20:39:43.191166+0000","last_unstale":"2024-09-10T20:42:03.191197+0000","last_undegraded":"2024-09-10T20:42:03.191197+0000","last_fullsized":"2024-09-10T20:42:03.191197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'74","last_scrub_stamp":"2024-09-10T20:42:03.191133+0000","last_deep_scrub":"54'74","last_deep_scrub_stamp":"2024-09-10T20:42:03.191133+0000","last_clean_scrub_stamp":"2024-09-10T20:42:03.191133+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:58.801163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1232896,"data_stored":879933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":289565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1232896,"data_stored":879933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T20:42:26.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T20:42:26.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.842+0000 7f1f54000640 1 -- 172.21.15.81:0/3186161677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c06eab0 msgr2=0x7f1f4c15db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.842+0000 7f1f54000640 1 --2- 172.21.15.81:0/3186161677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c06eab0 0x7f1f4c15db00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009be0 tx=0x7f1f4402a920 comp rx=0 tx=0).stop 2024-09-10T20:42:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.842+0000 7f1f54000640 1 -- 172.21.15.81:0/3186161677 shutdown_connections 2024-09-10T20:42:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.842+0000 7f1f54000640 1 --2- 172.21.15.81:0/3186161677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c06eab0 0x7f1f4c15db00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.842+0000 7f1f54000640 1 -- 172.21.15.81:0/3186161677 >> 172.21.15.81:0/3186161677 conn(0x7f1f4c069020 msgr2=0x7f1f4c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.842+0000 7f1f54000640 1 -- 172.21.15.81:0/3186161677 shutdown_connections 2024-09-10T20:42:26.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.842+0000 7f1f54000640 1 -- 172.21.15.81:0/3186161677 wait complete. 2024-09-10T20:42:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.844+0000 7f1f54000640 1 Processor -- start 2024-09-10T20:42:26.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.844+0000 7f1f54000640 1 -- start start 2024-09-10T20:42:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f54000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4c06e660 0x7f1f4c1414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f54000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f4c06eab0 0x7f1f4c142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f54000640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c1453c0 0x7f1f4c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f54000640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c15e1c0 con 0x7f1f4c06e660 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f54000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c15e040 con 0x7f1f4c06eab0 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f54000640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4c15e340 con 0x7f1f4c1453c0 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f51600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4c06e660 0x7f1f4c1414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f51600640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4c06e660 0x7f1f4c1414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59188/0 (socket says 172.21.15.81:59188) 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f51600640 1 -- 172.21.15.81:0/533083657 learned_addr learned my addr 172.21.15.81:0/533083657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f50c00640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f4c06eab0 0x7f1f4c142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.845+0000 7f1f52000640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c1453c0 0x7f1f4c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f51600640 1 -- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c1453c0 msgr2=0x7f1f4c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f51600640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c1453c0 0x7f1f4c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f51600640 1 -- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f4c06eab0 msgr2=0x7f1f4c142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:26.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f51600640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f4c06eab0 0x7f1f4c142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f51600640 1 -- 172.21.15.81:0/533083657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c1436b0 con 0x7f1f4c06e660 2024-09-10T20:42:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f51600640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4c06e660 0x7f1f4c1414a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c460 tx=0x7f1f4000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:26.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40016020 con 0x7f1f4c06e660 2024-09-10T20:42:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f40012940 con 0x7f1f4c06e660 2024-09-10T20:42:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40012d90 con 0x7f1f4c06e660 2024-09-10T20:42:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.846+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c155590 con 0x7f1f4c06e660 2024-09-10T20:42:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.847+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c155b50 con 0x7f1f4c06e660 2024-09-10T20:42:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.848+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4c0cf2b0 con 0x7f1f4c06e660 2024-09-10T20:42:26.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.849+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7f1f4001b400 con 0x7f1f4c06e660 2024-09-10T20:42:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.849+0000 7f1f49600640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1f2c077f70 0x7f1f2c07a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:26.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.850+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7f1f40099b00 con 0x7f1f4c06e660 2024-09-10T20:42:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.850+0000 7f1f50c00640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1f2c077f70 0x7f1f2c07a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:26.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.851+0000 7f1f50c00640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1f2c077f70 0x7f1f2c07a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f38009040 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:26.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:26.854+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7f1f40020030 con 0x7f1f4c06e660 2024-09-10T20:42:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.039+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1f4c073e30 con 0x7f1f4c06e660 2024-09-10T20:42:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.043+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7f1f40062030 con 0x7f1f4c06e660 2024-09-10T20:42:27.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.044+0000 7f1f49600640 1 -- 172.21.15.81:0/533083657 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f1f4009f080 con 0x7f1f4c06e660 2024-09-10T20:42:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1f2c077f70 msgr2=0x7f1f2c07a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1f2c077f70 0x7f1f2c07a430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f38009040 comp rx=0 tx=0).stop 2024-09-10T20:42:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4c06e660 msgr2=0x7f1f4c1414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:27.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4c06e660 0x7f1f4c1414a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c460 tx=0x7f1f4000c920 comp rx=0 tx=0).stop 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 shutdown_connections 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7f1f2c077f70 0x7f1f2c07a430 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1f4c1453c0 0x7f1f4c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1f4c06eab0 0x7f1f4c142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 --2- 172.21.15.81:0/533083657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f4c06e660 0x7f1f4c1414a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 >> 172.21.15.81:0/533083657 conn(0x7f1f4c069020 msgr2=0x7f1f4c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 shutdown_connections 2024-09-10T20:42:27.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.046+0000 7f1f54000640 1 -- 172.21.15.81:0/533083657 wait complete. 2024-09-10T20:42:27.065 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T20:42:27.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T20:42:27.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 -- 172.21.15.81:0/3294414062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 msgr2=0x7ffa740d07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 --2- 172.21.15.81:0/3294414062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa740d07e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ffa7406cde0 tx=0x7ffa6c02a980 comp rx=0 tx=0).stop 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 -- 172.21.15.81:0/3294414062 shutdown_connections 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 --2- 172.21.15.81:0/3294414062 >> v2:172.21.15.143:3300/0 conn(0x7ffa740d49a0 0x7ffa740d1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 --2- 172.21.15.81:0/3294414062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa740d07e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 --2- 172.21.15.81:0/3294414062 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa7415e000 0x7ffa740d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 -- 172.21.15.81:0/3294414062 >> 172.21.15.81:0/3294414062 conn(0x7ffa740d3e80 msgr2=0x7ffa740d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 -- 172.21.15.81:0/3294414062 shutdown_connections 2024-09-10T20:42:27.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.219+0000 7ffa7a800640 1 -- 172.21.15.81:0/3294414062 wait complete. 2024-09-10T20:42:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.221+0000 7ffa7a800640 1 Processor -- start 2024-09-10T20:42:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.221+0000 7ffa7a800640 1 -- start start 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa7a800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa741f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa7a800640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa740d49a0 0x7ffa7415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa7a800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa7415e000 0x7ffa7415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa7a800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa740d10b0 con 0x7ffa740d24d0 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa7a800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffa740d0f30 con 0x7ffa7415e000 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa7a800640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffa740d1230 con 0x7ffa740d49a0 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa73400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa741f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa73400640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa741f5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59206/0 (socket says 172.21.15.81:59206) 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa73400640 1 -- 172.21.15.81:0/917573251 learned_addr learned my addr 172.21.15.81:0/917573251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa73e00640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa7415e000 0x7ffa7415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.222+0000 7ffa72a00640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa740d49a0 0x7ffa7415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa73400640 1 -- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa740d49a0 msgr2=0x7ffa7415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa73400640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa740d49a0 0x7ffa7415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa73400640 1 -- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa7415e000 msgr2=0x7ffa7415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa73400640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa7415e000 0x7ffa7415eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa73400640 1 -- 172.21.15.81:0/917573251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa74160020 con 0x7ffa740d24d0 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa73400640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa741f5030 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400d6d0 tx=0x7ffa6400dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa6b400640 1 -- 172.21.15.81:0/917573251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64017070 con 0x7ffa740d24d0 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa6b400640 1 -- 172.21.15.81:0/917573251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7ffa64005350 con 0x7ffa740d24d0 2024-09-10T20:42:27.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7415f370 con 0x7ffa740d24d0 2024-09-10T20:42:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa6b400640 1 -- 172.21.15.81:0/917573251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa640047a0 con 0x7ffa740d24d0 2024-09-10T20:42:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.223+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa74160570 con 0x7ffa740d24d0 2024-09-10T20:42:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.224+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa740d07e0 con 0x7ffa740d24d0 2024-09-10T20:42:27.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.226+0000 7ffa6b400640 1 -- 172.21.15.81:0/917573251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 100601+0+0 (secure 0 0 0) 0x7ffa64004940 con 0x7ffa740d24d0 2024-09-10T20:42:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.226+0000 7ffa6b400640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa54077fa0 0x7ffa5407a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T20:42:27.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.227+0000 7ffa6b400640 1 -- 172.21.15.81:0/917573251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5421+0+0 (secure 0 0 0) 0x7ffa64099c40 con 0x7ffa740d24d0 2024-09-10T20:42:27.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.227+0000 7ffa72a00640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa54077fa0 0x7ffa5407a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T20:42:27.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.228+0000 7ffa72a00640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa54077fa0 0x7ffa5407a460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffa740b8b10 tx=0x7ffa6000b310 comp rx=0 tx=0).ready entity=mgr.4115 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T20:42:27.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.230+0000 7ffa6b400640 1 -- 172.21.15.81:0/917573251 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (secure 0 0 0) 0x7ffa64062210 con 0x7ffa740d24d0 2024-09-10T20:42:27.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.447+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa7415d420 con 0x7ffa740d24d0 2024-09-10T20:42:27.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.448+0000 7ffa6b400640 1 -- 172.21.15.81:0/917573251 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+3917 (secure 0 0 0) 0x7ffa64066c40 con 0x7ffa740d24d0 2024-09-10T20:42:27.453 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T20:42:27.453 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"btime":"2024-09-10T20:41:53:869682+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/3589159240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":3589159240},{"type":"v1","addr":"172.21.15.143:6835","nonce":3589159240}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4895,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3528844898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3528844898},{"type":"v1","addr":"172.21.15.143:6837","nonce":3528844898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2925895536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2925895536},{"type":"v1","addr":"172.21.15.81:6834","nonce":2925895536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3448291830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3448291830},{"type":"v1","addr":"172.21.15.81:6835","nonce":3448291830}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[]} 2024-09-10T20:42:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2024-09-10T20:42:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa54077fa0 msgr2=0x7ffa5407a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa54077fa0 0x7ffa5407a460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffa740b8b10 tx=0x7ffa6000b310 comp rx=0 tx=0).stop 2024-09-10T20:42:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 msgr2=0x7ffa741f5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T20:42:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa741f5030 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400d6d0 tx=0x7ffa6400dad0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 shutdown_connections 2024-09-10T20:42:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:6800/1719157968,v1:172.21.15.143:6801/1719157968] conn(0x7ffa54077fa0 0x7ffa5407a460 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffa7415e000 0x7ffa7415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffa740d49a0 0x7ffa7415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 --2- 172.21.15.81:0/917573251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa740d24d0 0x7ffa741f5030 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T20:42:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 >> 172.21.15.81:0/917573251 conn(0x7ffa740d3e80 msgr2=0x7ffa740d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T20:42:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 shutdown_connections 2024-09-10T20:42:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T20:42:27.450+0000 7ffa7a800640 1 -- 172.21.15.81:0/917573251 wait complete. 2024-09-10T20:42:27.470 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T20:42:27.470 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T20:42:27.471 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T20:42:27.471 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.485 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T20:42:27.486 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T20:42:27.486 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.541 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T20:42:27.541 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T20:42:27.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.558 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T20:42:27.559 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T20:42:27.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.617 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T20:42:27.617 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T20:42:27.618 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T20:42:27.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.663 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T20:42:27.664 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T20:42:27.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.718 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T20:42:27.718 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T20:42:27.718 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.755 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T20:42:27.755 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T20:42:27.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.842 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T20:42:27.843 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T20:42:27.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.888 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T20:42:27.888 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T20:42:27.888 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:27.952 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T20:42:27.952 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T20:42:27.953 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:28.003 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T20:42:28.003 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T20:42:28.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:28.069 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T20:42:28.070 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T20:42:28.070 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T20:42:28.070 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:28.133 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T20:42:28.133 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T20:42:28.134 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:28.204 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T20:42:28.205 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T20:42:28.205 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T20:42:28.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:28.225 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T20:42:28.226 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T20:42:28.226 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:28.244 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T20:42:28.244 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T20:42:28.245 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T20:42:28.303 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T20:42:28.304 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T20:42:28.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2024-09-10T20:42:28.396 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:42:28.396 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T20:42:28.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:42:28.562 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T20:42:28.721 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:42:28.722 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T20:42:28.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:42:28.801 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T20:42:28.932 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:42:28.932 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T20:42:29.167 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:42:29.168 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T20:42:29.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:42:29.277 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T20:42:29.384 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:42:29.384 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T20:42:29.483 INFO:tasks.ceph:Archiving mon data... 2024-09-10T20:42:29.484 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/data/mon.a.tgz 2024-09-10T20:42:29.485 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T20:42:29.520 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.mq9wjFJfck 2024-09-10T20:42:29.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.mq9wjFJfck 2024-09-10T20:42:29.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.mq9wjFJfck 2024-09-10T20:42:29.790 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.mq9wjFJfck is 352KB 2024-09-10T20:42:29.880 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.mq9wjFJfck 2024-09-10T20:42:29.915 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/data/mon.b.tgz 2024-09-10T20:42:29.916 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-09-10T20:42:29.952 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.VON6EyimXl 2024-09-10T20:42:29.952 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VON6EyimXl 2024-09-10T20:42:30.159 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.VON6EyimXl 2024-09-10T20:42:30.252 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.VON6EyimXl is 468KB 2024-09-10T20:42:30.342 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.VON6EyimXl 2024-09-10T20:42:30.377 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/data/mon.c.tgz 2024-09-10T20:42:30.378 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-09-10T20:42:30.452 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.xTzIseRnlN 2024-09-10T20:42:30.452 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xTzIseRnlN 2024-09-10T20:42:30.655 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.xTzIseRnlN 2024-09-10T20:42:30.750 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.xTzIseRnlN is 468KB 2024-09-10T20:42:30.846 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.xTzIseRnlN 2024-09-10T20:42:30.882 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T20:42:30.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T20:42:30.887 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T20:42:31.013 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T20:42:31.049 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T20:42:31.049 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T20:42:31.050 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/remote/smithi081/crash 2024-09-10T20:42:31.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T20:42:31.108 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/remote/smithi143/crash 2024-09-10T20:42:31.109 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T20:42:31.162 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T20:42:31.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:42:31.167 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T20:42:31.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T20:42:31.305 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T20:42:31.360 INFO:tasks.ceph:Compressing logs... 2024-09-10T20:42:31.360 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T20:42:31.365 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T20:42:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T20:42:31.415 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42580.log 2024-09-10T20:42:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49178.log 2024-09-10T20:42:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52788.log 2024-09-10T20:42:31.417 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42580.log.gz 2024-09-10T20:42:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2024-09-10T20:42:31.418 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2024-09-10T20:42:31.419 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36069.log 2024-09-10T20:42:31.419 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42261.log 2024-09-10T20:42:31.419 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52788.log.gz 2024-09-10T20:42:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50692.log 2024-09-10T20:42:31.421 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42261.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2024-09-10T20:42:31.421 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42261.log.gz 2024-09-10T20:42:31.421 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48309.log 2024-09-10T20:42:31.422 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T20:42:31.422 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.36069.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T20:42:31.422 INFO:teuthology.orchestra.run.smithi143.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36069.log.gz 2024-09-10T20:42:31.422 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T20:42:31.422 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T20:42:31.423 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42173.log 2024-09-10T20:42:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36056.log 2024-09-10T20:42:31.424 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50692.log.gz/var/log/ceph/ceph-client.admin.48309.log: 2024-09-10T20:42:31.424 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48543.log 2024-09-10T20:42:31.424 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48309.log.gz 2024-09-10T20:42:31.425 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47509.log 2024-09-10T20:42:31.425 INFO:teuthology.orchestra.run.smithi081.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36056.log.gz 2024-09-10T20:42:31.425 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48543.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48543.log.gz 2024-09-10T20:42:31.425 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43746.log 2024-09-10T20:42:31.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2024-09-10T20:42:31.428 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47509.log.gz 2024-09-10T20:42:31.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43368.log 2024-09-10T20:42:31.428 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43746.log.gz 2024-09-10T20:42:31.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2024-09-10T20:42:31.428 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2024-09-10T20:42:31.428 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35949.log 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.3.42173.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.3.42173.log.gz 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.35949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35989.log 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35949.log.gz 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35909.log 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.35989.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35989.log.gz 2024-09-10T20:42:31.429 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36109.log 2024-09-10T20:42:31.431 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.35909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36149.log 2024-09-10T20:42:31.432 INFO:teuthology.orchestra.run.smithi143.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35909.log.gz 2024-09-10T20:42:31.432 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.36109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41659.log 2024-09-10T20:42:31.432 INFO:teuthology.orchestra.run.smithi143.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36109.log.gz 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43368.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.43368.log.gz -5 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36927.log 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53124.log 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44742.log 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36927.log.gz 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50083.log 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53124.log.gz 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44742.log.gz 2024-09-10T20:42:31.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-09-10T20:42:31.435 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50083.log.gz 2024-09-10T20:42:31.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T20:42:31.435 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2024-09-10T20:42:31.438 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.36149.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36149.log.gz 2024-09-10T20:42:31.438 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36029.log 2024-09-10T20:42:31.438 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.1.41659.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T20:42:31.438 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.36029.log: 88.4% -- replaced with /var/log/ceph/ceph-client.1.41659.log.gz 2024-09-10T20:42:31.438 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35869.log 2024-09-10T20:42:31.438 INFO:teuthology.orchestra.run.smithi143.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36029.log.gz 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.35869.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi143.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.35869.log.gz 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52152.log 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50562.log 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52152.log.gz 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50562.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50562.log.gz 2024-09-10T20:42:31.439 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36380.log 2024-09-10T20:42:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T20:42:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mds.d.log: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T20:42:31.441 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41819.log 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36380.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36380.log.gz 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46686.log 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50274.log 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41819.log.gz 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46686.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46686.log.gz 2024-09-10T20:42:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53488.log 2024-09-10T20:42:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44325.log 2024-09-10T20:42:31.444 INFO:teuthology.orchestra.run.smithi081.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.50274.log.gz 2024-09-10T20:42:31.445 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43788.log 2024-09-10T20:42:31.445 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53488.log.gz 2024-09-10T20:42:31.445 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52914.log 2024-09-10T20:42:31.445 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44325.log.gz 2024-09-10T20:42:31.445 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T20:42:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43788.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43788.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.43536.log 2024-09-10T20:42:31.446 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T20:42:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52704.log 2024-09-10T20:42:31.447 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0%/var/log/ceph/ceph-client.admin.43536.log: -- replaced with /var/log/ceph/ceph-client.admin.52914.log.gz 2024-09-10T20:42:31.447 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43536.log.gz 2024-09-10T20:42:31.447 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52255.log 2024-09-10T20:42:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43249.log 2024-09-10T20:42:31.449 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52704.log.gz 2024-09-10T20:42:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52255.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52255.log.gz 2024-09-10T20:42:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47231.log 2024-09-10T20:42:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36142.log 2024-09-10T20:42:31.450 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43249.log.gz 2024-09-10T20:42:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47231.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47231.log.gz 2024-09-10T20:42:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41465.log 2024-09-10T20:42:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36142.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36142.log.gz 2024-09-10T20:42:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47590.log 2024-09-10T20:42:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41465.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41465.log.gz 2024-09-10T20:42:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51859.log 2024-09-10T20:42:31.453 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T20:42:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47189.log 2024-09-10T20:42:31.454 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47590.log.gz 2024-09-10T20:42:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51859.log: gzip -5 --verbose 87.3% -- -- replaced with /var/log/ceph/ceph-client.admin.51859.log.gz /var/log/ceph/ceph-client.admin.42003.log 2024-09-10T20:42:31.455 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T20:42:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36384.log 2024-09-10T20:42:31.455 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47189.log.gz 2024-09-10T20:42:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42003.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42003.log.gz 2024-09-10T20:42:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2024-09-10T20:42:31.457 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47885.log 2024-09-10T20:42:31.457 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36384.log.gz 2024-09-10T20:42:31.458 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44955.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2024-09-10T20:42:31.458 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-09-10T20:42:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47885.log: gzip -5 --verbose 87.2% -- -- replaced with /var/log/ceph/ceph-client.admin.47885.log.gz 2024-09-10T20:42:31.459 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.36364.log 2024-09-10T20:42:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48225.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-09-10T20:42:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46895.log 2024-09-10T20:42:31.461 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36364.log: gzip 86.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.36364.log.gz --verbose 2024-09-10T20:42:31.461 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.42219.log 2024-09-10T20:42:31.462 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46895.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46895.log.gz 2024-09-10T20:42:31.462 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47632.log 2024-09-10T20:42:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47021.log 2024-09-10T20:42:31.463 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42219.log.gz 2024-09-10T20:42:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53334.log 2024-09-10T20:42:31.464 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47632.log.gz 2024-09-10T20:42:31.465 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49101.log 2024-09-10T20:42:31.465 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47021.log.gz 2024-09-10T20:42:31.466 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53334.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53334.log.gz 2024-09-10T20:42:31.466 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49915.log 2024-09-10T20:42:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49101.log: 86.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.49101.log.gz -5 2024-09-10T20:42:31.467 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51589.log 2024-09-10T20:42:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49915.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49915.log.gz 2024-09-10T20:42:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43620.log 2024-09-10T20:42:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46287.log 2024-09-10T20:42:31.468 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51589.log.gz 2024-09-10T20:42:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43620.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.43620.log.gz 2024-09-10T20:42:31.469 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41961.log 2024-09-10T20:42:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2024-09-10T20:42:31.470 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46287.log.gz 2024-09-10T20:42:31.471 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41961.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41961.log.gz 2024-09-10T20:42:31.471 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42091.log 2024-09-10T20:42:31.472 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52339.log 2024-09-10T20:42:31.472 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2024-09-10T20:42:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42091.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42091.log.gz 2024-09-10T20:42:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52578.log 2024-09-10T20:42:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52339.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52339.log.gz 2024-09-10T20:42:31.474 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46245.log 2024-09-10T20:42:31.474 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52578.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52578.log.gz 2024-09-10T20:42:31.474 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-09-10T20:42:31.475 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35995.log 2024-09-10T20:42:31.476 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46245.log.gz 2024-09-10T20:42:31.477 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36833.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-09-10T20:42:31.477 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T20:42:31.477 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.35995.log: gzip -5 --verbose -- 86.4% /var/log/ceph/ceph-client.admin.46009.log -- replaced with /var/log/ceph/ceph-client.admin.35995.log.gz 2024-09-10T20:42:31.477 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T20:42:31.478 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42175.log 2024-09-10T20:42:31.479 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46009.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2024-09-10T20:42:31.479 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T20:42:31.479 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51715.log 2024-09-10T20:42:31.480 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2024-09-10T20:42:31.480 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42175.log.gz 2024-09-10T20:42:31.481 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51715.log: gzip -5 --verbose 87.4% -- -- replaced with /var/log/ceph/ceph-client.admin.51715.log.gz /var/log/ceph/ceph-client.admin.44307.log 2024-09-10T20:42:31.481 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T20:42:31.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43578.log: gzip 86.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz --verbose 2024-09-10T20:42:31.482 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.46818.log 2024-09-10T20:42:31.483 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42387.log 2024-09-10T20:42:31.483 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44307.log.gz 2024-09-10T20:42:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46818.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46818.log.gz 2024-09-10T20:42:31.484 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2024-09-10T20:42:31.485 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47315.log 2024-09-10T20:42:31.485 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42387.log.gz 2024-09-10T20:42:31.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49873.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2024-09-10T20:42:31.486 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46329.log 2024-09-10T20:42:31.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 87.4% 2024-09-10T20:42:31.487 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47315.log.gz 2024-09-10T20:42:31.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36348.log 2024-09-10T20:42:31.488 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.46329.log.gz 2024-09-10T20:42:31.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47801.log 2024-09-10T20:42:31.489 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2024-09-10T20:42:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36348.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36348.log.gz 2024-09-10T20:42:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-09-10T20:42:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47801.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47801.log.gz 2024-09-10T20:42:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48141.log 2024-09-10T20:42:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44784.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-09-10T20:42:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49220.log 2024-09-10T20:42:31.493 INFO:teuthology.orchestra.run.smithi143.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T20:42:31.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48141.log: gzip -5 87.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48141.log.gz -- 2024-09-10T20:42:31.493 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.52026.log 2024-09-10T20:42:31.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49220.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49220.log.gz -5 2024-09-10T20:42:31.493 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49747.log 2024-09-10T20:42:31.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49579.log 2024-09-10T20:42:31.494 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52026.log.gz 2024-09-10T20:42:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49747.log: gzip -5 87.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.49747.log.gz 2024-09-10T20:42:31.495 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.51547.log 2024-09-10T20:42:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36341.log 2024-09-10T20:42:31.496 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49579.log.gz 2024-09-10T20:42:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51547.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51547.log.gz 2024-09-10T20:42:31.497 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45469.log 2024-09-10T20:42:31.497 INFO:teuthology.orchestra.run.smithi143.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T20:42:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53530.log 2024-09-10T20:42:31.498 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36341.log.gz 2024-09-10T20:42:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45469.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45469.log.gz 2024-09-10T20:42:31.498 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49043.log 2024-09-10T20:42:31.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53530.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53530.log.gzgzip 2024-09-10T20:42:31.499 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51757.log 2024-09-10T20:42:31.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49043.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49043.log.gz 2024-09-10T20:42:31.500 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51505.log 2024-09-10T20:42:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43410.log 2024-09-10T20:42:31.502 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51757.log.gz 2024-09-10T20:42:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51505.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51505.log.gzgzip 2024-09-10T20:42:31.502 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52212.log 2024-09-10T20:42:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52998.log 2024-09-10T20:42:31.503 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43410.log.gz 2024-09-10T20:42:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52212.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.52212.log.gz 2024-09-10T20:42:31.504 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43494.log 2024-09-10T20:42:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2024-09-10T20:42:31.505 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52998.log.gz 2024-09-10T20:42:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43494.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43494.log.gz 2024-09-10T20:42:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53166.log 2024-09-10T20:42:31.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2024-09-10T20:42:31.507 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2024-09-10T20:42:31.508 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53166.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53166.log.gz 2024-09-10T20:42:31.508 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41919.log 2024-09-10T20:42:31.509 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44700.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2024-09-10T20:42:31.509 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51631.log 2024-09-10T20:42:31.509 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49999.log 87.3% 2024-09-10T20:42:31.509 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41919.log.gz 2024-09-10T20:42:31.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2024-09-10T20:42:31.510 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51631.log.gz 2024-09-10T20:42:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49999.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49999.log.gz 2024-09-10T20:42:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T20:42:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43452.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2024-09-10T20:42:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46937.log 2024-09-10T20:42:31.513 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48267.log 2024-09-10T20:42:31.514 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46937.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46937.log.gz 2024-09-10T20:42:31.514 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50358.log 2024-09-10T20:42:31.515 INFO:teuthology.orchestra.run.smithi081.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T20:42:31.515 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-09-10T20:42:31.515 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48267.log.gz 2024-09-10T20:42:31.516 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35850.log 2024-09-10T20:42:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43958.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.50358.log.gz 2024-09-10T20:42:31.517 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz --verbose 2024-09-10T20:42:31.517 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.51984.log 2024-09-10T20:42:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.35850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35850.log.gz 2024-09-10T20:42:31.518 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43704.log 2024-09-10T20:42:31.519 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44314.log 2024-09-10T20:42:31.519 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51984.log.gz 2024-09-10T20:42:31.520 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43704.log: gzip -5 87.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43704.log.gz -- 2024-09-10T20:42:31.520 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.52536.log 2024-09-10T20:42:31.521 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50509.log 2024-09-10T20:42:31.521 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44314.log.gz 2024-09-10T20:42:31.522 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52536.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52536.log.gzgzip 2024-09-10T20:42:31.522 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43981.log 2024-09-10T20:42:31.523 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52830.log 2024-09-10T20:42:31.523 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50509.log.gz 2024-09-10T20:42:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43981.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43981.log.gzgzip 2024-09-10T20:42:31.524 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48477.log 2024-09-10T20:42:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50908.log 2024-09-10T20:42:31.525 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52830.log.gz 2024-09-10T20:42:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43971.log 2024-09-10T20:42:31.526 INFO:teuthology.orchestra.run.smithi081.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48477.log.gz 2024-09-10T20:42:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50908.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50908.log.gz 2024-09-10T20:42:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53448.log 2024-09-10T20:42:31.527 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50442.log 2024-09-10T20:42:31.527 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43971.log.gz 2024-09-10T20:42:31.528 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2024-09-10T20:42:31.528 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53448.log.gz 2024-09-10T20:42:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2024-09-10T20:42:31.530 INFO:teuthology.orchestra.run.smithi081.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.50442.log.gz 2024-09-10T20:42:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47843.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2024-09-10T20:42:31.530 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42133.log 2024-09-10T20:42:31.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43018.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T20:42:31.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42133.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42133.log.gz 2024-09-10T20:42:31.533 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2024-09-10T20:42:31.533 INFO:teuthology.orchestra.run.smithi081.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2024-09-10T20:42:31.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49537.log 2024-09-10T20:42:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50650.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2024-09-10T20:42:31.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2024-09-10T20:42:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51186.log 2024-09-10T20:42:31.536 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49537.log.gz 2024-09-10T20:42:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45365.log 2024-09-10T20:42:31.537 INFO:teuthology.orchestra.run.smithi081.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2024-09-10T20:42:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.51186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2024-09-10T20:42:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.45365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52068.log 2024-09-10T20:42:31.540 INFO:teuthology.orchestra.run.smithi143.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T20:42:31.541 INFO:teuthology.orchestra.run.smithi081.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.51186.log.gz 2024-09-10T20:42:31.541 INFO:teuthology.orchestra.run.smithi081.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.0.45365.log.gz 2024-09-10T20:42:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44573.log 2024-09-10T20:42:31.541 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2024-09-10T20:42:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35871.log 2024-09-10T20:42:31.543 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52068.log.gz 2024-09-10T20:42:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44573.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44573.log.gz 2024-09-10T20:42:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51412.log 2024-09-10T20:42:31.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.35871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2024-09-10T20:42:31.544 INFO:teuthology.orchestra.run.smithi081.stderr: 75.7% -- replaced with /var/log/ceph/ceph-client.admin.35871.log.gz 2024-09-10T20:42:31.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46508.log 2024-09-10T20:42:31.546 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51412.log.gz 2024-09-10T20:42:31.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50604.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gz 2024-09-10T20:42:31.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2024-09-10T20:42:31.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2024-09-10T20:42:31.547 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz 2024-09-10T20:42:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46413.log 2024-09-10T20:42:31.548 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2024-09-10T20:42:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53376.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2024-09-10T20:42:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2024-09-10T20:42:31.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2024-09-10T20:42:31.550 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46413.log.gz 2024-09-10T20:42:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49789.log 2024-09-10T20:42:31.551 INFO:teuthology.orchestra.run.smithi081.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2024-09-10T20:42:31.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49621.log 2024-09-10T20:42:31.552 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2024-09-10T20:42:31.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49789.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49789.log.gz 2024-09-10T20:42:31.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T20:42:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-09-10T20:42:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49621.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49621.log.gz 2024-09-10T20:42:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43967.log 2024-09-10T20:42:31.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48015.log 2024-09-10T20:42:31.557 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-09-10T20:42:31.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48821.log 2024-09-10T20:42:31.560 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43967.log.gz 2024-09-10T20:42:31.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52662.log 2024-09-10T20:42:31.560 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48015.log.gz 2024-09-10T20:42:31.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.48821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49451.log 2024-09-10T20:42:31.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44320.log 2024-09-10T20:42:31.562 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52662.log.gz 2024-09-10T20:42:31.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52110.log 2024-09-10T20:42:31.563 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.49451.log.gz 2024-09-10T20:42:31.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44320.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44320.log.gz 2024-09-10T20:42:31.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52110.log: 94.0% -- replaced with /var/log/ceph/ceph-client.0.48821.log.gz 2024-09-10T20:42:31.565 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52110.log.gz 2024-09-10T20:42:31.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53208.log 2024-09-10T20:42:31.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36319.log 2024-09-10T20:42:31.567 INFO:teuthology.orchestra.run.smithi143.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T20:42:31.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43974.log 2024-09-10T20:42:31.568 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53208.log.gz 2024-09-10T20:42:31.569 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2024-09-10T20:42:31.569 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36319.log.gz 2024-09-10T20:42:31.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46371.log 2024-09-10T20:42:31.570 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43974.log.gz 2024-09-10T20:42:31.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51817.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T20:42:31.572 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2024-09-10T20:42:31.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 2024-09-10T20:42:31.573 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46371.log.gz 2024-09-10T20:42:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36631.log 2024-09-10T20:42:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36383.log 2024-09-10T20:42:31.576 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz 2024-09-10T20:42:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36631.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36631.log.gz 2024-09-10T20:42:31.577 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45967.log 2024-09-10T20:42:31.578 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36383.log: gzip 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36383.log.gz 2024-09-10T20:42:31.579 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46161.log 2024-09-10T20:42:31.579 INFO:teuthology.orchestra.run.smithi081.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T20:42:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45967.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45967.log.gz 2024-09-10T20:42:31.579 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46760.log 2024-09-10T20:42:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2024-09-10T20:42:31.581 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46161.log.gz 2024-09-10T20:42:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43662.log 2024-09-10T20:42:31.582 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46760.log.gz 2024-09-10T20:42:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50041.log 2024-09-10T20:42:31.583 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2024-09-10T20:42:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47674.log 2024-09-10T20:42:31.585 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43662.log.gz 2024-09-10T20:42:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48057.log 2024-09-10T20:42:31.586 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50041.log.gz 2024-09-10T20:42:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47674.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T20:42:31.587 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47674.log.gz 2024-09-10T20:42:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44310.log 2024-09-10T20:42:31.588 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48057.log.gz 2024-09-10T20:42:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2024-09-10T20:42:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44310.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T20:42:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-09-10T20:42:31.590 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44310.log.gz 2024-09-10T20:42:31.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47927.log 2024-09-10T20:42:31.592 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gz 2024-09-10T20:42:31.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2024-09-10T20:42:31.593 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-09-10T20:42:31.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47273.log 2024-09-10T20:42:31.594 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47927.log.gz 2024-09-10T20:42:31.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42047.log 2024-09-10T20:42:31.595 INFO:teuthology.orchestra.run.smithi081.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2024-09-10T20:42:31.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51673.log 2024-09-10T20:42:31.597 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47273.log.gz 2024-09-10T20:42:31.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47063.log 2024-09-10T20:42:31.598 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42047.log.gz 2024-09-10T20:42:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48435.log 2024-09-10T20:42:31.599 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51673.log.gz 2024-09-10T20:42:31.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50148.log 2024-09-10T20:42:31.600 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47063.log.gz 2024-09-10T20:42:31.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46203.log 2024-09-10T20:42:31.601 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48435.log.gz 2024-09-10T20:42:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44826.log 2024-09-10T20:42:31.603 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50148.log.gz 2024-09-10T20:42:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52956.log 2024-09-10T20:42:31.604 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46203.log.gz 2024-09-10T20:42:31.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51901.log 2024-09-10T20:42:31.605 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44826.log.gz 2024-09-10T20:42:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43326.log 2024-09-10T20:42:31.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52956.log.gz 2024-09-10T20:42:31.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44616.log 2024-09-10T20:42:31.608 INFO:teuthology.orchestra.run.smithi081.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.51901.log.gz 2024-09-10T20:42:31.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2024-09-10T20:42:31.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43326.log.gz 2024-09-10T20:42:31.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2024-09-10T20:42:31.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2024-09-10T20:42:31.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52381.log 2024-09-10T20:42:31.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2024-09-10T20:42:31.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-10T20:42:31.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-09-10T20:42:31.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43191.log 2024-09-10T20:42:31.613 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52381.log.gz 2024-09-10T20:42:31.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42514.log 2024-09-10T20:42:31.615 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-10T20:42:31.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48393.log 2024-09-10T20:42:31.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43191.log.gz 2024-09-10T20:42:31.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42471.log 2024-09-10T20:42:31.618 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42514.log.gz 2024-09-10T20:42:31.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2024-09-10T20:42:31.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48393.log.gz 2024-09-10T20:42:31.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52297.log 2024-09-10T20:42:31.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42471.log.gz 2024-09-10T20:42:31.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50866.log 2024-09-10T20:42:31.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2024-09-10T20:42:31.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45863.log 2024-09-10T20:42:31.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52297.log.gz 2024-09-10T20:42:31.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2024-09-10T20:42:31.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50866.log.gz 2024-09-10T20:42:31.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.45863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46644.log 2024-09-10T20:42:31.625 INFO:teuthology.orchestra.run.smithi081.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.2.45863.log.gz 2024-09-10T20:42:31.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2024-09-10T20:42:31.626 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2024-09-10T20:42:31.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46644.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29815.log 2024-09-10T20:42:31.627 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46644.log.gz 2024-09-10T20:42:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2024-09-10T20:42:31.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz 2024-09-10T20:42:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.29815.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29815.log.gz 2024-09-10T20:42:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52620.log 2024-09-10T20:42:31.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35934.log 2024-09-10T20:42:31.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-09-10T20:42:31.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48099.log 2024-09-10T20:42:31.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52620.log.gz 2024-09-10T20:42:31.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.35934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35974.log 2024-09-10T20:42:31.633 INFO:teuthology.orchestra.run.smithi081.stderr: 76.1% -- replaced with /var/log/ceph/ceph-client.admin.35934.log.gz 2024-09-10T20:42:31.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49705.log 2024-09-10T20:42:31.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48099.log.gz 2024-09-10T20:42:31.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.35974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52746.log 2024-09-10T20:42:31.636 INFO:teuthology.orchestra.run.smithi081.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.35974.log.gz 2024-09-10T20:42:31.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42303.log 2024-09-10T20:42:31.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49705.log.gz 2024-09-10T20:42:31.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53082.log 2024-09-10T20:42:31.638 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52746.log.gz 2024-09-10T20:42:31.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50190.log 2024-09-10T20:42:31.639 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42303.log.gz 2024-09-10T20:42:31.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2024-09-10T20:42:31.640 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53082.log.gz 2024-09-10T20:42:31.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51942.log 2024-09-10T20:42:31.642 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50190.log.gz 2024-09-10T20:42:31.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49957.log 2024-09-10T20:42:31.643 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2024-09-10T20:42:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42429.log 2024-09-10T20:42:31.644 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51942.log.gz 2024-09-10T20:42:31.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48351.log 2024-09-10T20:42:31.645 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49957.log.gz 2024-09-10T20:42:31.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52872.log 2024-09-10T20:42:31.646 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42429.log.gz 2024-09-10T20:42:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36397.log 2024-09-10T20:42:31.648 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48351.log.gz 2024-09-10T20:42:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48183.log 2024-09-10T20:42:31.649 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52872.log.gz 2024-09-10T20:42:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53292.log 2024-09-10T20:42:31.650 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36397.log.gz 2024-09-10T20:42:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48183.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48183.log.gz 2024-09-10T20:42:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47717.log 2024-09-10T20:42:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53292.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T20:42:31.653 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53292.log.gz 2024-09-10T20:42:31.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47717.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T20:42:31.654 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47717.log.gz 2024-09-10T20:42:31.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49831.log 2024-09-10T20:42:31.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2024-09-10T20:42:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49831.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49831.log.gz 2024-09-10T20:42:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43977.log 2024-09-10T20:42:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44658.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2024-09-10T20:42:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46566.log 2024-09-10T20:42:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43977.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43977.log.gz 2024-09-10T20:42:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50316.log 2024-09-10T20:42:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46566.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46566.log.gz 2024-09-10T20:42:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53250.log 2024-09-10T20:42:31.665 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50316.log: /var/log/ceph/ceph-client.admin.53250.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53250.log.gz 2024-09-10T20:42:31.666 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.50316.log.gz 2024-09-10T20:42:31.685 INFO:teuthology.orchestra.run.smithi081.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T20:42:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T20:42:32.161 INFO:teuthology.orchestra.run.smithi143.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T20:42:32.227 INFO:teuthology.orchestra.run.smithi143.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T20:42:32.242 INFO:teuthology.orchestra.run.smithi081.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T20:42:32.244 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T20:42:32.252 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T20:42:32.253 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T20:42:32.256 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-09-10T20:42:32.257 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m0.859s 2024-09-10T20:42:32.257 INFO:teuthology.orchestra.run.smithi143.stderr:user 0m3.274s 2024-09-10T20:42:32.257 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m0.366s 2024-09-10T20:42:32.303 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T20:42:32.474 INFO:teuthology.orchestra.run.smithi081.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T20:42:32.478 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T20:42:32.478 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m1.086s 2024-09-10T20:42:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m3.286s 2024-09-10T20:42:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.833s 2024-09-10T20:42:32.479 INFO:tasks.ceph:Archiving logs... 2024-09-10T20:42:32.480 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/remote/smithi081/log 2024-09-10T20:42:32.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T20:42:33.146 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/remote/smithi143/log 2024-09-10T20:42:33.147 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T20:42:33.653 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T20:42:33.661 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T20:42:33.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T20:42:33.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T20:42:33.794 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T20:42:33.802 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T20:42:33.802 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:42:33.807 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T20:42:33.836 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:42:33.840 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-10T20:42:33.843 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:42:33.843 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-10T20:42:33.843 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 -647us[ -634us] +/- 49ms 2024-09-10T20:42:33.843 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +1988us[+1988us] +/- 65ms 2024-09-10T20:42:33.843 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -1561us[-1549us] +/- 90ms 2024-09-10T20:42:33.843 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:42:33.847 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T20:42:33.847 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-10T20:42:33.847 INFO:teuthology.orchestra.run.smithi143.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -649us[ -663us] +/- 49ms 2024-09-10T20:42:33.847 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +2004us[+1990us] +/- 65ms 2024-09-10T20:42:33.847 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -1557us[-1557us] +/- 90ms 2024-09-10T20:42:33.847 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T20:42:33.848 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T20:42:33.857 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T20:42:33.857 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T20:42:33.865 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T20:42:34.006 DEBUG:teuthology.orchestra.run.smithi143:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T20:42:34.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:42:34.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:42:34.180 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-10T20:42:34.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:42:34.240 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T20:42:34.249 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T20:42:34.257 INFO:teuthology.task.internal:Duration was 625.175944 seconds 2024-09-10T20:42:34.258 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T20:42:34.266 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T20:42:34.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T20:42:34.270 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T20:42:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:42:34.357 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:42:34.732 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T20:42:34.732 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T20:42:34.733 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T20:42:34.782 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-09-10T20:42:34.782 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T20:42:34.834 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T20:42:34.834 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T20:42:34.838 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T20:42:34.899 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T20:42:34.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T20:42:34.903 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T20:42:35.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T20:42:35.064 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T20:42:35.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T20:42:35.120 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T20:42:35.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T20:42:35.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:42:35.190 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:42:35.257 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-10T20:42:35.261 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-09-10T20:42:35.290 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:42:35.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:42:35.324 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T20:42:35.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:42:35.357 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T20:42:35.367 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T20:42:35.368 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/remote/smithi081 2024-09-10T20:42:35.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T20:42:35.432 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899626/remote/smithi143 2024-09-10T20:42:35.432 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T20:42:35.495 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T20:42:35.495 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T20:42:35.500 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T20:42:35.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T20:42:35.546 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T20:42:35.546 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T20:42:35.555 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T20:42:35.555 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T20:42:35.575 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T20:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: 393602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 20:42 /home/ubuntu/cephtest 2024-09-10T20:42:35.610 INFO:teuthology.orchestra.run.smithi143.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 20:42 /home/ubuntu/cephtest 2024-09-10T20:42:35.613 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T20:42:35.623 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T20:42:35.646 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/alternate-pool} duration: 625.1759436130524 flavor: default mon.a-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a mon.b-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a owner: scheduled_hyelloji@teuthology success: true 2024-09-10T20:42:35.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T20:42:35.819 INFO:teuthology.run:pass